-- Logs begin at Mon 2022-08-29 22:04:06 UTC, end at Mon 2022-08-29 23:18:36 UTC. -- Aug 29 22:36:33.058556 dv-cinder-854271-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 22:36:33 2022] *** Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: nodename: dv-cinder-854271-4-smb Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: machine: x86_64 Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: clock source: unix Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: pcre jit disabled Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: detected number of CPU cores: 4 Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: current working directory: / Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: detected binary path: /usr/bin/uwsgi-core Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: your processes number limit is 47680 Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: your memory page size is 4096 bytes Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: detected max file descriptor number: 2048 Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: lock engine: pthread robust mutexes Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: thunder lock: enabled Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 22:36:33.077165 dv-cinder-854271-4-smb devstack@keystone.service[88540]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 22:36:33.114655 dv-cinder-854271-4-smb devstack@keystone.service[88540]: Python main interpreter initialized at 0x557647ad79c0 Aug 29 22:36:33.114655 dv-cinder-854271-4-smb devstack@keystone.service[88540]: python threads support enabled Aug 29 22:36:33.114655 dv-cinder-854271-4-smb devstack@keystone.service[88540]: your server socket listen backlog is limited to 100 connections Aug 29 22:36:33.114655 dv-cinder-854271-4-smb devstack@keystone.service[88540]: your mercy for graceful operations on workers is 90 seconds Aug 29 22:36:33.115188 dv-cinder-854271-4-smb devstack@keystone.service[88540]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 22:36:33.115296 dv-cinder-854271-4-smb devstack@keystone.service[88540]: *** Operational MODE: preforking *** Aug 29 22:36:33.115565 dv-cinder-854271-4-smb devstack@keystone.service[88540]: *** uWSGI is running in multiple interpreter mode *** Aug 29 22:36:33.115565 dv-cinder-854271-4-smb devstack@keystone.service[88540]: spawned uWSGI master process (pid: 88540) Aug 29 22:36:33.116419 dv-cinder-854271-4-smb devstack@keystone.service[88540]: spawned uWSGI worker 1 (pid: 88552, cores: 1) Aug 29 22:36:33.116661 dv-cinder-854271-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 22:36:33.117054 dv-cinder-854271-4-smb devstack@keystone.service[88540]: spawned uWSGI worker 2 (pid: 88553, cores: 1) Aug 29 22:36:33.117054 dv-cinder-854271-4-smb devstack@keystone.service[88540]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 22:36:37.726477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:36:37.726477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: from cryptography.utils import int_from_bytes Aug 29 22:36:37.727276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:36:37.727276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: from cryptography.utils import int_from_bytes Aug 29 22:36:37.731405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:36:37.731405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: from cryptography.utils import int_from_bytes Aug 29 22:36:37.732026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:36:37.732026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: from cryptography.utils import int_from_bytes Aug 29 22:36:37.779207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:36:37.779490 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:36:37.779636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:36:37.779792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:36:37.779932 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] command line args: [] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:36:37.780057 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] command line args: [] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:36:37.780184 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:36:37.780336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:36:37.780477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ================================================================================ {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:36:37.780626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ================================================================================ {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:36:37.780763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] admin_token = **** {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.780902 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] admin_token = **** {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.781185 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] config_dir = [] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.781326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] config_dir = [] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.781534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.781724 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.781909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] config_source = [] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.781909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] debug = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.782238 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] config_source = [] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.782486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.782809 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] debug = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.782809 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.783156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.783339 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.783556 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.783732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.783889 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.783889 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.784272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.784521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] list_limit = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.784521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] log_config_append = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.784521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.785017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.785217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] log_dir = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.785217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] log_file = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.785526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] list_limit = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.785719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.785915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] log_config_append = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.786040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.786220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.786411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.786544 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] log_dir = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.786734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.786734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.787049 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] log_file = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.787228 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.787356 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.787533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.787533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.787830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.787960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.787960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.788212 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.788353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.788353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.788574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.788818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.788954 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.789132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.789263 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.789422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.790159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.790299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.790299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] publish_errors = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.790595 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.790738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.790852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.790952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.790952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.790952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.791240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.791240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.791378 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.791378 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] standard_threads = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.791553 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.791632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.791632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.791821 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.791951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.791951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] use_journal = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.791951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] use_json = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.791951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] use_stderr = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.792349 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.792432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] use_syslog = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.792432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.792577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.792690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.792690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.792690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.792690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.792993 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.793120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.793195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] publish_errors = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.793263 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.793335 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.793408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.793408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.793589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.793668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.793736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.793809 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.793809 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.794053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.794158 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.794236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.794316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.794316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.794515 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] standard_threads = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.794642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.794774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.794888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.794888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.795123 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.795218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.795333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.795410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.795530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.795609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] use_journal = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.795742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.795856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] use_json = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.796003 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.796082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] use_stderr = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.796304 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.796430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] use_syslog = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.796567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.796772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:36:37.796899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.797048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.797243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.797319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.797508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.797592 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.797749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.797996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.798082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.798248 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.798416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.798501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.798712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.798818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.798966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.799219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.799294 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.799462 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.799664 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.799739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.799941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.800016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.800184 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.800449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.800527 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.800686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.800926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.801042 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.801161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.801284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.801398 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.801512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.801623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.801739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.801850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.801968 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.802080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.802217 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.802333 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.802509 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.802630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.802749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.802860 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.802970 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.803080 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.803223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.803345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.803466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.803576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.803691 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.803786 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.803918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.804018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.804160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.804309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.804420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.804573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.804762 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.804878 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.804974 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.805076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.805177 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.805272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.805369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.805495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.805616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.805730 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.805825 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.805974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.806120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.806246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.806358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.806467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.806575 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.806687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.806798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.806909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.807079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.807209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.807323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.807435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.807555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.807678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.807791 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.807910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.808020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.808131 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.808310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.808422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.808570 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.808703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.808817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.808919 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.809037 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.809155 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.809267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.809387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.809500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.809617 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.809729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.809839 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.809953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.810073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.810186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.810296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.810407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.810519 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.810630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.810800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.810918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.811031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.811142 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.811253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.811455 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.811580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.811753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.811874 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.812007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.812152 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.812293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.812516 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.812632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.812750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.812862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.812995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.813152 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.813347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.813463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.813573 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.813684 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.813801 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.813913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.814105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.814314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.814500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.814646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.814770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.814953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.815126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.815314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.815491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.815491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.815840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.816023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.816023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.816491 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.817203 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.817203 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.817527 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.817712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] auth.external = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.817895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.818087 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.818274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.818648 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.818648 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.818965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.819150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] auth.password = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.819297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.819434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] auth.token = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.819434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.819757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.819938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.820091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.820313 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.820492 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.820612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.820612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.820905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.821088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.821285 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.821463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.821746 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.821890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] credential.caching = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.822012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.822171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.822371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.822553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.822736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.822881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.822881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.823130 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.823327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.823501 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.823667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.823667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.823992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.824164 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.824374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.824561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.824756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.824952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.824952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.825291 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.825472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.825602 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.825764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.825954 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.826119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.826306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.826483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.826483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] federation.caching = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.826732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.826916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.827071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.827257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.827411 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.827595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.827595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.827903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.828038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.828245 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.828384 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.828384 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.828746 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.828932 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.829104 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.829223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.829337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.829515 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.829707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.829893 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.830060 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.830227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity.caching = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.830227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.830537 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.830694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.830879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.831046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.831243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.831415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.831415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.831415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.831796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.831971 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.832287 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.832478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.832829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.833085 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.833272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.833457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.833457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.833789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.833922 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.834078 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.834267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.834434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] auth.external = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.834619 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.834619 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.834987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.835132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.835248 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.835397 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.835584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.835758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.835758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.836079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] auth.password = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.836284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.836439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] auth.token = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.836556 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.836695 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.836976 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.836976 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.837326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.837489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.837623 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.837809 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.837951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.838132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.838303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.838487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.838672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.838807 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.838807 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.839084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.839264 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.839435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] credential.caching = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.839607 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.839607 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.839948 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.840105 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.840258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.840427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.840427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.840744 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.840946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.841074 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.841227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.841227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.841567 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.841757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.841954 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.842142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.842327 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.842459 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.842572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.842736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.842736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.843054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.843240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.843413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.843596 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.843596 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.843862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.844002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.844210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.844374 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.844374 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.844707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.844878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.845055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.845195 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.845339 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.845523 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.845523 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.845857 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] federation.caching = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.846024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.846142 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.846297 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.846485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.846650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.846650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.846985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.847168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.847353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.847480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.847615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.848361 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.848361 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.848889 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.849077 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.849261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.849462 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.849462 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.849793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.849948 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.850065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.850246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.850413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.850597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.850597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.850946 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.851075 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.851258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity.caching = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.851420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.851614 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.851775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.851775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.852119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.852299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.852444 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.852634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.852796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.852981 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.853139 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.853324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.853324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.853928 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.854111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.854298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.854473 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.854473 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.854790 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.854924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.854924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.855182 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.855392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.855569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.855769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.855912 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.856027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.856206 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.856383 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.856533 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.856735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.856918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.857107 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] resource.caching = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.857107 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.857341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.857503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.857688 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.857866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.858031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.858218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.858218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.858534 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.858688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.858873 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.859061 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.859246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.859430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.859564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.859688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.859688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] role.caching = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.860016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.860208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] role.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.860362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.860550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.860747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.860887 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.860887 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.861141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.861328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.861499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.861672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.861841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.862021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.862195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.862315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.862315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.862652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.862830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.863012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.863159 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.863276 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.863430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.863430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.864175 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.864290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.864403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.864515 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.864641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.864816 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.864936 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.865051 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.865163 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.865276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.865471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.865587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.865699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.865812 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.865812 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.866023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.866143 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.866241 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.866335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.866431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.866547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.866660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.866780 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.866780 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.866992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.867104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.867215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.867327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.867448 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.867561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.867561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.867770 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.867881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.868000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.868121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.868121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.868347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.868460 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.868572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.868684 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] token.caching = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.868809 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.868924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.869035 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.869147 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.869147 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.869357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.869477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.869591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.869704 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.869815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.869928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.870039 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.870159 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.870159 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.870370 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.870482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.870594 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.870706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.870826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.870939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.871051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.871170 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.871170 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.871381 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.871505 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.871619 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.871732 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.871852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.871974 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.871974 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.872185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.872377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.connection = **** {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.872491 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.872604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.872721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.872833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.872945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.873065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.873065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.873311 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.873426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.873539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.873650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.873650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.873871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.873983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.874095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.874206 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.874206 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.874424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.874538 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.874649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.874762 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.874875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.874986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.875106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.875219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.875219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.875429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.875541 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.875653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.875773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.875887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.875999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.875999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:36:37.876267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.876267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.876267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.876267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.876267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.876267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.876267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.876267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.876267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.877186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.877186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] resource.caching = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.877186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.877186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.877186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.877186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.877186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.877186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.877186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.878089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.878089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.878089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] role.caching = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.878089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] role.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.878089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.878089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.878089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.878089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.878089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.879332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.879332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.879332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.879332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.879332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.879332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.879953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.879953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.880304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.880841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.881127 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.881427 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.881758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.882036 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.882424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.882725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.883063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.883358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.883666 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.883965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.884292 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.884600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.884966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.885300 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.885615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.885922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.886309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.886632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.887008 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] token.caching = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.887312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.887737 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.888174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.888689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.889112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.889436 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.889791 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.890082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.890424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.890682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.890983 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.891288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.891608 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.891959 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.892287 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.892687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.892988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.893321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.connection = **** {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.893673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.893998 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.894301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.894660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.895183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.895479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.895776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.896050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.896419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.896788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.897120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.897487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.897795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.898098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.898434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.898758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.898876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:37.899066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:37.899196 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.899311 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:37.899428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:36:37.899661 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:36:37.907917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:37.938181 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:37.938423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:37.939747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:37.940035 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:37.940393 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:37.951608 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:37.977510 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:37.977712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:37.995218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.017684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.046691 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.047005 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.055598 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.055832 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.118634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.119098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.119344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.119576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.119803 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.120033 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.148326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.148549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.148773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.148997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.149221 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.149441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.149659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.162577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.203838 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.204073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.204378 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.204611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.204842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.205069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.219417 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.219672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.219866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.220097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.220355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.220579 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.220803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.230338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.242549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.242766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.243003 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.243234 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.243461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.243685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.243905 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.256781 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.257012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.257245 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.257474 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.257696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.257917 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.258135 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:36:38.261482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.261697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:36:38.262059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.262264 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:36:38.262545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.262816 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.263084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.263351 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.268138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.268369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:36:38.268719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.268922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:36:38.269205 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.269479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.270270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.270538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.274080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.274376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.274658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.274948 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.280165 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.280479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.280767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.281061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.282110 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.285100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.285945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.286318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.286818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.287216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.287491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.287774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.288062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.288372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.288663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.288785 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.288944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.291708 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.291992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.292314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.292601 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.292888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.293152 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.293426 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.293703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.293981 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.294260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.294530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.312129 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.313670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.313965 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.318122 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.318621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.318911 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.319208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.319626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.319918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.324517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.324925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.325219 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.325792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.326098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.330122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.330425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.330725 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.331024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.331313 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.331695 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.331995 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.334067 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.334451 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.334755 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.336600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.336900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.337187 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.337597 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.337879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.338325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.338608 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.338885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.351342 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.351639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.355875 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.356133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.356304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.360604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.360742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.361029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.363983 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.364427 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.365571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.368673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.368771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.371805 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.371946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.372183 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.372509 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.372814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.373106 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.373504 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.374942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.375243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.375645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.375947 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.376256 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.376551 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.389688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.390007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.390265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.390544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.392531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.402628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.402628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.402628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.402891 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.402891 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.403123 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.403189 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.403189 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.403903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.404065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.404399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.404698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.404996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.405291 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.405512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.405796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.408487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.408778 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.409072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.409456 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.409741 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.417531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.417825 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.418120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.418405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.418693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.418985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.419281 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.421887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.422206 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.422499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.422825 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.423080 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.423755 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.423837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.435671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.438788 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.440361 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.442289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.443862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.444006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.445385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.445684 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.445977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.446942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.448407 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.449922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.450216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.450497 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.452562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.454072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.456996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.457250 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.457401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.457829 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.458254 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.458747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.461765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.462065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.462363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.462645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.466380 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.466687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.466984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.470701 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.471001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.471286 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.474704 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.475000 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.475287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.478773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.478773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.478773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.478773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.478773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.478773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.479457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.479457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.479457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.479457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.479457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.479966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:36:38.479966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.479966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.479966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.480291 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.480500 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.480677 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.480963 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.481244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.481517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.481794 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.482073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.482356 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.482615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:36:38.514180 dv-cinder-854271-4-smb devstack@keystone.service[88552]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557647ad79c0 pid: 88552 (default app) Aug 29 22:36:38.516901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557647ad79c0 pid: 88553 (default app) Aug 29 22:36:38.517879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6a13-dc61-4140-8dc3-afc16a77fda8 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:38.518176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6a13-dc61-4140-8dc3-afc16a77fda8 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:38.518452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6a13-dc61-4140-8dc3-afc16a77fda8 None None] PATH_INFO: `/v3` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:38.523026 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 791 bytes} [Mon Aug 29 22:36:38 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:36:46.335527 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e0bb2-883c-4e27-b834-6283800bb0c6 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:46.336444 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e0bb2-883c-4e27-b834-6283800bb0c6 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:46.336444 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e0bb2-883c-4e27-b834-6283800bb0c6 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:46.340455 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1/2] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:36:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:36:46.348503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec278938-372e-49b7-96b1-6b81f48ea371 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:46.349169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec278938-372e-49b7-96b1-6b81f48ea371 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:46.349169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec278938-372e-49b7-96b1-6b81f48ea371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:46.423254 dv-cinder-854271-4-smb devstack@keystone.service[88552]: INFO dbcounter [None req-ec278938-372e-49b7-96b1-6b81f48ea371 None None] Registered counter for database keystone Aug 29 22:36:46.446284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG oslo_db.sqlalchemy.engines [None req-ec278938-372e-49b7-96b1-6b81f48ea371 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:36:46.453249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writer thread running {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:36:46.652409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG passlib.handlers.bcrypt [None req-ec278938-372e-49b7-96b1-6b81f48ea371 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88552) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 22:36:46.652723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG passlib.handlers.bcrypt [None req-ec278938-372e-49b7-96b1-6b81f48ea371 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88552) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 22:36:46.714388 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-ec278938-372e-49b7-96b1-6b81f48ea371 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:36:46.716081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ec278938-372e-49b7-96b1-6b81f48ea371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:46.866802 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 2/3] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:36:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 22:36:47.350017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e0bb2-883c-4e27-b834-6283800bb0c6 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:47.423547 dv-cinder-854271-4-smb devstack@keystone.service[88553]: INFO dbcounter [None req-290e0bb2-883c-4e27-b834-6283800bb0c6 None None] Registered counter for database keystone Aug 29 22:36:47.444808 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG oslo_db.sqlalchemy.engines [None req-290e0bb2-883c-4e27-b834-6283800bb0c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:36:47.451280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writer thread running {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:36:47.575244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e0bb2-883c-4e27-b834-6283800bb0c6 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:47.579523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7219a-5b52-4cc3-825a-f96ece03c346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:47.580145 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7219a-5b52-4cc3-825a-f96ece03c346 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:47.580450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7219a-5b52-4cc3-825a-f96ece03c346 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:47.580723 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7219a-5b52-4cc3-825a-f96ece03c346 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:47.590540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7219a-5b52-4cc3-825a-f96ece03c346 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:47.646868 dv-cinder-854271-4-smb devstack@keystone.service[88553]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fab7219a-5b52-4cc3-825a-f96ece03c346 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 22:36:47.647113 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7219a-5b52-4cc3-825a-f96ece03c346 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:47.657699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 2/4] 10.222.0.72 () {58 vars in 1324 bytes} [Mon Aug 29 22:36:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:36:47.664434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec278938-372e-49b7-96b1-6b81f48ea371 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:47.679921 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec278938-372e-49b7-96b1-6b81f48ea371 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:47.684549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48502fcc-3061-4955-a674-9eb056ac63ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:47.685685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48502fcc-3061-4955-a674-9eb056ac63ea admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:47.685974 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48502fcc-3061-4955-a674-9eb056ac63ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:47.686251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48502fcc-3061-4955-a674-9eb056ac63ea admin admin] PATH_INFO: `/v3/projects/3c5435e2f5ae455ab9a7fc1e7c010ec4` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:47.687899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48502fcc-3061-4955-a674-9eb056ac63ea admin admin] RBAC: Authorizing `identity:get_project(project_id=3c5435e2f5ae455ab9a7fc1e7c010ec4)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:47.742231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: WARNING keystone.common.rbac_enforcer.enforcer [None req-48502fcc-3061-4955-a674-9eb056ac63ea admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 22:36:47.742627 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48502fcc-3061-4955-a674-9eb056ac63ea admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:47.747521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 3/5] 10.222.0.72 () {56 vars in 1207 bytes} [Mon Aug 29 22:36:47 2022] GET /identity/v3/projects/3c5435e2f5ae455ab9a7fc1e7c010ec4 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:36:49.866356 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b6d4b-fab3-4950-b43d-d9feb8692c68 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:49.867034 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b6d4b-fab3-4950-b43d-d9feb8692c68 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:49.867034 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b6d4b-fab3-4950-b43d-d9feb8692c68 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:49.871339 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 3/6] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:36:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:36:49.877712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7ef73-d9d3-4c3a-aa5a-20ec6abaaf6a None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:49.878239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7ef73-d9d3-4c3a-aa5a-20ec6abaaf6a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:49.878836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7ef73-d9d3-4c3a-aa5a-20ec6abaaf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:49.900882 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-abf7ef73-d9d3-4c3a-aa5a-20ec6abaaf6a None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:36:49.902421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-abf7ef73-d9d3-4c3a-aa5a-20ec6abaaf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:49.910738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 4/7] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:36:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 22:36:50.190982 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b6d4b-fab3-4950-b43d-d9feb8692c68 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:50.204763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b6d4b-fab3-4950-b43d-d9feb8692c68 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:50.209611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef1d81-1008-4a8a-bb31-29de9188fd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:50.210243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef1d81-1008-4a8a-bb31-29de9188fd8f admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:50.210547 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef1d81-1008-4a8a-bb31-29de9188fd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:50.210819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef1d81-1008-4a8a-bb31-29de9188fd8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:50.219531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef1d81-1008-4a8a-bb31-29de9188fd8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:50.221601 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef1d81-1008-4a8a-bb31-29de9188fd8f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:50.231407 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 4/8] 10.222.0.72 () {58 vars in 1324 bytes} [Mon Aug 29 22:36:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:36:50.237575 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7ef73-d9d3-4c3a-aa5a-20ec6abaaf6a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:50.248407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7ef73-d9d3-4c3a-aa5a-20ec6abaaf6a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:50.252851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90257b-c3f1-4861-92ec-7de87ff9beba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:50.254457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90257b-c3f1-4861-92ec-7de87ff9beba admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:50.254847 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90257b-c3f1-4861-92ec-7de87ff9beba admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:50.255133 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90257b-c3f1-4861-92ec-7de87ff9beba admin admin] PATH_INFO: `/v3/users/179ea3f8c1ea4c8fb5be02793b645d99` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:50.256566 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90257b-c3f1-4861-92ec-7de87ff9beba admin admin] RBAC: Authorizing `identity:get_user(user_id=179ea3f8c1ea4c8fb5be02793b645d99)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:50.258458 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90257b-c3f1-4861-92ec-7de87ff9beba admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:50.260041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 5/9] 10.222.0.72 () {56 vars in 1198 bytes} [Mon Aug 29 22:36:50 2022] GET /identity/v3/users/179ea3f8c1ea4c8fb5be02793b645d99 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:36:52.358050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47fa21-ef35-4af5-9665-050c28ff1ddf None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:52.358629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47fa21-ef35-4af5-9665-050c28ff1ddf None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:52.358747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47fa21-ef35-4af5-9665-050c28ff1ddf None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:52.360013 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 5/10] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:36:52.365432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea90ba-0303-4e5b-87fc-280e2aeeb1df None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:52.366141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea90ba-0303-4e5b-87fc-280e2aeeb1df None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:52.366451 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea90ba-0303-4e5b-87fc-280e2aeeb1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:52.385698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-c5ea90ba-0303-4e5b-87fc-280e2aeeb1df None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:36:52.386883 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c5ea90ba-0303-4e5b-87fc-280e2aeeb1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:52.390371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7df3c4-15dd-4a50-82dd-25d5e7dfe343 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:52.390793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7df3c4-15dd-4a50-82dd-25d5e7dfe343 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:52.391413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7df3c4-15dd-4a50-82dd-25d5e7dfe343 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:52.393439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 6/11] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:36:52.400807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d493a0-6c2a-47de-9f65-1cbff675d0c3 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:52.401332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d493a0-6c2a-47de-9f65-1cbff675d0c3 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:52.401854 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d493a0-6c2a-47de-9f65-1cbff675d0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:52.453378 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG passlib.handlers.bcrypt [None req-72d493a0-6c2a-47de-9f65-1cbff675d0c3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88553) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 22:36:52.453768 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG passlib.handlers.bcrypt [None req-72d493a0-6c2a-47de-9f65-1cbff675d0c3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88553) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 22:36:52.490094 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 6/12] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:36:52.505281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-72d493a0-6c2a-47de-9f65-1cbff675d0c3 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:36:52.506900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-72d493a0-6c2a-47de-9f65-1cbff675d0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:52.623408 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 7/13] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:36:52.760315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea90ba-0303-4e5b-87fc-280e2aeeb1df None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:52.788675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:52.883908 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea90ba-0303-4e5b-87fc-280e2aeeb1df None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:52.903359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d493a0-6c2a-47de-9f65-1cbff675d0c3 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:52.925743 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86fae8-c425-4833-857e-6967a4ce6c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:52.926605 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86fae8-c425-4833-857e-6967a4ce6c39 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:52.927080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86fae8-c425-4833-857e-6967a4ce6c39 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:52.927576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86fae8-c425-4833-857e-6967a4ce6c39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:53.020650 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d493a0-6c2a-47de-9f65-1cbff675d0c3 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:53.023447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:53.031465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86fae8-c425-4833-857e-6967a4ce6c39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:53.033408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86fae8-c425-4833-857e-6967a4ce6c39 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:53.068287 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e82784-f9dc-446a-aed4-d70de6d04804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:53.068948 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:53.069926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e82784-f9dc-446a-aed4-d70de6d04804 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:53.070236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e82784-f9dc-446a-aed4-d70de6d04804 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:53.070514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e82784-f9dc-446a-aed4-d70de6d04804 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:53.093662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e82784-f9dc-446a-aed4-d70de6d04804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-d9e82784-f9dc-446a-aed4-d70de6d04804 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:36:53.111334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:36:53.112869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:36:53.114366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:36:53.114366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:36:53.114366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:36:53.114366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:36:53.114366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:36:53.114366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:36:53.114366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:36:53.114366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:36:53.114366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:36:53.114366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:36:53.114366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:36:53.114366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:36:53.114366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 8/14] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:36:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:36:53.122513 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e82784-f9dc-446a-aed4-d70de6d04804 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:53.162509 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 7/15] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:36:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:36:53.168398 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86fae8-c425-4833-857e-6967a4ce6c39 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:53.251265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e82784-f9dc-446a-aed4-d70de6d04804 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:53.284227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86fae8-c425-4833-857e-6967a4ce6c39 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:53.292061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041fbe2-c635-4344-b959-368db02f30d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:53.292721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041fbe2-c635-4344-b959-368db02f30d4 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:53.292994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041fbe2-c635-4344-b959-368db02f30d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:53.293265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041fbe2-c635-4344-b959-368db02f30d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:53.293960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041fbe2-c635-4344-b959-368db02f30d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:36:53.294266 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041fbe2-c635-4344-b959-368db02f30d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:53.295813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041fbe2-c635-4344-b959-368db02f30d4 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:53.310584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 9/16] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:36:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:36:53.311219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:53.317046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041fbe2-c635-4344-b959-368db02f30d4 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:53.325571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c2735-f0c3-42f2-9ebf-ad3c795243ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:53.326474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c2735-f0c3-42f2-9ebf-ad3c795243ce None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:53.326759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c2735-f0c3-42f2-9ebf-ad3c795243ce None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:53.327033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c2735-f0c3-42f2-9ebf-ad3c795243ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:53.340426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c2735-f0c3-42f2-9ebf-ad3c795243ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:53.342025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c2735-f0c3-42f2-9ebf-ad3c795243ce None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:53.350407 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-258c2735-f0c3-42f2-9ebf-ad3c795243ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:36:53.369262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:36:53.370724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:36:53.371678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:36:53.371678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:36:53.371678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:36:53.371678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 8/17] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:36:53.376536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c2735-f0c3-42f2-9ebf-ad3c795243ce None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:53.446290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041fbe2-c635-4344-b959-368db02f30d4 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:53.495722 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551df5f-a207-481c-8729-33afb770a2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:53.497005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551df5f-a207-481c-8729-33afb770a2ca None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:53.497463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551df5f-a207-481c-8729-33afb770a2ca None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:53.498234 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551df5f-a207-481c-8729-33afb770a2ca None admin] PATH_INFO: `/v3/users/179ea3f8c1ea4c8fb5be02793b645d99` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:53.501074 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551df5f-a207-481c-8729-33afb770a2ca None admin] RBAC: Authorizing `identity:get_user(user_id=179ea3f8c1ea4c8fb5be02793b645d99)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:53.504538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551df5f-a207-481c-8729-33afb770a2ca None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:53.506653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 10/18] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:36:53 2022] GET /identity/v3/users/179ea3f8c1ea4c8fb5be02793b645d99 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:36:53.513214 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551df5f-a207-481c-8729-33afb770a2ca None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:53.515755 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c2735-f0c3-42f2-9ebf-ad3c795243ce None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:53.562547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375b4d2-aab7-4ab6-941d-9a3ba7e90394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:53.563176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375b4d2-aab7-4ab6-941d-9a3ba7e90394 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:53.563468 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375b4d2-aab7-4ab6-941d-9a3ba7e90394 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:53.563758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375b4d2-aab7-4ab6-941d-9a3ba7e90394 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:53.564421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375b4d2-aab7-4ab6-941d-9a3ba7e90394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:36:53.564723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375b4d2-aab7-4ab6-941d-9a3ba7e90394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:53.567038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375b4d2-aab7-4ab6-941d-9a3ba7e90394 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:53.598499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 9/19] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:36:53.642422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:53.653046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551df5f-a207-481c-8729-33afb770a2ca None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:53.729745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721422e-d398-418d-847d-e94129ea29ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:53.729745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721422e-d398-418d-847d-e94129ea29ed None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:53.729745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721422e-d398-418d-847d-e94129ea29ed None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:53.729745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721422e-d398-418d-847d-e94129ea29ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:53.730404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721422e-d398-418d-847d-e94129ea29ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:53.730404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721422e-d398-418d-847d-e94129ea29ed None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:53.730404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 11/20] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:36:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:36:53.730786 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375b4d2-aab7-4ab6-941d-9a3ba7e90394 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:53.780010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:53.866273 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375b4d2-aab7-4ab6-941d-9a3ba7e90394 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:53.919969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14963492-9293-468f-83e2-2ae42998cece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:53.921118 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14963492-9293-468f-83e2-2ae42998cece None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:53.921567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14963492-9293-468f-83e2-2ae42998cece None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:53.922113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14963492-9293-468f-83e2-2ae42998cece None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:53.923514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14963492-9293-468f-83e2-2ae42998cece None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.domain.id=default, user.id=179ea3f8c1ea4c8fb5be02793b645d99) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:36:53.924120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14963492-9293-468f-83e2-2ae42998cece None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:53.929109 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14963492-9293-468f-83e2-2ae42998cece None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:53.948376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 10/21] 10.222.0.72 () {56 vars in 1322 bytes} [Mon Aug 29 22:36:53 2022] GET /identity/v3/role_assignments?user.id=179ea3f8c1ea4c8fb5be02793b645d99&scope.domain.id=default&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 233 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:36:56.054534 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03582f60-03b9-4359-a489-fd2c0187ca81 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:56.055571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03582f60-03b9-4359-a489-fd2c0187ca81 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:56.056063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03582f60-03b9-4359-a489-fd2c0187ca81 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:56.057928 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 12/22] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:36:56.063718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db664155-44bc-49e8-8345-82e44f5e211b None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:56.064618 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db664155-44bc-49e8-8345-82e44f5e211b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:56.065099 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db664155-44bc-49e8-8345-82e44f5e211b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:56.093279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-db664155-44bc-49e8-8345-82e44f5e211b None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:36:56.094847 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-db664155-44bc-49e8-8345-82e44f5e211b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:56.212324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 11/23] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:36:56.304088 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6549b16-092d-45a5-aaee-ffc8e73e798c None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:56.304805 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6549b16-092d-45a5-aaee-ffc8e73e798c None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:56.305312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6549b16-092d-45a5-aaee-ffc8e73e798c None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:56.306877 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 13/24] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:36:56.312649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c6798-67d9-4d65-980d-ca9de14d5099 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:56.313194 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c6798-67d9-4d65-980d-ca9de14d5099 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:56.313689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c6798-67d9-4d65-980d-ca9de14d5099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:56.340496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-170c6798-67d9-4d65-980d-ca9de14d5099 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:36:56.342040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-170c6798-67d9-4d65-980d-ca9de14d5099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:56.373327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:56.438741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 12/25] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:36:56.474935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5cffe-0ce6-477b-9e8c-124b85977978 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:56.475222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5cffe-0ce6-477b-9e8c-124b85977978 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:56.475507 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5cffe-0ce6-477b-9e8c-124b85977978 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:56.476922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 14/26] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:36:56.482690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d59bf-9c17-4a89-9689-181cd46e1f84 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:56.482981 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d59bf-9c17-4a89-9689-181cd46e1f84 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:56.483264 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d59bf-9c17-4a89-9689-181cd46e1f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:56.506957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-bf7d59bf-9c17-4a89-9689-181cd46e1f84 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:36:56.508179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-bf7d59bf-9c17-4a89-9689-181cd46e1f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:56.592031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 13/27] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:36:56.693077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5cffe-0ce6-477b-9e8c-124b85977978 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:56.829618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5cffe-0ce6-477b-9e8c-124b85977978 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:56.877205 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d59bf-9c17-4a89-9689-181cd46e1f84 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:56.877370 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07263c6-6d75-4893-b606-42619e8f5a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:56.878115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07263c6-6d75-4893-b606-42619e8f5a93 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:56.879442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07263c6-6d75-4893-b606-42619e8f5a93 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:56.879442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07263c6-6d75-4893-b606-42619e8f5a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:56.919804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07263c6-6d75-4893-b606-42619e8f5a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:56.921789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07263c6-6d75-4893-b606-42619e8f5a93 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-a07263c6-6d75-4893-b606-42619e8f5a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:36:56.951985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:36:56.952918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:36:56.953712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:36:56.953712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:36:56.953712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:36:56.953712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 15/28] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:36:56.962047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07263c6-6d75-4893-b606-42619e8f5a93 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:57.010800 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:57.095955 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:57.123608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d59bf-9c17-4a89-9689-181cd46e1f84 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:57.183262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07263c6-6d75-4893-b606-42619e8f5a93 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:57.226807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a35dab-4dae-43b2-b1a6-f2ae863d8fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:57.227429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a35dab-4dae-43b2-b1a6-f2ae863d8fac None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:57.228006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a35dab-4dae-43b2-b1a6-f2ae863d8fac None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:57.228327 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a35dab-4dae-43b2-b1a6-f2ae863d8fac None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:57.228984 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a35dab-4dae-43b2-b1a6-f2ae863d8fac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:36:57.229286 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a35dab-4dae-43b2-b1a6-f2ae863d8fac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:57.230685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a35dab-4dae-43b2-b1a6-f2ae863d8fac None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:57.233059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e6986-d03b-4a16-b6fe-a386cb194473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:57.233713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e6986-d03b-4a16-b6fe-a386cb194473 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:57.233990 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e6986-d03b-4a16-b6fe-a386cb194473 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:57.234258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e6986-d03b-4a16-b6fe-a386cb194473 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:57.258712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e6986-d03b-4a16-b6fe-a386cb194473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-e48e6986-d03b-4a16-b6fe-a386cb194473 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:36:57.265475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:36:57.266330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:36:57.267736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:36:57.267736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:36:57.267736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:36:57.267736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:36:57.267736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:36:57.267736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:36:57.267736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:36:57.267736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:36:57.267736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:36:57.267736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:36:57.267736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:36:57.267736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:36:57.267736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 14/29] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:36:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:36:57.267736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e6986-d03b-4a16-b6fe-a386cb194473 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:57.278182 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 16/30] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:36:57.278863 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a35dab-4dae-43b2-b1a6-f2ae863d8fac None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:57.408360 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:57.448264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a35dab-4dae-43b2-b1a6-f2ae863d8fac None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:57.482332 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e6986-d03b-4a16-b6fe-a386cb194473 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:57.486852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4477ead-455e-48b3-b3ff-06a9788d948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:57.488084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4477ead-455e-48b3-b3ff-06a9788d948f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:57.488447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4477ead-455e-48b3-b3ff-06a9788d948f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:57.488723 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4477ead-455e-48b3-b3ff-06a9788d948f None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:57.489483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4477ead-455e-48b3-b3ff-06a9788d948f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:36:57.489787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4477ead-455e-48b3-b3ff-06a9788d948f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:57.491204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4477ead-455e-48b3-b3ff-06a9788d948f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:57.500863 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 17/31] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:36:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:36:57.501305 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4477ead-455e-48b3-b3ff-06a9788d948f None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:57.547396 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef9086-3aef-4f85-b215-d7a6e9961825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:57.548628 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef9086-3aef-4f85-b215-d7a6e9961825 None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:57.549140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef9086-3aef-4f85-b215-d7a6e9961825 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:57.549612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef9086-3aef-4f85-b215-d7a6e9961825 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:57.551367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef9086-3aef-4f85-b215-d7a6e9961825 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:57.553299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef9086-3aef-4f85-b215-d7a6e9961825 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:57.616810 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4477ead-455e-48b3-b3ff-06a9788d948f None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:57.653617 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfbc91-9562-4b36-93f8-418a065c4fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:57.654243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfbc91-9562-4b36-93f8-418a065c4fd3 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:57.654742 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfbc91-9562-4b36-93f8-418a065c4fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:57.654861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfbc91-9562-4b36-93f8-418a065c4fd3 None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:57.655512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfbc91-9562-4b36-93f8-418a065c4fd3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:57.657044 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfbc91-9562-4b36-93f8-418a065c4fd3 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:57.665261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:57.808041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 15/32] 10.222.0.72 () {60 vars in 1131 bytes} [Mon Aug 29 22:36:57 2022] POST /identity/v3/roles => generated 219 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:36:57.808041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abd371-82dd-400f-b79a-93c711c59a30 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:57.808041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abd371-82dd-400f-b79a-93c711c59a30 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:57.808041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abd371-82dd-400f-b79a-93c711c59a30 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:57.808041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 16/33] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:36:57.808041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abd371-82dd-400f-b79a-93c711c59a30 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:57.821466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:57.951705 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abd371-82dd-400f-b79a-93c711c59a30 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:58.015779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 18/34] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Aug 29 22:36:57 2022] POST /identity/v3/projects => generated 301 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:36:58.017326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2218b-2f73-4285-bf9b-15e17a8b4800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:58.017478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c017a1c-403b-4ee5-9353-4e171d97cf4d None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:58.017717 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c017a1c-403b-4ee5-9353-4e171d97cf4d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:58.018057 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c017a1c-403b-4ee5-9353-4e171d97cf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:58.018314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2218b-2f73-4285-bf9b-15e17a8b4800 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:58.018790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2218b-2f73-4285-bf9b-15e17a8b4800 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:58.019253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2218b-2f73-4285-bf9b-15e17a8b4800 None admin] PATH_INFO: `/v3/users/179ea3f8c1ea4c8fb5be02793b645d99` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:58.021342 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2218b-2f73-4285-bf9b-15e17a8b4800 None admin] RBAC: Authorizing `identity:get_user(user_id=179ea3f8c1ea4c8fb5be02793b645d99)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:58.023734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2218b-2f73-4285-bf9b-15e17a8b4800 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:58.025616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 17/35] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:36:57 2022] GET /identity/v3/users/179ea3f8c1ea4c8fb5be02793b645d99 => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:36:58.027045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868d1f1-80ac-4215-8151-c6754ac56473 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:58.027341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868d1f1-80ac-4215-8151-c6754ac56473 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:58.027622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868d1f1-80ac-4215-8151-c6754ac56473 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:58.029333 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 18/36] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:36:58.032597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868d1f1-80ac-4215-8151-c6754ac56473 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:58.050746 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-5c017a1c-403b-4ee5-9353-4e171d97cf4d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:36:58.052464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5c017a1c-403b-4ee5-9353-4e171d97cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:58.168587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 19/37] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:36:58.170177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3cbf6-05b8-4d2d-8a4e-a283a3b60566 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:58.170177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3cbf6-05b8-4d2d-8a4e-a283a3b60566 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:58.170348 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3cbf6-05b8-4d2d-8a4e-a283a3b60566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:58.193104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:58.203809 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-fcc3cbf6-05b8-4d2d-8a4e-a283a3b60566 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:36:58.208629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-fcc3cbf6-05b8-4d2d-8a4e-a283a3b60566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:58.229108 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868d1f1-80ac-4215-8151-c6754ac56473 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:58.296284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c02687-7bbc-46fe-8f65-5d0ba4571681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:58.296941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c02687-7bbc-46fe-8f65-5d0ba4571681 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:58.297226 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c02687-7bbc-46fe-8f65-5d0ba4571681 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:58.297502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c02687-7bbc-46fe-8f65-5d0ba4571681 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:58.298773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c02687-7bbc-46fe-8f65-5d0ba4571681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:58.300876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c02687-7bbc-46fe-8f65-5d0ba4571681 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:58.302519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 19/38] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:36:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:36:58.305339 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930de73-cb23-4f4b-a9c2-db9b57e6a79b None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:58.305655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930de73-cb23-4f4b-a9c2-db9b57e6a79b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:58.305933 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930de73-cb23-4f4b-a9c2-db9b57e6a79b None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:58.310472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 20/39] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:36:58.311997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 20/40] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:36:58.313004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b1dc8-0478-41c3-8f48-78daa816b039 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:58.313467 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b1dc8-0478-41c3-8f48-78daa816b039 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:58.313743 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b1dc8-0478-41c3-8f48-78daa816b039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:58.317600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3cbf6-05b8-4d2d-8a4e-a283a3b60566 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:58.339907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-1a2b1dc8-0478-41c3-8f48-78daa816b039 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:36:58.342350 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-1a2b1dc8-0478-41c3-8f48-78daa816b039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:58.386466 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:58.443050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 21/41] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:36:58.461921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3cbf6-05b8-4d2d-8a4e-a283a3b60566 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:58.495730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b1dc8-0478-41c3-8f48-78daa816b039 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:58.501844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4ab1a-b2eb-49df-854a-283ab1b69294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:58.502532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4ab1a-b2eb-49df-854a-283ab1b69294 None admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:58.502923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4ab1a-b2eb-49df-854a-283ab1b69294 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:58.503829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4ab1a-b2eb-49df-854a-283ab1b69294 None admin] PATH_INFO: `/v3/domains/default/users/179ea3f8c1ea4c8fb5be02793b645d99/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:58.505990 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4ab1a-b2eb-49df-854a-283ab1b69294 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=179ea3f8c1ea4c8fb5be02793b645d99, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:58.507777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4ab1a-b2eb-49df-854a-283ab1b69294 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:58.611389 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 21/42] 10.222.0.72 () {58 vars in 1361 bytes} [Mon Aug 29 22:36:58 2022] PUT /identity/v3/domains/default/users/179ea3f8c1ea4c8fb5be02793b645d99/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:36:58.715953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:58.766082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b1dc8-0478-41c3-8f48-78daa816b039 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:58.773338 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4ab1a-b2eb-49df-854a-283ab1b69294 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:58.820722 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a23d3-53fa-4309-90e7-4b9651b98897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:58.821374 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a23d3-53fa-4309-90e7-4b9651b98897 None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:58.821782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a23d3-53fa-4309-90e7-4b9651b98897 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:58.822070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a23d3-53fa-4309-90e7-4b9651b98897 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:58.822785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a23d3-53fa-4309-90e7-4b9651b98897 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:58.824430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a23d3-53fa-4309-90e7-4b9651b98897 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:58.901411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 22/43] 10.222.0.72 () {60 vars in 1131 bytes} [Mon Aug 29 22:36:58 2022] POST /identity/v3/roles => generated 225 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:36:58.902830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a23d3-53fa-4309-90e7-4b9651b98897 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:58.945652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4ab1a-b2eb-49df-854a-283ab1b69294 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:58.966194 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:59.015719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b70ac-2a1d-411c-8157-8c572515cb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:59.016690 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b70ac-2a1d-411c-8157-8c572515cb66 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:59.017125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b70ac-2a1d-411c-8157-8c572515cb66 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:59.017861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b70ac-2a1d-411c-8157-8c572515cb66 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:59.018951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b70ac-2a1d-411c-8157-8c572515cb66 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:59.022015 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b70ac-2a1d-411c-8157-8c572515cb66 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:59.094205 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a23d3-53fa-4309-90e7-4b9651b98897 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:59.142360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edac624-07a2-423c-b94f-d93e03890456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:59.143178 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edac624-07a2-423c-b94f-d93e03890456 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:59.143297 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edac624-07a2-423c-b94f-d93e03890456 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:59.144240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edac624-07a2-423c-b94f-d93e03890456 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:59.145784 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edac624-07a2-423c-b94f-d93e03890456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:59.147916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edac624-07a2-423c-b94f-d93e03890456 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:59.149792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 23/44] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:36:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:36:59.156762 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edac624-07a2-423c-b94f-d93e03890456 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:59.161074 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:59.202561 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 22/45] 10.222.0.72 () {60 vars in 1131 bytes} [Mon Aug 29 22:36:58 2022] POST /identity/v3/roles => generated 223 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:36:59.293794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edac624-07a2-423c-b94f-d93e03890456 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:59.338228 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11834b-69ab-47ec-8dd4-2e5c55bada4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:59.338876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11834b-69ab-47ec-8dd4-2e5c55bada4a None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:59.339155 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11834b-69ab-47ec-8dd4-2e5c55bada4a None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:59.339435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11834b-69ab-47ec-8dd4-2e5c55bada4a None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:59.340127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11834b-69ab-47ec-8dd4-2e5c55bada4a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:59.341686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11834b-69ab-47ec-8dd4-2e5c55bada4a None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:59.504289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 24/46] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Aug 29 22:36:59 2022] POST /identity/v3/projects => generated 312 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:37:00.744985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e74c1-9f0a-44d5-b295-71d47db4b7fd None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:00.745565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e74c1-9f0a-44d5-b295-71d47db4b7fd None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:00.746017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e74c1-9f0a-44d5-b295-71d47db4b7fd None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:00.748590 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 23/47] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:00.757267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255e628-8431-48c8-a783-a6504e5e3643 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:00.757768 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255e628-8431-48c8-a783-a6504e5e3643 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:00.757857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255e628-8431-48c8-a783-a6504e5e3643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:00.777545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-7255e628-8431-48c8-a783-a6504e5e3643 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:00.778740 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-7255e628-8431-48c8-a783-a6504e5e3643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:00.850672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:00.870851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 25/48] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:01.143112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e74c1-9f0a-44d5-b295-71d47db4b7fd None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:01.276945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e74c1-9f0a-44d5-b295-71d47db4b7fd None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:01.314452 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143e543-fcdb-443a-9f0a-f8ddaef8c28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:01.315116 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143e543-fcdb-443a-9f0a-f8ddaef8c28a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:01.315433 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143e543-fcdb-443a-9f0a-f8ddaef8c28a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:01.315898 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143e543-fcdb-443a-9f0a-f8ddaef8c28a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:01.327767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143e543-fcdb-443a-9f0a-f8ddaef8c28a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-8143e543-fcdb-443a-9f0a-f8ddaef8c28a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:01.333757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:01.335061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:01.335913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:01.335913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:01.335913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:01.335913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:01.335913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:01.335913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:01.335913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:01.335913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:01.335913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:01.335913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:01.335913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:01.335913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:01.335913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 24/49] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:37:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:01.340913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255e628-8431-48c8-a783-a6504e5e3643 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:01.505864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255e628-8431-48c8-a783-a6504e5e3643 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:01.530666 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721b9c-0650-48a9-b20c-5825f1ef5647 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:01.530968 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721b9c-0650-48a9-b20c-5825f1ef5647 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:01.531251 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721b9c-0650-48a9-b20c-5825f1ef5647 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:01.532669 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 25/50] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:37:01.538204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c1a0d-2f0b-438e-ba3e-85d4d4def188 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:01.538567 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c1a0d-2f0b-438e-ba3e-85d4d4def188 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:01.538777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c1a0d-2f0b-438e-ba3e-85d4d4def188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:01.557527 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-bf4c1a0d-2f0b-438e-ba3e-85d4d4def188 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:01.559068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-bf4c1a0d-2f0b-438e-ba3e-85d4d4def188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:01.574271 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e5e6e-004a-4e3a-b767-21cb9dd37d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:01.575371 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e5e6e-004a-4e3a-b767-21cb9dd37d80 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:01.575893 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e5e6e-004a-4e3a-b767-21cb9dd37d80 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:01.576438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e5e6e-004a-4e3a-b767-21cb9dd37d80 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:01.577724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e5e6e-004a-4e3a-b767-21cb9dd37d80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:01.578306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e5e6e-004a-4e3a-b767-21cb9dd37d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:01.582029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e5e6e-004a-4e3a-b767-21cb9dd37d80 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:01.583016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:01.611086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 26/51] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:01.612948 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e5e6e-004a-4e3a-b767-21cb9dd37d80 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:01.635680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 26/52] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:01.677333 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:01.736181 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e5e6e-004a-4e3a-b767-21cb9dd37d80 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:01.774138 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40836f54-4ebf-4161-a666-fdf04721ad6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:01.774868 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40836f54-4ebf-4161-a666-fdf04721ad6a None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:01.775060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40836f54-4ebf-4161-a666-fdf04721ad6a None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:01.775339 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40836f54-4ebf-4161-a666-fdf04721ad6a None admin] PATH_INFO: `/v3/users/179ea3f8c1ea4c8fb5be02793b645d99` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:01.776550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40836f54-4ebf-4161-a666-fdf04721ad6a None admin] RBAC: Authorizing `identity:get_user(user_id=179ea3f8c1ea4c8fb5be02793b645d99)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:01.778145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40836f54-4ebf-4161-a666-fdf04721ad6a None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:01.779799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 27/53] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:01 2022] GET /identity/v3/users/179ea3f8c1ea4c8fb5be02793b645d99 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:01.786651 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c1a0d-2f0b-438e-ba3e-85d4d4def188 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:01.909875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c1a0d-2f0b-438e-ba3e-85d4d4def188 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:01.933461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40836f54-4ebf-4161-a666-fdf04721ad6a None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:01.946583 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048528fa-2b41-4668-8c17-c481a6286138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:01.947228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048528fa-2b41-4668-8c17-c481a6286138 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:01.947508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048528fa-2b41-4668-8c17-c481a6286138 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:01.947780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048528fa-2b41-4668-8c17-c481a6286138 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:01.948980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048528fa-2b41-4668-8c17-c481a6286138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:01.950440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048528fa-2b41-4668-8c17-c481a6286138 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:01.952029 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 27/54] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:37:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:01.957829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048528fa-2b41-4668-8c17-c481a6286138 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:01.994099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:02.044064 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40836f54-4ebf-4161-a666-fdf04721ad6a None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:02.058904 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:02.071496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048528fa-2b41-4668-8c17-c481a6286138 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:02.083467 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b56b39-8192-4e1a-ae12-487d55af4633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:02.084490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b56b39-8192-4e1a-ae12-487d55af4633 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:02.084794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b56b39-8192-4e1a-ae12-487d55af4633 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:02.085080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b56b39-8192-4e1a-ae12-487d55af4633 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:02.086477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b56b39-8192-4e1a-ae12-487d55af4633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:02.088217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b56b39-8192-4e1a-ae12-487d55af4633 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:02.090162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 28/55] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:37:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:02.095638 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b56b39-8192-4e1a-ae12-487d55af4633 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:02.109693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bc6da-3e78-459f-a3b4-a3929dc3fee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:02.110416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bc6da-3e78-459f-a3b4-a3929dc3fee5 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:02.110700 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bc6da-3e78-459f-a3b4-a3929dc3fee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:02.111149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bc6da-3e78-459f-a3b4-a3929dc3fee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:02.112685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bc6da-3e78-459f-a3b4-a3929dc3fee5 None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.domain.id=default, user.id=179ea3f8c1ea4c8fb5be02793b645d99) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:02.113133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bc6da-3e78-459f-a3b4-a3929dc3fee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:02.115120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bc6da-3e78-459f-a3b4-a3929dc3fee5 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:02.124918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 28/56] 10.222.0.72 () {56 vars in 1322 bytes} [Mon Aug 29 22:37:01 2022] GET /identity/v3/role_assignments?user.id=179ea3f8c1ea4c8fb5be02793b645d99&scope.domain.id=default&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 530 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:02.214976 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b56b39-8192-4e1a-ae12-487d55af4633 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:02.256833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45371ef-d662-4054-819f-bd973b474ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:02.257469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45371ef-d662-4054-819f-bd973b474ccd None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:02.257919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45371ef-d662-4054-819f-bd973b474ccd None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:02.257919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45371ef-d662-4054-819f-bd973b474ccd None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:02.259112 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45371ef-d662-4054-819f-bd973b474ccd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:02.260212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45371ef-d662-4054-819f-bd973b474ccd None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:02.384687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 29/57] 10.222.0.72 () {60 vars in 1140 bytes} [Mon Aug 29 22:37:02 2022] POST /identity/v3/projects => generated 298 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:37:04.384634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246eb90-8ade-4d29-a755-926ac73c469c None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:04.385159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246eb90-8ade-4d29-a755-926ac73c469c None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:04.385159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246eb90-8ade-4d29-a755-926ac73c469c None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:04.386519 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 29/58] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:04.392032 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d8c54-fed4-4a3b-8205-6a5925f8d9a7 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:04.392514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d8c54-fed4-4a3b-8205-6a5925f8d9a7 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:04.392622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d8c54-fed4-4a3b-8205-6a5925f8d9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:04.411899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-896d8c54-fed4-4a3b-8205-6a5925f8d9a7 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:04.413125 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-896d8c54-fed4-4a3b-8205-6a5925f8d9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:04.441681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:04.484264 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 30/59] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:04.763034 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246eb90-8ade-4d29-a755-926ac73c469c None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:04.856905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:04.867391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246eb90-8ade-4d29-a755-926ac73c469c None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:04.902402 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04eda0-0e0d-47bb-89c0-4c248559e18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:04.903038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04eda0-0e0d-47bb-89c0-4c248559e18c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:04.903316 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04eda0-0e0d-47bb-89c0-4c248559e18c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:04.903593 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04eda0-0e0d-47bb-89c0-4c248559e18c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:04.904739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04eda0-0e0d-47bb-89c0-4c248559e18c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:04.906174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04eda0-0e0d-47bb-89c0-4c248559e18c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:04.907733 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 30/60] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:37:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:04.913429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d8c54-fed4-4a3b-8205-6a5925f8d9a7 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:05.012531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d8c54-fed4-4a3b-8205-6a5925f8d9a7 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:05.050536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460812d-9b21-4f51-a1b3-3c74f1dca405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:05.051065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460812d-9b21-4f51-a1b3-3c74f1dca405 None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:05.051345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460812d-9b21-4f51-a1b3-3c74f1dca405 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:05.051622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460812d-9b21-4f51-a1b3-3c74f1dca405 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:05.052330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460812d-9b21-4f51-a1b3-3c74f1dca405 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:05.053839 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460812d-9b21-4f51-a1b3-3c74f1dca405 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:05.150539 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 31/61] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:37:04 2022] POST /identity/v3/users => generated 275 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:37:08.345740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e13d8-81ad-4c27-9a48-2a57497f9d17 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:08.346510 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e13d8-81ad-4c27-9a48-2a57497f9d17 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:08.346510 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e13d8-81ad-4c27-9a48-2a57497f9d17 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:08.347846 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 31/62] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:08.350904 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adbc00-6e46-40e5-a776-903310dcd17e None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:08.351716 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adbc00-6e46-40e5-a776-903310dcd17e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:08.352554 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adbc00-6e46-40e5-a776-903310dcd17e None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:08.354192 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 32/63] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:08.358706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c38b-b4c2-4b82-9d24-4aa12c21bfd8 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:08.359232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c38b-b4c2-4b82-9d24-4aa12c21bfd8 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:08.359701 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c38b-b4c2-4b82-9d24-4aa12c21bfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:08.363386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66b924-26d1-41d5-ae1a-1caeb513728d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:08.363915 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66b924-26d1-41d5-ae1a-1caeb513728d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:08.364465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66b924-26d1-41d5-ae1a-1caeb513728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:08.389906 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-ce66b924-26d1-41d5-ae1a-1caeb513728d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:08.391457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ce66b924-26d1-41d5-ae1a-1caeb513728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:08.407396 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-e711c38b-b4c2-4b82-9d24-4aa12c21bfd8 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:08.409454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e711c38b-b4c2-4b82-9d24-4aa12c21bfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:08.426594 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:08.529939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 33/64] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:08.543956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 32/65] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:08.869303 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66b924-26d1-41d5-ae1a-1caeb513728d None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:08.883562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb78bd-898f-4539-86de-d80e619120d0 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:08.884246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb78bd-898f-4539-86de-d80e619120d0 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:08.884742 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb78bd-898f-4539-86de-d80e619120d0 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:08.886563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 33/66] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:08.888332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb78bd-898f-4539-86de-d80e619120d0 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:08.995140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:09.010071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb78bd-898f-4539-86de-d80e619120d0 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:09.015860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66b924-26d1-41d5-ae1a-1caeb513728d None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:09.048523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85c020-f2c9-44ba-844c-a66924a5096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:09.049651 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85c020-f2c9-44ba-844c-a66924a5096d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:09.050479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85c020-f2c9-44ba-844c-a66924a5096d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:09.050761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85c020-f2c9-44ba-844c-a66924a5096d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:09.055281 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78841657-0e47-484e-9f1b-54c573956c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:09.056021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78841657-0e47-484e-9f1b-54c573956c6f None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:09.056244 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78841657-0e47-484e-9f1b-54c573956c6f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:09.056510 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78841657-0e47-484e-9f1b-54c573956c6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:09.062198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85c020-f2c9-44ba-844c-a66924a5096d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-2b85c020-f2c9-44ba-844c-a66924a5096d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:09.068647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:09.069526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:09.070699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:09.070699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:09.070699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:09.070699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:09.070699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:09.070699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:09.070699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:09.070699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:09.070699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:09.070699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:09.070699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:09.070699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:09.071531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78841657-0e47-484e-9f1b-54c573956c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:09.071600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 34/67] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:37:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:09.071600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117bec-e459-4e86-ad9c-84c7b69c27fb None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:09.071600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117bec-e459-4e86-ad9c-84c7b69c27fb None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:09.071600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117bec-e459-4e86-ad9c-84c7b69c27fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-78841657-0e47-484e-9f1b-54c573956c6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:09.074862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:09.075718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:09.076586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:09.076586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:09.076586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:09.076586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:09.076586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:09.076586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:09.076586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:09.076586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:09.076586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:09.076586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:09.076586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:09.076586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:09.076586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 34/68] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:09.077194 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aed9d-81b4-40aa-8311-d21ce181d527 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:09.077194 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aed9d-81b4-40aa-8311-d21ce181d527 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:09.077194 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aed9d-81b4-40aa-8311-d21ce181d527 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:09.078406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 35/69] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:09.079166 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2aed9d-81b4-40aa-8311-d21ce181d527 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:09.094354 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:09.095501 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-9d117bec-e459-4e86-ad9c-84c7b69c27fb None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:09.096814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9d117bec-e459-4e86-ad9c-84c7b69c27fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:09.167451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 35/70] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:09.168366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117bec-e459-4e86-ad9c-84c7b69c27fb None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:09.210441 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2aed9d-81b4-40aa-8311-d21ce181d527 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:09.264021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64b9ff-ed29-42b8-aca7-87fad41a1e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:09.264685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64b9ff-ed29-42b8-aca7-87fad41a1e13 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:09.264982 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64b9ff-ed29-42b8-aca7-87fad41a1e13 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:09.265251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64b9ff-ed29-42b8-aca7-87fad41a1e13 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:09.265938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64b9ff-ed29-42b8-aca7-87fad41a1e13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:09.266486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64b9ff-ed29-42b8-aca7-87fad41a1e13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:09.267648 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64b9ff-ed29-42b8-aca7-87fad41a1e13 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:09.281914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 36/71] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:09.281914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e8a5e-3ee6-4cec-89cf-be3fbc7f68f6 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:09.281914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e8a5e-3ee6-4cec-89cf-be3fbc7f68f6 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:09.281914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e8a5e-3ee6-4cec-89cf-be3fbc7f68f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:09.286335 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:09.301125 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-6d7e8a5e-3ee6-4cec-89cf-be3fbc7f68f6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:09.302354 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-6d7e8a5e-3ee6-4cec-89cf-be3fbc7f68f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:09.310221 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117bec-e459-4e86-ad9c-84c7b69c27fb None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:09.348431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6c088-5b9d-4fbc-bbd1-652e04e222af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:09.349066 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c088-5b9d-4fbc-bbd1-652e04e222af None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:09.349323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c088-5b9d-4fbc-bbd1-652e04e222af None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:09.349595 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c088-5b9d-4fbc-bbd1-652e04e222af None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:09.350267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c088-5b9d-4fbc-bbd1-652e04e222af None admin] RBAC: Adding query filter params (name=member) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:09.350572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c088-5b9d-4fbc-bbd1-652e04e222af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:09.351953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c088-5b9d-4fbc-bbd1-652e04e222af None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:09.366391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 36/72] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:09.366391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc53c5a-3ac8-4689-a76c-f8f70719c578 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:09.366391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc53c5a-3ac8-4689-a76c-f8f70719c578 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:09.366391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc53c5a-3ac8-4689-a76c-f8f70719c578 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:09.366391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 37/73] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:09.366391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc53c5a-3ac8-4689-a76c-f8f70719c578 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:09.384238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 37/74] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:09.392745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e8a5e-3ee6-4cec-89cf-be3fbc7f68f6 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:09.392745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:09.506674 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc53c5a-3ac8-4689-a76c-f8f70719c578 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:09.521831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e8a5e-3ee6-4cec-89cf-be3fbc7f68f6 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:09.547831 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1508d7-4c1e-4ef7-9d61-fc7b62381112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:09.548516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1508d7-4c1e-4ef7-9d61-fc7b62381112 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:09.548799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1508d7-4c1e-4ef7-9d61-fc7b62381112 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:09.549792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1508d7-4c1e-4ef7-9d61-fc7b62381112 None admin] PATH_INFO: `/v3/users/179ea3f8c1ea4c8fb5be02793b645d99` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:09.551005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1508d7-4c1e-4ef7-9d61-fc7b62381112 None admin] RBAC: Authorizing `identity:get_user(user_id=179ea3f8c1ea4c8fb5be02793b645d99)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:09.552489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1508d7-4c1e-4ef7-9d61-fc7b62381112 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:09.558563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 38/75] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:09 2022] GET /identity/v3/users/179ea3f8c1ea4c8fb5be02793b645d99 => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:09.558563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27388cdb-ec25-45a2-8d45-a5f66a8f8d47 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:09.558563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27388cdb-ec25-45a2-8d45-a5f66a8f8d47 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:09.558563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27388cdb-ec25-45a2-8d45-a5f66a8f8d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:09.567709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd04b12-764f-4dc5-b6d1-0d8209b01b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:09.568396 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd04b12-764f-4dc5-b6d1-0d8209b01b17 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:09.568686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd04b12-764f-4dc5-b6d1-0d8209b01b17 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:09.568966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd04b12-764f-4dc5-b6d1-0d8209b01b17 None admin] PATH_INFO: `/v3/users/13c53024985741bf9865d5cec76fef6d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:09.574941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-27388cdb-ec25-45a2-8d45-a5f66a8f8d47 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:09.576292 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-27388cdb-ec25-45a2-8d45-a5f66a8f8d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:09.578559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:09.587853 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd04b12-764f-4dc5-b6d1-0d8209b01b17 None admin] RBAC: Authorizing `identity:get_user(user_id=13c53024985741bf9865d5cec76fef6d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:09.589382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd04b12-764f-4dc5-b6d1-0d8209b01b17 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:09.595975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 38/76] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:09 2022] GET /identity/v3/users/13c53024985741bf9865d5cec76fef6d => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:09.595975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd04b12-764f-4dc5-b6d1-0d8209b01b17 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:09.656940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:09.669259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 39/77] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:09.670422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27388cdb-ec25-45a2-8d45-a5f66a8f8d47 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:09.702053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd04b12-764f-4dc5-b6d1-0d8209b01b17 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:09.742525 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ea9be-47fe-4482-8f29-144e7c0f7f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:09.743656 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ea9be-47fe-4482-8f29-144e7c0f7f8e None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:09.743906 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ea9be-47fe-4482-8f29-144e7c0f7f8e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:09.744171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ea9be-47fe-4482-8f29-144e7c0f7f8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:09.759425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ea9be-47fe-4482-8f29-144e7c0f7f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-ab6ea9be-47fe-4482-8f29-144e7c0f7f8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:09.764754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:09.765680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:09.766421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:09.766421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:09.766421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:09.766421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:09.766421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:09.766421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:09.766421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:09.766421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:09.766421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:09.766421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:09.766421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:09.766421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:09.766421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 39/78] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:37:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:09.767032 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ea9be-47fe-4482-8f29-144e7c0f7f8e None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:09.793688 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27388cdb-ec25-45a2-8d45-a5f66a8f8d47 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:09.837221 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b457d8d-cbcc-4e06-a2b7-1f13bc3e1c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:09.837866 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b457d8d-cbcc-4e06-a2b7-1f13bc3e1c26 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:09.838145 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b457d8d-cbcc-4e06-a2b7-1f13bc3e1c26 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:09.838542 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b457d8d-cbcc-4e06-a2b7-1f13bc3e1c26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:09.848410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:09.887389 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ea9be-47fe-4482-8f29-144e7c0f7f8e None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:09.911389 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:09.915450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b457d8d-cbcc-4e06-a2b7-1f13bc3e1c26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:09.917089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b457d8d-cbcc-4e06-a2b7-1f13bc3e1c26 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:09.933800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f4583-b0a6-4c39-a364-6fbe6c5c158d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:09.934539 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f4583-b0a6-4c39-a364-6fbe6c5c158d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:09.934831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f4583-b0a6-4c39-a364-6fbe6c5c158d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:09.935115 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f4583-b0a6-4c39-a364-6fbe6c5c158d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:10.008294 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f4583-b0a6-4c39-a364-6fbe6c5c158d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:10.009834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f4583-b0a6-4c39-a364-6fbe6c5c158d None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:10.025324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 40/79] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:10.026344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b457d8d-cbcc-4e06-a2b7-1f13bc3e1c26 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:10.071175 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:10.122139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 40/80] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:10.123223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f4583-b0a6-4c39-a364-6fbe6c5c158d None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:10.146037 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:10.146234 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b457d8d-cbcc-4e06-a2b7-1f13bc3e1c26 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:10.181114 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca93be-aa45-4b09-9b8d-563da7bcc254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:10.181774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca93be-aa45-4b09-9b8d-563da7bcc254 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:10.182059 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca93be-aa45-4b09-9b8d-563da7bcc254 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:10.182332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca93be-aa45-4b09-9b8d-563da7bcc254 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:10.193975 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca93be-aa45-4b09-9b8d-563da7bcc254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-74ca93be-aa45-4b09-9b8d-563da7bcc254 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:10.199151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:10.200065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:10.200848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:10.200848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:10.200848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:10.200848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:10.200848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:10.200848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:10.200848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:10.200848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:10.200848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:10.200848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:10.200848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:10.200848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:10.200848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 41/81] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:10.201454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca93be-aa45-4b09-9b8d-563da7bcc254 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:10.228945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f4583-b0a6-4c39-a364-6fbe6c5c158d None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:10.263992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d50c6-f7d8-4ddd-8da5-b79c195f6745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:10.264541 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d50c6-f7d8-4ddd-8da5-b79c195f6745 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:10.264823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d50c6-f7d8-4ddd-8da5-b79c195f6745 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:10.265094 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d50c6-f7d8-4ddd-8da5-b79c195f6745 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:10.265760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d50c6-f7d8-4ddd-8da5-b79c195f6745 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:10.266063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d50c6-f7d8-4ddd-8da5-b79c195f6745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:10.267450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d50c6-f7d8-4ddd-8da5-b79c195f6745 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:10.276232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 41/82] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:37:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:10.277069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d50c6-f7d8-4ddd-8da5-b79c195f6745 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:10.308175 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:10.312064 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca93be-aa45-4b09-9b8d-563da7bcc254 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:10.347164 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22239786-724f-43e3-b47a-260aad7c597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:10.347794 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22239786-724f-43e3-b47a-260aad7c597b None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:10.348074 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22239786-724f-43e3-b47a-260aad7c597b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:10.348375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22239786-724f-43e3-b47a-260aad7c597b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:10.349511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22239786-724f-43e3-b47a-260aad7c597b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:10.350961 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22239786-724f-43e3-b47a-260aad7c597b None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:10.356315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 42/83] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:37:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:10.356315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22239786-724f-43e3-b47a-260aad7c597b None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:10.371680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:10.393624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d50c6-f7d8-4ddd-8da5-b79c195f6745 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:10.430964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b37fb-758c-4ee1-b2b8-2c597299d6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:10.431604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b37fb-758c-4ee1-b2b8-2c597299d6c1 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:10.431883 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b37fb-758c-4ee1-b2b8-2c597299d6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:10.432158 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b37fb-758c-4ee1-b2b8-2c597299d6c1 None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:10.433449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b37fb-758c-4ee1-b2b8-2c597299d6c1 None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:10.434963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b37fb-758c-4ee1-b2b8-2c597299d6c1 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:10.436709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 42/84] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:10 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:10.437489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b37fb-758c-4ee1-b2b8-2c597299d6c1 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:10.466773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22239786-724f-43e3-b47a-260aad7c597b None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:10.508287 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494bd50-ff4d-4876-8831-6b6abb899dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:10.508950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494bd50-ff4d-4876-8831-6b6abb899dd3 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:10.509234 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494bd50-ff4d-4876-8831-6b6abb899dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:10.509512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494bd50-ff4d-4876-8831-6b6abb899dd3 None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:10.510750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494bd50-ff4d-4876-8831-6b6abb899dd3 None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:10.512332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494bd50-ff4d-4876-8831-6b6abb899dd3 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:10.514075 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 43/85] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:10 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:10.514981 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494bd50-ff4d-4876-8831-6b6abb899dd3 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:10.555849 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:10.559394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b37fb-758c-4ee1-b2b8-2c597299d6c1 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:10.594487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef4bb0-b6c6-472b-8dbc-a0bc301f293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:10.595175 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef4bb0-b6c6-472b-8dbc-a0bc301f293c None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:10.595464 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef4bb0-b6c6-472b-8dbc-a0bc301f293c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:10.595743 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef4bb0-b6c6-472b-8dbc-a0bc301f293c None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:10.596479 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef4bb0-b6c6-472b-8dbc-a0bc301f293c None admin] RBAC: Adding query filter params (name=member) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:10.596787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef4bb0-b6c6-472b-8dbc-a0bc301f293c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:10.598185 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef4bb0-b6c6-472b-8dbc-a0bc301f293c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:10.607122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 43/86] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:10.607970 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef4bb0-b6c6-472b-8dbc-a0bc301f293c None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:10.623886 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:10.634595 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494bd50-ff4d-4876-8831-6b6abb899dd3 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:10.669704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672165af-cb5e-4e32-a6ec-86aeb6186bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:10.670337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672165af-cb5e-4e32-a6ec-86aeb6186bc8 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:10.670616 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672165af-cb5e-4e32-a6ec-86aeb6186bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:10.670888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672165af-cb5e-4e32-a6ec-86aeb6186bc8 None admin] PATH_INFO: `/v3/users/13c53024985741bf9865d5cec76fef6d` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:10.672032 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672165af-cb5e-4e32-a6ec-86aeb6186bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=13c53024985741bf9865d5cec76fef6d)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:10.673513 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672165af-cb5e-4e32-a6ec-86aeb6186bc8 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:10.676340 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 44/87] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:10 2022] GET /identity/v3/users/13c53024985741bf9865d5cec76fef6d => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:10.677129 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672165af-cb5e-4e32-a6ec-86aeb6186bc8 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:10.724006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef4bb0-b6c6-472b-8dbc-a0bc301f293c None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:10.759087 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95156998-9476-45da-80cc-ca871a1112bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:10.759717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95156998-9476-45da-80cc-ca871a1112bf None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:10.760010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95156998-9476-45da-80cc-ca871a1112bf None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:10.760308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95156998-9476-45da-80cc-ca871a1112bf None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:10.760974 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95156998-9476-45da-80cc-ca871a1112bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:10.762433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95156998-9476-45da-80cc-ca871a1112bf None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:10.785078 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672165af-cb5e-4e32-a6ec-86aeb6186bc8 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:10.785465 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:10.819147 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bc365-ff1d-47ed-980d-09ae22087d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:10.819756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bc365-ff1d-47ed-980d-09ae22087d86 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:10.820027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bc365-ff1d-47ed-980d-09ae22087d86 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:10.820331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bc365-ff1d-47ed-980d-09ae22087d86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:10.821064 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bc365-ff1d-47ed-980d-09ae22087d86 None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5, user.id=179ea3f8c1ea4c8fb5be02793b645d99) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:10.821373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bc365-ff1d-47ed-980d-09ae22087d86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:10.822902 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bc365-ff1d-47ed-980d-09ae22087d86 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:10.828606 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 45/88] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:10 2022] GET /identity/v3/role_assignments?user.id=179ea3f8c1ea4c8fb5be02793b645d99&scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:10.829422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bc365-ff1d-47ed-980d-09ae22087d86 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:10.855970 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 44/89] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:37:10 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:37:10.857449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95156998-9476-45da-80cc-ca871a1112bf None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:10.982306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bc365-ff1d-47ed-980d-09ae22087d86 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:10.985919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:11.035611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c4a37-0609-4c0c-b970-bc711fedd2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:11.037201 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c4a37-0609-4c0c-b970-bc711fedd2c7 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:11.037881 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c4a37-0609-4c0c-b970-bc711fedd2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:11.038589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c4a37-0609-4c0c-b970-bc711fedd2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:11.042818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c4a37-0609-4c0c-b970-bc711fedd2c7 None admin] RBAC: Adding query filter params (role.id=bebe72a018ea47b992e9e6715060fadb, scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5, user.id=13c53024985741bf9865d5cec76fef6d) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:11.042818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c4a37-0609-4c0c-b970-bc711fedd2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:11.043596 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95156998-9476-45da-80cc-ca871a1112bf None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:11.044308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c4a37-0609-4c0c-b970-bc711fedd2c7 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:11.057065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 46/90] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:10 2022] GET /identity/v3/role_assignments?user.id=13c53024985741bf9865d5cec76fef6d&scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5&role.id=bebe72a018ea47b992e9e6715060fadb => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:11.058465 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c4a37-0609-4c0c-b970-bc711fedd2c7 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:11.101282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef834be-42d6-43e9-a71e-285b3fbb564c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:11.102802 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef834be-42d6-43e9-a71e-285b3fbb564c None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:11.103682 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef834be-42d6-43e9-a71e-285b3fbb564c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:11.104447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef834be-42d6-43e9-a71e-285b3fbb564c None admin] PATH_INFO: `/v3/users/13c53024985741bf9865d5cec76fef6d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:11.106738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef834be-42d6-43e9-a71e-285b3fbb564c None admin] RBAC: Authorizing `identity:get_user(user_id=13c53024985741bf9865d5cec76fef6d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:11.109438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef834be-42d6-43e9-a71e-285b3fbb564c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:11.111264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:11.116311 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 45/91] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:10 2022] GET /identity/v3/users/13c53024985741bf9865d5cec76fef6d => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:11.122403 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef834be-42d6-43e9-a71e-285b3fbb564c None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:11.224560 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c4a37-0609-4c0c-b970-bc711fedd2c7 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:11.267365 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ac928-995c-4fa8-95c9-0e65ce8d63ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:11.267560 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ac928-995c-4fa8-95c9-0e65ce8d63ce None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:11.268567 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ac928-995c-4fa8-95c9-0e65ce8d63ce None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:11.268855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ac928-995c-4fa8-95c9-0e65ce8d63ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:11.269404 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef834be-42d6-43e9-a71e-285b3fbb564c None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:11.321110 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75ec5b-e258-49ff-a9a8-e046a30dc064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:11.322666 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75ec5b-e258-49ff-a9a8-e046a30dc064 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:11.323226 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75ec5b-e258-49ff-a9a8-e046a30dc064 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:11.323520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75ec5b-e258-49ff-a9a8-e046a30dc064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:11.331350 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:11.365865 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ac928-995c-4fa8-95c9-0e65ce8d63ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:11.367441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ac928-995c-4fa8-95c9-0e65ce8d63ce None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:11.430151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:11.452737 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75ec5b-e258-49ff-a9a8-e046a30dc064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:11.454954 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75ec5b-e258-49ff-a9a8-e046a30dc064 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:11.623633 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 47/92] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:11.632045 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ac928-995c-4fa8-95c9-0e65ce8d63ce None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:11.650310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 46/93] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:11.657127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75ec5b-e258-49ff-a9a8-e046a30dc064 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:11.701323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:11.809929 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75ec5b-e258-49ff-a9a8-e046a30dc064 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:11.890504 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7b6ae-ae9f-4e64-b89e-8ccb05263f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:11.891137 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7b6ae-ae9f-4e64-b89e-8ccb05263f25 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:11.891422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7b6ae-ae9f-4e64-b89e-8ccb05263f25 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:11.891703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7b6ae-ae9f-4e64-b89e-8ccb05263f25 None admin] PATH_INFO: `/v3/projects/463db6dbd0d2422fa3de11c0d94133ed` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:11.894236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7b6ae-ae9f-4e64-b89e-8ccb05263f25 None admin] RBAC: Authorizing `identity:get_project(project_id=463db6dbd0d2422fa3de11c0d94133ed)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:11.895799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7b6ae-ae9f-4e64-b89e-8ccb05263f25 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:11.897575 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 47/94] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:11 2022] GET /identity/v3/projects/463db6dbd0d2422fa3de11c0d94133ed => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:11.903612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7b6ae-ae9f-4e64-b89e-8ccb05263f25 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:11.907224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ac928-995c-4fa8-95c9-0e65ce8d63ce None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:11.960135 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:11.973861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d4971-b1c9-4053-9707-57802b95329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:11.974515 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d4971-b1c9-4053-9707-57802b95329a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:11.974794 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d4971-b1c9-4053-9707-57802b95329a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:11.979423 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d4971-b1c9-4053-9707-57802b95329a None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:11.979423 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d4971-b1c9-4053-9707-57802b95329a None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:11.979423 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d4971-b1c9-4053-9707-57802b95329a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:11.980475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 48/95] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:11 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:11.987322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d4971-b1c9-4053-9707-57802b95329a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:12.014360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7b6ae-ae9f-4e64-b89e-8ccb05263f25 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:12.040649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:12.053016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46f1d2-9bd6-4b9e-be0b-5a7af4aab33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:12.053652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46f1d2-9bd6-4b9e-be0b-5a7af4aab33b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:12.053944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46f1d2-9bd6-4b9e-be0b-5a7af4aab33b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:12.054228 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46f1d2-9bd6-4b9e-be0b-5a7af4aab33b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:12.055076 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46f1d2-9bd6-4b9e-be0b-5a7af4aab33b None admin] RBAC: Adding query filter params (role.id=bebe72a018ea47b992e9e6715060fadb, scope.project.id=463db6dbd0d2422fa3de11c0d94133ed, user.id=13c53024985741bf9865d5cec76fef6d) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:12.055398 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46f1d2-9bd6-4b9e-be0b-5a7af4aab33b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:12.056993 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46f1d2-9bd6-4b9e-be0b-5a7af4aab33b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:12.063441 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 48/96] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:11 2022] GET /identity/v3/role_assignments?user.id=13c53024985741bf9865d5cec76fef6d&scope.project.id=463db6dbd0d2422fa3de11c0d94133ed&role.id=bebe72a018ea47b992e9e6715060fadb => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:12.180215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d4971-b1c9-4053-9707-57802b95329a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:12.231613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4614754-3374-4e5a-ac74-62f8025ea09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:12.232248 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4614754-3374-4e5a-ac74-62f8025ea09d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:12.232534 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4614754-3374-4e5a-ac74-62f8025ea09d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:12.233548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4614754-3374-4e5a-ac74-62f8025ea09d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:12.233548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4614754-3374-4e5a-ac74-62f8025ea09d None admin] RBAC: Adding query filter params (role.id=da30366a448b4b1f902c8160690d366e, scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5, user.id=13c53024985741bf9865d5cec76fef6d) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:12.233886 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4614754-3374-4e5a-ac74-62f8025ea09d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:12.235329 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4614754-3374-4e5a-ac74-62f8025ea09d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:12.242143 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 49/97] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:11 2022] GET /identity/v3/role_assignments?user.id=13c53024985741bf9865d5cec76fef6d&scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5&role.id=da30366a448b4b1f902c8160690d366e => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:13.387745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cee70-7cda-4cff-88e7-5a26e909fc1f None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:13.388822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cee70-7cda-4cff-88e7-5a26e909fc1f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:13.389316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cee70-7cda-4cff-88e7-5a26e909fc1f None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:13.390896 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 49/98] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:13.397317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c1dee-2405-401f-90fd-001e0f765cd2 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:13.402399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c1dee-2405-401f-90fd-001e0f765cd2 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:13.402399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c1dee-2405-401f-90fd-001e0f765cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:13.426525 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-1f9c1dee-2405-401f-90fd-001e0f765cd2 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:13.427747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1f9c1dee-2405-401f-90fd-001e0f765cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:13.515874 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:13.527567 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 50/99] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:13.708453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf811d-7be5-4379-8fac-ef66fc0177b2 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:13.708794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf811d-7be5-4379-8fac-ef66fc0177b2 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:13.709008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf811d-7be5-4379-8fac-ef66fc0177b2 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:13.710658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 50/100] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:13.717090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fd35f-e225-44ea-8304-1f7d03105ace None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:13.717390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fd35f-e225-44ea-8304-1f7d03105ace None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:13.717652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fd35f-e225-44ea-8304-1f7d03105ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:13.738680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-0f8fd35f-e225-44ea-8304-1f7d03105ace None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:13.740911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0f8fd35f-e225-44ea-8304-1f7d03105ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:13.854828 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 51/101] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:14.083486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf811d-7be5-4379-8fac-ef66fc0177b2 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:14.213845 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf811d-7be5-4379-8fac-ef66fc0177b2 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:14.251967 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b306d1f-cdef-451d-875b-f53bf4d31551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:14.253236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b306d1f-cdef-451d-875b-f53bf4d31551 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:14.253533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b306d1f-cdef-451d-875b-f53bf4d31551 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:14.253822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b306d1f-cdef-451d-875b-f53bf4d31551 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:14.265959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b306d1f-cdef-451d-875b-f53bf4d31551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-5b306d1f-cdef-451d-875b-f53bf4d31551 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:14.272041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:14.272944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:14.273674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:14.273674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:14.273674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:14.273674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:14.273674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:14.273674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:14.273674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:14.273674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:14.273674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:14.273674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:14.273674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:14.273674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:14.273674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 51/102] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:37:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:14.280388 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fd35f-e225-44ea-8304-1f7d03105ace None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:14.403973 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a8c46-ba5c-4efe-9c30-b81abf1949eb None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:14.403973 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a8c46-ba5c-4efe-9c30-b81abf1949eb None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:14.403973 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a8c46-ba5c-4efe-9c30-b81abf1949eb None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:14.405144 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 52/103] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:14.417010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5ea2d-0e35-403f-a5bd-c6d6263fa217 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:14.417583 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5ea2d-0e35-403f-a5bd-c6d6263fa217 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:14.417583 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5ea2d-0e35-403f-a5bd-c6d6263fa217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:14.438574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fd35f-e225-44ea-8304-1f7d03105ace None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:14.477197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-29a5ea2d-0e35-403f-a5bd-c6d6263fa217 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:14.478433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-29a5ea2d-0e35-403f-a5bd-c6d6263fa217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:14.511391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:14.522102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:14.532225 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453473f3-0ba7-4894-bf0a-8614d36d1c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:14.532856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453473f3-0ba7-4894-bf0a-8614d36d1c50 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:14.533734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453473f3-0ba7-4894-bf0a-8614d36d1c50 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:14.534097 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453473f3-0ba7-4894-bf0a-8614d36d1c50 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:14.534790 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453473f3-0ba7-4894-bf0a-8614d36d1c50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:14.535108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453473f3-0ba7-4894-bf0a-8614d36d1c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:14.536525 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453473f3-0ba7-4894-bf0a-8614d36d1c50 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:14.559363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 52/104] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:14.561917 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453473f3-0ba7-4894-bf0a-8614d36d1c50 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:14.608881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 53/105] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 29 22:37:14.609767 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5ea2d-0e35-403f-a5bd-c6d6263fa217 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:14.806872 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453473f3-0ba7-4894-bf0a-8614d36d1c50 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:14.837801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5ea2d-0e35-403f-a5bd-c6d6263fa217 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:14.879638 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3477e95-2aed-4a98-8c80-13f509a32895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:14.880472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3477e95-2aed-4a98-8c80-13f509a32895 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:14.880765 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3477e95-2aed-4a98-8c80-13f509a32895 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:14.881154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3477e95-2aed-4a98-8c80-13f509a32895 None admin] PATH_INFO: `/v3/users/179ea3f8c1ea4c8fb5be02793b645d99` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:14.882462 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3477e95-2aed-4a98-8c80-13f509a32895 None admin] RBAC: Authorizing `identity:get_user(user_id=179ea3f8c1ea4c8fb5be02793b645d99)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:14.884481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3477e95-2aed-4a98-8c80-13f509a32895 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:14.886328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 54/106] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:14 2022] GET /identity/v3/users/179ea3f8c1ea4c8fb5be02793b645d99 => generated 247 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:14.887854 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73706da4-be7d-4771-ac71-6be194dd2a1e None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:14.888154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73706da4-be7d-4771-ac71-6be194dd2a1e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:14.888641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73706da4-be7d-4771-ac71-6be194dd2a1e None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:14.890406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 55/107] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:14.892028 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73706da4-be7d-4771-ac71-6be194dd2a1e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:14.909669 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07253f6b-9613-4ff6-9123-95009a5aa590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:14.910317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07253f6b-9613-4ff6-9123-95009a5aa590 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:14.910616 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07253f6b-9613-4ff6-9123-95009a5aa590 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:14.910912 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07253f6b-9613-4ff6-9123-95009a5aa590 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:14.924698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07253f6b-9613-4ff6-9123-95009a5aa590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-07253f6b-9613-4ff6-9123-95009a5aa590 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:14.930630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:14.931884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:14.932727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:14.932727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:14.932727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:14.932727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:14.932727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:14.932727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:14.932727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:14.932727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:14.932727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:14.932727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:14.932727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:14.932727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:14.932727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 53/108] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:14.933748 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667a8c2-3ec2-4811-9e80-ac3132170662 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:14.934260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667a8c2-3ec2-4811-9e80-ac3132170662 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:14.934547 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667a8c2-3ec2-4811-9e80-ac3132170662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:14.937957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:14.956502 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-e667a8c2-3ec2-4811-9e80-ac3132170662 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:14.957748 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e667a8c2-3ec2-4811-9e80-ac3132170662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:15.007476 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:15.026801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73706da4-be7d-4771-ac71-6be194dd2a1e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:15.036978 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 54/109] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:15.042550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc477fc-8eef-47d1-8eff-b1d4a602e2af None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:15.042919 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc477fc-8eef-47d1-8eff-b1d4a602e2af None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:15.043275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc477fc-8eef-47d1-8eff-b1d4a602e2af None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:15.045319 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 55/110] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:15.046164 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc477fc-8eef-47d1-8eff-b1d4a602e2af None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:15.067345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44073ac-adbb-46e2-a270-6b1ef4b1a3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:15.069297 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44073ac-adbb-46e2-a270-6b1ef4b1a3fd None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:15.070067 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44073ac-adbb-46e2-a270-6b1ef4b1a3fd None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:15.070576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44073ac-adbb-46e2-a270-6b1ef4b1a3fd None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:15.072017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44073ac-adbb-46e2-a270-6b1ef4b1a3fd None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:15.073800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44073ac-adbb-46e2-a270-6b1ef4b1a3fd None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:15.076215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 56/111] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:14 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:15.077270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44073ac-adbb-46e2-a270-6b1ef4b1a3fd None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:15.168759 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc477fc-8eef-47d1-8eff-b1d4a602e2af None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:15.185280 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:15.193074 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44073ac-adbb-46e2-a270-6b1ef4b1a3fd None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:15.215804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38229217-210e-43ab-b72a-8d1e2cd9328c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:15.216483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38229217-210e-43ab-b72a-8d1e2cd9328c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:15.216766 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38229217-210e-43ab-b72a-8d1e2cd9328c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:15.217041 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38229217-210e-43ab-b72a-8d1e2cd9328c None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:15.217715 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38229217-210e-43ab-b72a-8d1e2cd9328c None admin] RBAC: Adding query filter params (name=member) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:15.218018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38229217-210e-43ab-b72a-8d1e2cd9328c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:15.219413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38229217-210e-43ab-b72a-8d1e2cd9328c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:15.230610 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 56/112] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:15.237574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecfc25-2a45-4de0-8d0e-8a07bd553776 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:15.237861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecfc25-2a45-4de0-8d0e-8a07bd553776 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:15.238140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecfc25-2a45-4de0-8d0e-8a07bd553776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:15.240158 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914300b0-dd49-4f0b-b465-9eb4c378bd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:15.241081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914300b0-dd49-4f0b-b465-9eb4c378bd58 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:15.241583 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914300b0-dd49-4f0b-b465-9eb4c378bd58 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:15.242066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914300b0-dd49-4f0b-b465-9eb4c378bd58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:15.255392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914300b0-dd49-4f0b-b465-9eb4c378bd58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:15.259904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-46ecfc25-2a45-4de0-8d0e-8a07bd553776 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:15.261137 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-46ecfc25-2a45-4de0-8d0e-8a07bd553776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-914300b0-dd49-4f0b-b465-9eb4c378bd58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:15.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:15.262420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:15.263218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:15.263218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:15.263218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:15.263218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:15.263218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:15.263218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:15.263218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:15.263218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:15.263218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:15.263218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:15.263218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:15.263218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:15.265534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 57/113] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:15.272128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914300b0-dd49-4f0b-b465-9eb4c378bd58 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:15.304163 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:15.405704 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914300b0-dd49-4f0b-b465-9eb4c378bd58 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:15.447024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e754673-44f7-4621-8361-f80f823799fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:15.447687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e754673-44f7-4621-8361-f80f823799fa None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:15.448450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e754673-44f7-4621-8361-f80f823799fa None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:15.448450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e754673-44f7-4621-8361-f80f823799fa None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5/users/179ea3f8c1ea4c8fb5be02793b645d99/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:15.450323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e754673-44f7-4621-8361-f80f823799fa None admin] RBAC: Authorizing `identity:create_grant(project_id=ee30b1fbec25473ebc077e35e79c2ad5, user_id=179ea3f8c1ea4c8fb5be02793b645d99, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:15.451810 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e754673-44f7-4621-8361-f80f823799fa None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:15.464156 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 57/114] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:15.470082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecfc25-2a45-4de0-8d0e-8a07bd553776 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:15.527060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 58/115] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:37:15 2022] PUT /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5/users/179ea3f8c1ea4c8fb5be02793b645d99/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:37:15.527736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e754673-44f7-4621-8361-f80f823799fa None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:15.547639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:15.609436 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecfc25-2a45-4de0-8d0e-8a07bd553776 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:15.659625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6072e7-7d86-47ef-94ef-228dcddd9557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:15.660371 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e754673-44f7-4621-8361-f80f823799fa None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:15.660834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6072e7-7d86-47ef-94ef-228dcddd9557 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:15.661307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6072e7-7d86-47ef-94ef-228dcddd9557 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:15.661763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6072e7-7d86-47ef-94ef-228dcddd9557 None admin] PATH_INFO: `/v3/users/13c53024985741bf9865d5cec76fef6d` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:15.664965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6072e7-7d86-47ef-94ef-228dcddd9557 None admin] RBAC: Authorizing `identity:get_user(user_id=13c53024985741bf9865d5cec76fef6d)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:15.666499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6072e7-7d86-47ef-94ef-228dcddd9557 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:15.668739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 58/116] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:15 2022] GET /identity/v3/users/13c53024985741bf9865d5cec76fef6d => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:15.669667 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817ee91-94b6-47c3-9f79-6b9123993ff2 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:15.669961 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817ee91-94b6-47c3-9f79-6b9123993ff2 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:15.670240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817ee91-94b6-47c3-9f79-6b9123993ff2 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:15.671491 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 59/117] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:15.672230 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817ee91-94b6-47c3-9f79-6b9123993ff2 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:15.720069 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:15.720309 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d856e4-55d2-4cc9-bf64-20f832bf05e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:15.721558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d856e4-55d2-4cc9-bf64-20f832bf05e5 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:15.722027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d856e4-55d2-4cc9-bf64-20f832bf05e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:15.722350 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d856e4-55d2-4cc9-bf64-20f832bf05e5 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:15.723008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d856e4-55d2-4cc9-bf64-20f832bf05e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:15.723321 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d856e4-55d2-4cc9-bf64-20f832bf05e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:15.724781 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d856e4-55d2-4cc9-bf64-20f832bf05e5 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:15.735896 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 59/118] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:15.738375 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d856e4-55d2-4cc9-bf64-20f832bf05e5 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:15.807073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817ee91-94b6-47c3-9f79-6b9123993ff2 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:15.835790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:15.848928 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66402b8-9bde-4b96-a31b-ac134541a6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:15.849605 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66402b8-9bde-4b96-a31b-ac134541a6da None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:15.849919 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66402b8-9bde-4b96-a31b-ac134541a6da None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:15.850154 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66402b8-9bde-4b96-a31b-ac134541a6da None admin] PATH_INFO: `/v3/domains/default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:15.851292 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66402b8-9bde-4b96-a31b-ac134541a6da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:15.853121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66402b8-9bde-4b96-a31b-ac134541a6da None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:15.854955 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 60/119] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:37:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:15.861726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a4113-8f31-4b57-a217-55219f679ddb None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:15.862300 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a4113-8f31-4b57-a217-55219f679ddb None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:15.862578 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a4113-8f31-4b57-a217-55219f679ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:15.863483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d856e4-55d2-4cc9-bf64-20f832bf05e5 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:15.882215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-383a4113-8f31-4b57-a217-55219f679ddb None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:15.883424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-383a4113-8f31-4b57-a217-55219f679ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:15.904476 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278c289-fef3-4e53-a1a0-61f517f3d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:15.905218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278c289-fef3-4e53-a1a0-61f517f3d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:15.905578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278c289-fef3-4e53-a1a0-61f517f3d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:15.905944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278c289-fef3-4e53-a1a0-61f517f3d2d1 None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:15.907226 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278c289-fef3-4e53-a1a0-61f517f3d2d1 None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:15.908872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278c289-fef3-4e53-a1a0-61f517f3d2d1 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:15.915308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 60/120] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:15 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:15.915308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278c289-fef3-4e53-a1a0-61f517f3d2d1 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:15.975594 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 61/121] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:15.985521 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a4113-8f31-4b57-a217-55219f679ddb None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:16.037329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278c289-fef3-4e53-a1a0-61f517f3d2d1 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:16.053417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:16.078615 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb97fa-5a61-41fb-8eb5-4bb39907f5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:16.079266 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb97fa-5a61-41fb-8eb5-4bb39907f5ac None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:16.079608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb97fa-5a61-41fb-8eb5-4bb39907f5ac None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:16.079945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb97fa-5a61-41fb-8eb5-4bb39907f5ac None admin] PATH_INFO: `/v3/users/fbf90c60a12549e7b0398fbbcc916a3b` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:16.097410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb97fa-5a61-41fb-8eb5-4bb39907f5ac None admin] RBAC: Authorizing `identity:get_user(user_id=fbf90c60a12549e7b0398fbbcc916a3b)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:16.099090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb97fa-5a61-41fb-8eb5-4bb39907f5ac None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:16.101152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 61/122] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:15 2022] GET /identity/v3/users/fbf90c60a12549e7b0398fbbcc916a3b => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:16.107025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb97fa-5a61-41fb-8eb5-4bb39907f5ac None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:16.110214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:16.185446 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a4113-8f31-4b57-a217-55219f679ddb None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:16.224994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c80ff-0e9a-4563-9e8f-37e618375b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:16.225730 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c80ff-0e9a-4563-9e8f-37e618375b5c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:16.226081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c80ff-0e9a-4563-9e8f-37e618375b5c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:16.226429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c80ff-0e9a-4563-9e8f-37e618375b5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:16.239370 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c80ff-0e9a-4563-9e8f-37e618375b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-ec2c80ff-0e9a-4563-9e8f-37e618375b5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:16.244618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:16.245638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:16.246557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:16.246557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:16.246557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:16.246557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:16.246557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:16.246557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:16.246557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:16.246557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:16.246557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:16.246557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:16.246557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:16.246557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:16.247233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 62/123] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:16.247515 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c80ff-0e9a-4563-9e8f-37e618375b5c None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:16.271716 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb97fa-5a61-41fb-8eb5-4bb39907f5ac None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:16.311068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faafe70-473a-4ee2-b5e0-2e20b37020b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:16.312134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faafe70-473a-4ee2-b5e0-2e20b37020b0 None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:16.312134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faafe70-473a-4ee2-b5e0-2e20b37020b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:16.312377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faafe70-473a-4ee2-b5e0-2e20b37020b0 None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:16.313029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faafe70-473a-4ee2-b5e0-2e20b37020b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:16.315416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faafe70-473a-4ee2-b5e0-2e20b37020b0 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:16.369036 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:16.378986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c80ff-0e9a-4563-9e8f-37e618375b5c None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:16.402737 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 62/124] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Aug 29 22:37:16 2022] POST /identity/v3/projects => generated 302 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:37:16.411472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faafe70-473a-4ee2-b5e0-2e20b37020b0 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:16.428088 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04422ad7-33e1-4003-b2a6-59d0a36366f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:16.428476 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04422ad7-33e1-4003-b2a6-59d0a36366f6 None admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:16.428729 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04422ad7-33e1-4003-b2a6-59d0a36366f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:16.429002 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04422ad7-33e1-4003-b2a6-59d0a36366f6 None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5/users/13c53024985741bf9865d5cec76fef6d/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:16.433306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04422ad7-33e1-4003-b2a6-59d0a36366f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee30b1fbec25473ebc077e35e79c2ad5, user_id=13c53024985741bf9865d5cec76fef6d, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:16.436285 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04422ad7-33e1-4003-b2a6-59d0a36366f6 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:16.545002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:16.575329 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 63/125] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:37:16 2022] PUT /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5/users/13c53024985741bf9865d5cec76fef6d/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:37:16.576220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04422ad7-33e1-4003-b2a6-59d0a36366f6 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:16.624289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faafe70-473a-4ee2-b5e0-2e20b37020b0 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:16.676561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601abb15-6943-48a7-8693-fb85a07958ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:16.677225 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601abb15-6943-48a7-8693-fb85a07958ef None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:16.677511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601abb15-6943-48a7-8693-fb85a07958ef None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:16.677786 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601abb15-6943-48a7-8693-fb85a07958ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:16.734369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04422ad7-33e1-4003-b2a6-59d0a36366f6 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:16.783082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601abb15-6943-48a7-8693-fb85a07958ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:16.784114 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888ce22-1dc8-48cb-ac97-5b3edf94fc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:16.784627 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601abb15-6943-48a7-8693-fb85a07958ef None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:16.785230 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888ce22-1dc8-48cb-ac97-5b3edf94fc10 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:16.785729 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888ce22-1dc8-48cb-ac97-5b3edf94fc10 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:16.786197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888ce22-1dc8-48cb-ac97-5b3edf94fc10 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:16.787100 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888ce22-1dc8-48cb-ac97-5b3edf94fc10 None admin] RBAC: Adding query filter params (name=member) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:16.787643 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888ce22-1dc8-48cb-ac97-5b3edf94fc10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:16.789288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888ce22-1dc8-48cb-ac97-5b3edf94fc10 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:16.802122 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 64/126] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:16.803578 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888ce22-1dc8-48cb-ac97-5b3edf94fc10 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:16.824416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:16.858423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:16.916652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 63/127] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:16.917959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601abb15-6943-48a7-8693-fb85a07958ef None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:16.981868 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888ce22-1dc8-48cb-ac97-5b3edf94fc10 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:17.027295 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ce77d-7dd4-4737-a794-615470fcb6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:17.028103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ce77d-7dd4-4737-a794-615470fcb6ad None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:17.028545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ce77d-7dd4-4737-a794-615470fcb6ad None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:17.028920 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ce77d-7dd4-4737-a794-615470fcb6ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:17.055615 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601abb15-6943-48a7-8693-fb85a07958ef None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:17.059519 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ce77d-7dd4-4737-a794-615470fcb6ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-673ce77d-7dd4-4737-a794-615470fcb6ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:17.065649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:17.066517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:17.067261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:17.067261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:17.067261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:17.067261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:17.067261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:17.067261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:17.067261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:17.067261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:17.067261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:17.067261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:17.067261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:17.067261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:17.074470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 65/128] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:37:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:17.075460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ce77d-7dd4-4737-a794-615470fcb6ad None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:17.101307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66190a1c-90de-4f1b-a8c1-0a08805d5f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:17.102486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66190a1c-90de-4f1b-a8c1-0a08805d5f28 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:17.103158 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66190a1c-90de-4f1b-a8c1-0a08805d5f28 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:17.103584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66190a1c-90de-4f1b-a8c1-0a08805d5f28 None admin] PATH_INFO: `/v3/users/13c53024985741bf9865d5cec76fef6d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:17.110091 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66190a1c-90de-4f1b-a8c1-0a08805d5f28 None admin] RBAC: Authorizing `identity:get_user(user_id=13c53024985741bf9865d5cec76fef6d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:17.111805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66190a1c-90de-4f1b-a8c1-0a08805d5f28 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:17.115956 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 64/129] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:16 2022] GET /identity/v3/users/13c53024985741bf9865d5cec76fef6d => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:17.121692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66190a1c-90de-4f1b-a8c1-0a08805d5f28 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:17.162607 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:17.266084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66190a1c-90de-4f1b-a8c1-0a08805d5f28 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:17.272007 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:17.303910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ce77d-7dd4-4737-a794-615470fcb6ad None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:17.343109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acc46a-36ac-48f3-b458-d07a9d17570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:17.343758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acc46a-36ac-48f3-b458-d07a9d17570b None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:17.344038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acc46a-36ac-48f3-b458-d07a9d17570b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:17.344344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acc46a-36ac-48f3-b458-d07a9d17570b None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:17.346088 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acc46a-36ac-48f3-b458-d07a9d17570b None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:17.347991 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acc46a-36ac-48f3-b458-d07a9d17570b None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:17.349695 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 66/130] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:17 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:17.350460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acc46a-36ac-48f3-b458-d07a9d17570b None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:17.366318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d0997-f19b-4d15-83f6-093c40a7d5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:17.366944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d0997-f19b-4d15-83f6-093c40a7d5b0 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:17.367230 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d0997-f19b-4d15-83f6-093c40a7d5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:17.367506 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d0997-f19b-4d15-83f6-093c40a7d5b0 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:17.368212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d0997-f19b-4d15-83f6-093c40a7d5b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:17.368521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d0997-f19b-4d15-83f6-093c40a7d5b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:17.370198 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d0997-f19b-4d15-83f6-093c40a7d5b0 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:17.382296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 65/131] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:37:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:17.383687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d0997-f19b-4d15-83f6-093c40a7d5b0 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:17.528587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:17.534213 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d0997-f19b-4d15-83f6-093c40a7d5b0 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:17.579133 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcade0-7ea5-49d4-9f7e-97c33bddaff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:17.579911 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcade0-7ea5-49d4-9f7e-97c33bddaff7 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:17.580680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcade0-7ea5-49d4-9f7e-97c33bddaff7 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:17.581526 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcade0-7ea5-49d4-9f7e-97c33bddaff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:17.582283 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcade0-7ea5-49d4-9f7e-97c33bddaff7 None admin] RBAC: Adding query filter params (role.id=071203b5be0a4780aa2292e2be3fe13c, scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5, user.id=fbf90c60a12549e7b0398fbbcc916a3b) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:17.582601 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcade0-7ea5-49d4-9f7e-97c33bddaff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:17.583256 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acc46a-36ac-48f3-b458-d07a9d17570b None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:17.584155 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcade0-7ea5-49d4-9f7e-97c33bddaff7 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:17.589987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 66/132] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:17 2022] GET /identity/v3/role_assignments?user.id=fbf90c60a12549e7b0398fbbcc916a3b&scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5&role.id=071203b5be0a4780aa2292e2be3fe13c => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:17.591050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcade0-7ea5-49d4-9f7e-97c33bddaff7 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:17.683406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f26a8-217f-4d31-91c7-0cf24928985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:17.684113 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f26a8-217f-4d31-91c7-0cf24928985b None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:17.685897 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f26a8-217f-4d31-91c7-0cf24928985b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:17.685897 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f26a8-217f-4d31-91c7-0cf24928985b None admin] PATH_INFO: `/v3/projects/463db6dbd0d2422fa3de11c0d94133ed` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:17.693297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f26a8-217f-4d31-91c7-0cf24928985b None admin] RBAC: Authorizing `identity:get_project(project_id=463db6dbd0d2422fa3de11c0d94133ed)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:17.696211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f26a8-217f-4d31-91c7-0cf24928985b None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:17.697658 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 67/133] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:17 2022] GET /identity/v3/projects/463db6dbd0d2422fa3de11c0d94133ed => generated 312 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:17.716226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f26a8-217f-4d31-91c7-0cf24928985b None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:17.755779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:17.927942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcade0-7ea5-49d4-9f7e-97c33bddaff7 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:18.052876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f26a8-217f-4d31-91c7-0cf24928985b None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:18.060961 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40ca62-5f5d-4f6d-9851-272658d65207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:18.061633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40ca62-5f5d-4f6d-9851-272658d65207 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:18.061921 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40ca62-5f5d-4f6d-9851-272658d65207 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:18.062202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40ca62-5f5d-4f6d-9851-272658d65207 None admin] PATH_INFO: `/v3/users/13c53024985741bf9865d5cec76fef6d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:18.069017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40ca62-5f5d-4f6d-9851-272658d65207 None admin] RBAC: Authorizing `identity:get_user(user_id=13c53024985741bf9865d5cec76fef6d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:18.070539 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40ca62-5f5d-4f6d-9851-272658d65207 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:18.072205 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 67/134] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:17 2022] GET /identity/v3/users/13c53024985741bf9865d5cec76fef6d => generated 275 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:18.073401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c871c-c7f0-4cc8-8e0b-5ed433954784 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:18.073685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c871c-c7f0-4cc8-8e0b-5ed433954784 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:18.074255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c871c-c7f0-4cc8-8e0b-5ed433954784 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:18.075187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 68/135] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:18.081889 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c871c-c7f0-4cc8-8e0b-5ed433954784 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:18.138907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:18.152960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57652ec8-098a-47ef-bf16-b14fc4de2028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:18.153886 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57652ec8-098a-47ef-bf16-b14fc4de2028 None admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:18.154198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57652ec8-098a-47ef-bf16-b14fc4de2028 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:18.154557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57652ec8-098a-47ef-bf16-b14fc4de2028 None admin] PATH_INFO: `/v3/projects/463db6dbd0d2422fa3de11c0d94133ed/users/13c53024985741bf9865d5cec76fef6d/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:18.165245 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57652ec8-098a-47ef-bf16-b14fc4de2028 None admin] RBAC: Authorizing `identity:create_grant(project_id=463db6dbd0d2422fa3de11c0d94133ed, user_id=13c53024985741bf9865d5cec76fef6d, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:18.166736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57652ec8-098a-47ef-bf16-b14fc4de2028 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:18.263560 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 68/136] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:37:17 2022] PUT /identity/v3/projects/463db6dbd0d2422fa3de11c0d94133ed/users/13c53024985741bf9865d5cec76fef6d/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:37:18.272426 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db64ae-ad0c-406d-a829-629f1b2d511a None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:18.272426 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db64ae-ad0c-406d-a829-629f1b2d511a None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:18.272426 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db64ae-ad0c-406d-a829-629f1b2d511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:18.311200 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-e2db64ae-ad0c-406d-a829-629f1b2d511a None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:18.313446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c871c-c7f0-4cc8-8e0b-5ed433954784 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:18.316161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e2db64ae-ad0c-406d-a829-629f1b2d511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:18.371774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e0012-3d4e-4fcc-842f-73bafff2f0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:18.372934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e0012-3d4e-4fcc-842f-73bafff2f0f4 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:18.373588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e0012-3d4e-4fcc-842f-73bafff2f0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:18.374278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e0012-3d4e-4fcc-842f-73bafff2f0f4 None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:18.375768 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e0012-3d4e-4fcc-842f-73bafff2f0f4 None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:18.378253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e0012-3d4e-4fcc-842f-73bafff2f0f4 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:18.380974 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 69/137] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:18 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:18.388473 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e0012-3d4e-4fcc-842f-73bafff2f0f4 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:18.490663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:18.495257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 69/138] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:18.545843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:18.565652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e0012-3d4e-4fcc-842f-73bafff2f0f4 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:18.606474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db202ca-1ed6-4759-83e7-8b2b04edaa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:18.607162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db202ca-1ed6-4759-83e7-8b2b04edaa25 None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:18.607458 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db202ca-1ed6-4759-83e7-8b2b04edaa25 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:18.607734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db202ca-1ed6-4759-83e7-8b2b04edaa25 None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5/users/13c53024985741bf9865d5cec76fef6d/roles/da30366a448b4b1f902c8160690d366e` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:18.610045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db202ca-1ed6-4759-83e7-8b2b04edaa25 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee30b1fbec25473ebc077e35e79c2ad5, user_id=13c53024985741bf9865d5cec76fef6d, role_id=da30366a448b4b1f902c8160690d366e)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:18.611762 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db202ca-1ed6-4759-83e7-8b2b04edaa25 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:18.681377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 70/139] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:37:18 2022] PUT /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5/users/13c53024985741bf9865d5cec76fef6d/roles/da30366a448b4b1f902c8160690d366e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:37:19.001176 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db64ae-ad0c-406d-a829-629f1b2d511a None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:19.104221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cfc6d-69d0-4746-a019-5936aff2dfbd None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:19.104567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cfc6d-69d0-4746-a019-5936aff2dfbd None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:19.104782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cfc6d-69d0-4746-a019-5936aff2dfbd None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:19.106941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 71/140] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:19.112694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbabcf-d83d-4f10-a856-902e1718b23c None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:19.112978 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbabcf-d83d-4f10-a856-902e1718b23c None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:19.113256 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbabcf-d83d-4f10-a856-902e1718b23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:19.130290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db64ae-ad0c-406d-a829-629f1b2d511a None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:19.138641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-b2dbabcf-d83d-4f10-a856-902e1718b23c None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:19.139855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b2dbabcf-d83d-4f10-a856-902e1718b23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:19.216985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fb0b7-8b1f-4adc-978e-a69889004132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:19.217644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fb0b7-8b1f-4adc-978e-a69889004132 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:19.217923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fb0b7-8b1f-4adc-978e-a69889004132 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:19.218192 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fb0b7-8b1f-4adc-978e-a69889004132 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:19.242195 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 72/141] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:19.257351 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943fb0b7-8b1f-4adc-978e-a69889004132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-943fb0b7-8b1f-4adc-978e-a69889004132 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:19.262277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:19.263431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:19.264802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:19.264802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:19.264802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:19.264802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:19.264802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:19.264802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:19.264802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:19.264802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:19.264802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:19.264802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:19.264802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:19.264802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:19.264802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 70/142] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:37:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:19.269320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbabcf-d83d-4f10-a856-902e1718b23c None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:19.357456 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6f9a5-9812-469c-ad5c-017cb768fcff None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:19.357788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6f9a5-9812-469c-ad5c-017cb768fcff None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:19.358023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6f9a5-9812-469c-ad5c-017cb768fcff None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:19.359613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 71/143] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:19.367186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149838bd-40e5-4851-8f4a-19055298af1f None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:19.367466 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149838bd-40e5-4851-8f4a-19055298af1f None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:19.367742 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149838bd-40e5-4851-8f4a-19055298af1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:19.417280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-149838bd-40e5-4851-8f4a-19055298af1f None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:19.423999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-149838bd-40e5-4851-8f4a-19055298af1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:19.439895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:19.519845 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbabcf-d83d-4f10-a856-902e1718b23c None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:19.546353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:19.568713 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 72/144] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:19.602185 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf299a-16b4-40b9-ac38-60fbc3fe9b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:19.602754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf299a-16b4-40b9-ac38-60fbc3fe9b8e None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:19.603028 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf299a-16b4-40b9-ac38-60fbc3fe9b8e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:19.603291 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf299a-16b4-40b9-ac38-60fbc3fe9b8e None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:19.603976 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf299a-16b4-40b9-ac38-60fbc3fe9b8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:19.604300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf299a-16b4-40b9-ac38-60fbc3fe9b8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:19.605703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf299a-16b4-40b9-ac38-60fbc3fe9b8e None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:19.623591 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 73/145] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:19.629910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149838bd-40e5-4851-8f4a-19055298af1f None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:19.789814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149838bd-40e5-4851-8f4a-19055298af1f None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:19.793267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf299a-16b4-40b9-ac38-60fbc3fe9b8e None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:19.851447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db90ad-e9c8-424a-a227-98a987199178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:19.852429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db90ad-e9c8-424a-a227-98a987199178 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:19.852709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db90ad-e9c8-424a-a227-98a987199178 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:19.852983 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db90ad-e9c8-424a-a227-98a987199178 None admin] PATH_INFO: `/v3/users/179ea3f8c1ea4c8fb5be02793b645d99` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:19.854130 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db90ad-e9c8-424a-a227-98a987199178 None admin] RBAC: Authorizing `identity:get_user(user_id=179ea3f8c1ea4c8fb5be02793b645d99)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:19.855644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db90ad-e9c8-424a-a227-98a987199178 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:19.858076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 73/146] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:19 2022] GET /identity/v3/users/179ea3f8c1ea4c8fb5be02793b645d99 => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:19.872142 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db90ad-e9c8-424a-a227-98a987199178 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:19.951692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:19.991891 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf299a-16b4-40b9-ac38-60fbc3fe9b8e None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:20.029885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db90ad-e9c8-424a-a227-98a987199178 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:20.036883 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d8cd4-afd8-4a81-b81d-994aca60ab36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:20.037949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8cd4-afd8-4a81-b81d-994aca60ab36 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:20.038234 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8cd4-afd8-4a81-b81d-994aca60ab36 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:20.038643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8cd4-afd8-4a81-b81d-994aca60ab36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:20.046380 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:20.070713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d8cd4-afd8-4a81-b81d-994aca60ab36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:20.071323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7f2af-bbea-4e38-a708-ad7ac9c5f9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:20.072070 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7f2af-bbea-4e38-a708-ad7ac9c5f9f2 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:20.072454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7f2af-bbea-4e38-a708-ad7ac9c5f9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:20.072831 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7f2af-bbea-4e38-a708-ad7ac9c5f9f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-551d8cd4-afd8-4a81-b81d-994aca60ab36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:20.084920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:20.085827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:20.086577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:20.086577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:20.086577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:20.086577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:20.086577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:20.086577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:20.086577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:20.086577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:20.086577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:20.086577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:20.086577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:20.086577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:20.088531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 74/147] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:20.090260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d8cd4-afd8-4a81-b81d-994aca60ab36 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:20.160275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7f2af-bbea-4e38-a708-ad7ac9c5f9f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:20.161993 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7f2af-bbea-4e38-a708-ad7ac9c5f9f2 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:20.234960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:20.252334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d8cd4-afd8-4a81-b81d-994aca60ab36 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:20.286927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 74/148] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 22:37:20.287780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7f2af-bbea-4e38-a708-ad7ac9c5f9f2 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:20.309452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e3058-06c9-4d37-bd95-0f87e72c2bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:20.312226 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e3058-06c9-4d37-bd95-0f87e72c2bd1 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:20.312226 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e3058-06c9-4d37-bd95-0f87e72c2bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:20.312226 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e3058-06c9-4d37-bd95-0f87e72c2bd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:20.313934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e3058-06c9-4d37-bd95-0f87e72c2bd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:20.316824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e3058-06c9-4d37-bd95-0f87e72c2bd1 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:20.318514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 75/149] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:37:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:20.319567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e3058-06c9-4d37-bd95-0f87e72c2bd1 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:20.460365 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7f2af-bbea-4e38-a708-ad7ac9c5f9f2 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:20.478654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:20.554547 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac49d85-1b22-4873-bf22-b1234342879a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:20.555603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac49d85-1b22-4873-bf22-b1234342879a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:20.556082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac49d85-1b22-4873-bf22-b1234342879a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:20.556586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac49d85-1b22-4873-bf22-b1234342879a None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:20.557769 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac49d85-1b22-4873-bf22-b1234342879a None admin] RBAC: Adding query filter params (name=member) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:20.558307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac49d85-1b22-4873-bf22-b1234342879a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:20.569860 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac49d85-1b22-4873-bf22-b1234342879a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:20.592355 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 75/150] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:20.593510 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac49d85-1b22-4873-bf22-b1234342879a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:20.601073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e3058-06c9-4d37-bd95-0f87e72c2bd1 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:20.621924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:20.670222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb69381-5756-4bb4-a9ea-151d3a6bf990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:20.671216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb69381-5756-4bb4-a9ea-151d3a6bf990 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:20.671860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb69381-5756-4bb4-a9ea-151d3a6bf990 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:20.672493 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb69381-5756-4bb4-a9ea-151d3a6bf990 None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:20.675713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb69381-5756-4bb4-a9ea-151d3a6bf990 None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:20.679532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb69381-5756-4bb4-a9ea-151d3a6bf990 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:20.683355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 76/151] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:20 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:20.690117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501cbfa-936e-47e9-9cb1-03cac58c6820 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:20.690117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501cbfa-936e-47e9-9cb1-03cac58c6820 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:20.690117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501cbfa-936e-47e9-9cb1-03cac58c6820 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:20.691476 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 77/152] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:20.692272 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501cbfa-936e-47e9-9cb1-03cac58c6820 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:20.775150 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac49d85-1b22-4873-bf22-b1234342879a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:20.819092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9dd3c8-b30c-41af-a446-86f032f88971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:20.820009 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dd3c8-b30c-41af-a446-86f032f88971 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:20.820490 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dd3c8-b30c-41af-a446-86f032f88971 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:20.820896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dd3c8-b30c-41af-a446-86f032f88971 None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:20.821937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9dd3c8-b30c-41af-a446-86f032f88971 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:20.823589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9dd3c8-b30c-41af-a446-86f032f88971 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:20.854997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501cbfa-936e-47e9-9cb1-03cac58c6820 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:20.888625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:20.895310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8da5f-8718-4ee0-91b8-451511236fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:20.895963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8da5f-8718-4ee0-91b8-451511236fd5 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:20.896279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8da5f-8718-4ee0-91b8-451511236fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:20.896616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8da5f-8718-4ee0-91b8-451511236fd5 None admin] PATH_INFO: `/v3/users/13c53024985741bf9865d5cec76fef6d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:20.897757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8da5f-8718-4ee0-91b8-451511236fd5 None admin] RBAC: Authorizing `identity:get_user(user_id=13c53024985741bf9865d5cec76fef6d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:20.899348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8da5f-8718-4ee0-91b8-451511236fd5 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:20.901384 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 78/153] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:20 2022] GET /identity/v3/users/13c53024985741bf9865d5cec76fef6d => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:20.902238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8da5f-8718-4ee0-91b8-451511236fd5 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:20.907158 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 76/154] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:37:20 2022] POST /identity/v3/users => generated 283 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:37:20.909888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95ed4f-8afc-4e72-b0c4-6e1de248c89c None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:20.910392 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95ed4f-8afc-4e72-b0c4-6e1de248c89c None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:20.910911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95ed4f-8afc-4e72-b0c4-6e1de248c89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:20.939334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-cd95ed4f-8afc-4e72-b0c4-6e1de248c89c None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:20.940936 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-cd95ed4f-8afc-4e72-b0c4-6e1de248c89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:21.034281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 77/155] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:21.045348 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95ed4f-8afc-4e72-b0c4-6e1de248c89c None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:21.056223 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:21.141324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8da5f-8718-4ee0-91b8-451511236fd5 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:21.188359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1a217-6732-4fa1-8a04-79e75042e642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:21.189771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a217-6732-4fa1-8a04-79e75042e642 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:21.189971 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a217-6732-4fa1-8a04-79e75042e642 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:21.190438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a217-6732-4fa1-8a04-79e75042e642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:21.191237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1a217-6732-4fa1-8a04-79e75042e642 None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5, user.id=179ea3f8c1ea4c8fb5be02793b645d99) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:21.191553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1a217-6732-4fa1-8a04-79e75042e642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:21.193048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1a217-6732-4fa1-8a04-79e75042e642 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:21.199865 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 79/156] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:20 2022] GET /identity/v3/role_assignments?user.id=179ea3f8c1ea4c8fb5be02793b645d99&scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:21.200925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14673fd-a482-48ad-ad5a-cbcb3dfa1aa0 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:21.201209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14673fd-a482-48ad-ad5a-cbcb3dfa1aa0 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:21.201490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14673fd-a482-48ad-ad5a-cbcb3dfa1aa0 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:21.204033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 80/157] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:21.210808 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a9a89-b9c7-413e-bdd1-b5a3ca7f3627 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:21.211095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a9a89-b9c7-413e-bdd1-b5a3ca7f3627 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:21.211377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a9a89-b9c7-413e-bdd1-b5a3ca7f3627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:21.235400 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95ed4f-8afc-4e72-b0c4-6e1de248c89c None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:21.241103 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-c01a9a89-b9c7-413e-bdd1-b5a3ca7f3627 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:21.242341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c01a9a89-b9c7-413e-bdd1-b5a3ca7f3627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:21.290669 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782a569-bd1f-44b1-8b20-25efdbdec0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:21.291646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782a569-bd1f-44b1-8b20-25efdbdec0c1 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:21.292174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782a569-bd1f-44b1-8b20-25efdbdec0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:21.292638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782a569-bd1f-44b1-8b20-25efdbdec0c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:21.334361 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:21.354981 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 81/158] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:21.417160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782a569-bd1f-44b1-8b20-25efdbdec0c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:21.422495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782a569-bd1f-44b1-8b20-25efdbdec0c1 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:21.434093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:21.572746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a9a89-b9c7-413e-bdd1-b5a3ca7f3627 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:21.588104 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 78/159] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:21.597878 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782a569-bd1f-44b1-8b20-25efdbdec0c1 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:21.707894 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a9a89-b9c7-413e-bdd1-b5a3ca7f3627 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:21.730324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782a569-bd1f-44b1-8b20-25efdbdec0c1 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:21.740361 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:21.759881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab9856-c31d-4032-8530-e588f3661e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:21.761035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab9856-c31d-4032-8530-e588f3661e31 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:21.761430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab9856-c31d-4032-8530-e588f3661e31 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:21.761713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab9856-c31d-4032-8530-e588f3661e31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:21.776965 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab9856-c31d-4032-8530-e588f3661e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:21.780789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae18df-b3cf-43d0-9176-5fc17622d0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:21.781718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae18df-b3cf-43d0-9176-5fc17622d0b0 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:21.782224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae18df-b3cf-43d0-9176-5fc17622d0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-29ab9856-c31d-4032-8530-e588f3661e31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:21.782395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:21.784552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:21.785328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:21.785328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:21.785328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:21.785328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:21.785328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:21.785328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:21.785328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:21.785328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:21.785328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:21.785328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:21.785328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:21.785328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:21.785328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 82/160] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:21.785948 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f540c-b585-47fc-810a-056eee0ff6af None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:21.786759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f540c-b585-47fc-810a-056eee0ff6af None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:21.786759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f540c-b585-47fc-810a-056eee0ff6af None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:21.787492 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae18df-b3cf-43d0-9176-5fc17622d0b0 None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:21.787745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 83/161] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:21.793066 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae18df-b3cf-43d0-9176-5fc17622d0b0 None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:21.793424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ca13d-fce9-4a9f-b2aa-5750b20883fd None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:21.793799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ca13d-fce9-4a9f-b2aa-5750b20883fd None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:21.794173 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ca13d-fce9-4a9f-b2aa-5750b20883fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:21.795551 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae18df-b3cf-43d0-9176-5fc17622d0b0 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:21.797679 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 79/162] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:21 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:21.801374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae18df-b3cf-43d0-9176-5fc17622d0b0 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:21.818021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-ed6ca13d-fce9-4a9f-b2aa-5750b20883fd None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:21.818854 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ed6ca13d-fce9-4a9f-b2aa-5750b20883fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:21.895167 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:21.919419 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 84/163] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:21.920632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ca13d-fce9-4a9f-b2aa-5750b20883fd None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:21.942985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae18df-b3cf-43d0-9176-5fc17622d0b0 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:21.989275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44f3e8-bd38-4870-adfb-d69127366387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:21.989275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44f3e8-bd38-4870-adfb-d69127366387 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:21.989538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44f3e8-bd38-4870-adfb-d69127366387 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:21.989825 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44f3e8-bd38-4870-adfb-d69127366387 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:21.990963 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44f3e8-bd38-4870-adfb-d69127366387 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:21.991083 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44f3e8-bd38-4870-adfb-d69127366387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:21.992720 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44f3e8-bd38-4870-adfb-d69127366387 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:22.003509 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 80/164] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:22.004875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44f3e8-bd38-4870-adfb-d69127366387 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:22.038522 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ca13d-fce9-4a9f-b2aa-5750b20883fd None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:22.053815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:22.082985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb022a9f-6bd0-4429-8ef6-f9c71fa6cda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:22.083910 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb022a9f-6bd0-4429-8ef6-f9c71fa6cda5 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:22.084431 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb022a9f-6bd0-4429-8ef6-f9c71fa6cda5 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:22.084899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb022a9f-6bd0-4429-8ef6-f9c71fa6cda5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:22.085824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb022a9f-6bd0-4429-8ef6-f9c71fa6cda5 None admin] RBAC: Adding query filter params (role.id=bebe72a018ea47b992e9e6715060fadb, scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5, user.id=13c53024985741bf9865d5cec76fef6d) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:22.086327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb022a9f-6bd0-4429-8ef6-f9c71fa6cda5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:22.087978 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb022a9f-6bd0-4429-8ef6-f9c71fa6cda5 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:22.094876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 85/165] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:21 2022] GET /identity/v3/role_assignments?user.id=13c53024985741bf9865d5cec76fef6d&scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5&role.id=bebe72a018ea47b992e9e6715060fadb => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:22.096956 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb022a9f-6bd0-4429-8ef6-f9c71fa6cda5 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:22.156632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:22.172523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44f3e8-bd38-4870-adfb-d69127366387 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:22.229741 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bf8d2-c1cb-4a90-8a6a-7761a947e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:22.230784 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bf8d2-c1cb-4a90-8a6a-7761a947e9db None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:22.230784 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bf8d2-c1cb-4a90-8a6a-7761a947e9db None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:22.231101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bf8d2-c1cb-4a90-8a6a-7761a947e9db None admin] PATH_INFO: `/v3/roles/member` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:22.247963 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bf8d2-c1cb-4a90-8a6a-7761a947e9db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:22.250502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb022a9f-6bd0-4429-8ef6-f9c71fa6cda5 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-549bf8d2-c1cb-4a90-8a6a-7761a947e9db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:22.255366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:22.256362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:22.257337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:22.257337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:22.257337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:22.257337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:22.257337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:22.257337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:22.257337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:22.257337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:22.257337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:22.257337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:22.257337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:22.257337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:22.257337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 81/166] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:22.265948 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bf8d2-c1cb-4a90-8a6a-7761a947e9db None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:22.337345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457f31b-9248-4817-9991-fc9391995f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:22.338159 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457f31b-9248-4817-9991-fc9391995f20 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:22.338688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457f31b-9248-4817-9991-fc9391995f20 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:22.339049 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457f31b-9248-4817-9991-fc9391995f20 None admin] PATH_INFO: `/v3/users/fbf90c60a12549e7b0398fbbcc916a3b` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:22.340637 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457f31b-9248-4817-9991-fc9391995f20 None admin] RBAC: Authorizing `identity:get_user(user_id=fbf90c60a12549e7b0398fbbcc916a3b)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:22.342228 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457f31b-9248-4817-9991-fc9391995f20 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:22.348392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 86/167] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:22 2022] GET /identity/v3/users/fbf90c60a12549e7b0398fbbcc916a3b => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:22.348392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457f31b-9248-4817-9991-fc9391995f20 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:22.445278 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:22.453060 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bf8d2-c1cb-4a90-8a6a-7761a947e9db None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:22.497159 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457f31b-9248-4817-9991-fc9391995f20 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:22.498074 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd206495-b825-4026-89ce-9055930ac98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:22.498998 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd206495-b825-4026-89ce-9055930ac98f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:22.499465 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd206495-b825-4026-89ce-9055930ac98f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:22.500113 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd206495-b825-4026-89ce-9055930ac98f None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:22.501005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd206495-b825-4026-89ce-9055930ac98f None admin] RBAC: Adding query filter params (name=member) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:22.502202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd206495-b825-4026-89ce-9055930ac98f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:22.503818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd206495-b825-4026-89ce-9055930ac98f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:22.514216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 82/168] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:22.515308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd206495-b825-4026-89ce-9055930ac98f None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:22.517703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:22.548892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc248fb-7985-4966-9e6b-53e353a38092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:22.549713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc248fb-7985-4966-9e6b-53e353a38092 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:22.550099 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc248fb-7985-4966-9e6b-53e353a38092 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:22.550810 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc248fb-7985-4966-9e6b-53e353a38092 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:22.565166 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc248fb-7985-4966-9e6b-53e353a38092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-5bc248fb-7985-4966-9e6b-53e353a38092 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:22.571310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:22.572376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:22.573152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:22.573152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:22.573152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:22.573152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:22.573152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:22.573152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:22.573152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:22.573152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:22.573152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:22.573152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:22.573152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:22.573152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:22.573152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 87/169] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:37:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:22.578693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc248fb-7985-4966-9e6b-53e353a38092 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:22.638855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd206495-b825-4026-89ce-9055930ac98f None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:22.678225 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d8323-6797-4514-ba7d-b4af669b944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:22.679272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d8323-6797-4514-ba7d-b4af669b944f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:22.679764 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d8323-6797-4514-ba7d-b4af669b944f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:22.680274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d8323-6797-4514-ba7d-b4af669b944f None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:22.681694 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d8323-6797-4514-ba7d-b4af669b944f None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:22.683509 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d8323-6797-4514-ba7d-b4af669b944f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:22.685863 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 83/170] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:22 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:22.686906 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d8323-6797-4514-ba7d-b4af669b944f None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:22.730823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc248fb-7985-4966-9e6b-53e353a38092 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:22.748662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:22.800571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecb596-4053-4f95-8c5a-3df73f4801a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:22.801325 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb596-4053-4f95-8c5a-3df73f4801a4 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:22.801692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb596-4053-4f95-8c5a-3df73f4801a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:22.803324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb596-4053-4f95-8c5a-3df73f4801a4 None admin] PATH_INFO: `/v3/users/13c53024985741bf9865d5cec76fef6d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:22.804642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecb596-4053-4f95-8c5a-3df73f4801a4 None admin] RBAC: Authorizing `identity:get_user(user_id=13c53024985741bf9865d5cec76fef6d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:22.807089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecb596-4053-4f95-8c5a-3df73f4801a4 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:22.809020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 88/171] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:22 2022] GET /identity/v3/users/13c53024985741bf9865d5cec76fef6d => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:22.809574 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecb596-4053-4f95-8c5a-3df73f4801a4 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:22.893215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d8323-6797-4514-ba7d-b4af669b944f None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:22.906270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:22.967765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408da516-29f0-4787-9b83-511401ac6a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:22.968419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408da516-29f0-4787-9b83-511401ac6a5d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:22.968696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408da516-29f0-4787-9b83-511401ac6a5d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:22.968981 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408da516-29f0-4787-9b83-511401ac6a5d None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:22.969662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408da516-29f0-4787-9b83-511401ac6a5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:22.969970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408da516-29f0-4787-9b83-511401ac6a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:22.971912 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408da516-29f0-4787-9b83-511401ac6a5d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:22.992242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 84/172] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:37:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:22.993190 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408da516-29f0-4787-9b83-511401ac6a5d None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:23.016480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecb596-4053-4f95-8c5a-3df73f4801a4 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:23.081783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4241940-4451-4d8f-b1df-e527e87a0351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:23.082462 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4241940-4451-4d8f-b1df-e527e87a0351 None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:23.082746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4241940-4451-4d8f-b1df-e527e87a0351 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:23.083024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4241940-4451-4d8f-b1df-e527e87a0351 None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5/users/fbf90c60a12549e7b0398fbbcc916a3b/roles/071203b5be0a4780aa2292e2be3fe13c` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:23.085841 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4241940-4451-4d8f-b1df-e527e87a0351 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee30b1fbec25473ebc077e35e79c2ad5, user_id=fbf90c60a12549e7b0398fbbcc916a3b, role_id=071203b5be0a4780aa2292e2be3fe13c)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:23.087306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4241940-4451-4d8f-b1df-e527e87a0351 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:23.139617 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:23.158221 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408da516-29f0-4787-9b83-511401ac6a5d None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:23.159355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 89/173] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:37:22 2022] PUT /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5/users/fbf90c60a12549e7b0398fbbcc916a3b/roles/071203b5be0a4780aa2292e2be3fe13c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:37:23.160222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4241940-4451-4d8f-b1df-e527e87a0351 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:23.225117 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761f0e3-c31b-4f38-83ab-bc4aa89d5375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:23.226930 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761f0e3-c31b-4f38-83ab-bc4aa89d5375 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:23.227430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761f0e3-c31b-4f38-83ab-bc4aa89d5375 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:23.228247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761f0e3-c31b-4f38-83ab-bc4aa89d5375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:23.364257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761f0e3-c31b-4f38-83ab-bc4aa89d5375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:23.366941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761f0e3-c31b-4f38-83ab-bc4aa89d5375 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:23.417204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4241940-4451-4d8f-b1df-e527e87a0351 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:23.424236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:23.479642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553ae12-7465-44d7-956d-bd74db2510ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:23.481038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553ae12-7465-44d7-956d-bd74db2510ea None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:23.481338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553ae12-7465-44d7-956d-bd74db2510ea None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:23.481608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553ae12-7465-44d7-956d-bd74db2510ea None admin] PATH_INFO: `/v3/users/13c53024985741bf9865d5cec76fef6d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:23.482906 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553ae12-7465-44d7-956d-bd74db2510ea None admin] RBAC: Authorizing `identity:get_user(user_id=13c53024985741bf9865d5cec76fef6d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:23.484439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553ae12-7465-44d7-956d-bd74db2510ea None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:23.487211 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 90/174] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:23 2022] GET /identity/v3/users/13c53024985741bf9865d5cec76fef6d => generated 275 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:23.493214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553ae12-7465-44d7-956d-bd74db2510ea None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:23.584946 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:23.604253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 85/175] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:23.611613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761f0e3-c31b-4f38-83ab-bc4aa89d5375 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:23.714563 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553ae12-7465-44d7-956d-bd74db2510ea None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:23.788167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761f0e3-c31b-4f38-83ab-bc4aa89d5375 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:23.803362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501946d-4315-4df1-b136-baabe5d3adca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:23.804032 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501946d-4315-4df1-b136-baabe5d3adca None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:23.804325 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501946d-4315-4df1-b136-baabe5d3adca None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:23.804606 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501946d-4315-4df1-b136-baabe5d3adca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:23.854394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce82b4b-7299-4fa8-b181-ae2a846261a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:23.855315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:23.856976 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce82b4b-7299-4fa8-b181-ae2a846261a7 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:23.857476 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce82b4b-7299-4fa8-b181-ae2a846261a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:23.857957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce82b4b-7299-4fa8-b181-ae2a846261a7 None admin] PATH_INFO: `/v3/projects/463db6dbd0d2422fa3de11c0d94133ed` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:23.863259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce82b4b-7299-4fa8-b181-ae2a846261a7 None admin] RBAC: Authorizing `identity:get_project(project_id=463db6dbd0d2422fa3de11c0d94133ed)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:23.870531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce82b4b-7299-4fa8-b181-ae2a846261a7 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:23.870531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 86/176] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:23 2022] GET /identity/v3/projects/463db6dbd0d2422fa3de11c0d94133ed => generated 312 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:23.878611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce82b4b-7299-4fa8-b181-ae2a846261a7 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:23.924811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501946d-4315-4df1-b136-baabe5d3adca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:23.926674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501946d-4315-4df1-b136-baabe5d3adca None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:24.008532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:24.101316 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce82b4b-7299-4fa8-b181-ae2a846261a7 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:24.140218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 91/177] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:24.147922 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501946d-4315-4df1-b136-baabe5d3adca None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:24.176552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160ce75-decb-4a2c-8101-915bfa0c2208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:24.178703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160ce75-decb-4a2c-8101-915bfa0c2208 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:24.179356 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160ce75-decb-4a2c-8101-915bfa0c2208 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:24.180615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160ce75-decb-4a2c-8101-915bfa0c2208 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:24.181403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160ce75-decb-4a2c-8101-915bfa0c2208 None admin] RBAC: Adding query filter params (role.id=bebe72a018ea47b992e9e6715060fadb, scope.project.id=463db6dbd0d2422fa3de11c0d94133ed, user.id=13c53024985741bf9865d5cec76fef6d) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:24.181812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160ce75-decb-4a2c-8101-915bfa0c2208 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:24.183250 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160ce75-decb-4a2c-8101-915bfa0c2208 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:24.194167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 87/178] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:23 2022] GET /identity/v3/role_assignments?user.id=13c53024985741bf9865d5cec76fef6d&scope.project.id=463db6dbd0d2422fa3de11c0d94133ed&role.id=bebe72a018ea47b992e9e6715060fadb => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:24.273788 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:24.325762 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501946d-4315-4df1-b136-baabe5d3adca None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:24.377883 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c51c82-6df2-4fe1-9ea9-9e3c531e37fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:24.378919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c51c82-6df2-4fe1-9ea9-9e3c531e37fd None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:24.379399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c51c82-6df2-4fe1-9ea9-9e3c531e37fd None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:24.379870 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c51c82-6df2-4fe1-9ea9-9e3c531e37fd None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:24.381270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c51c82-6df2-4fe1-9ea9-9e3c531e37fd None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:24.383122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c51c82-6df2-4fe1-9ea9-9e3c531e37fd None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:24.385081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 92/179] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:24 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:24.391851 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160ce75-decb-4a2c-8101-915bfa0c2208 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:24.515089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f89c0c-db05-48e6-9121-aa8422829a41 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:24.515785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f89c0c-db05-48e6-9121-aa8422829a41 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:24.516439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f89c0c-db05-48e6-9121-aa8422829a41 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:24.520293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 93/180] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:24.524111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e7e3f-dab3-48de-8817-65cbcb10a1c0 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:24.524645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e7e3f-dab3-48de-8817-65cbcb10a1c0 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:24.525160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e7e3f-dab3-48de-8817-65cbcb10a1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:24.532216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160ce75-decb-4a2c-8101-915bfa0c2208 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:24.561940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:24.566384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5541ac-d282-479b-8e44-61e6c39bfedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:24.567008 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5541ac-d282-479b-8e44-61e6c39bfedd None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:24.567293 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5541ac-d282-479b-8e44-61e6c39bfedd None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:24.567572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5541ac-d282-479b-8e44-61e6c39bfedd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:24.567903 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-036e7e3f-dab3-48de-8817-65cbcb10a1c0 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:24.572336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5541ac-d282-479b-8e44-61e6c39bfedd None admin] RBAC: Adding query filter params (role.id=da30366a448b4b1f902c8160690d366e, scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5, user.id=13c53024985741bf9865d5cec76fef6d) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:24.572336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5541ac-d282-479b-8e44-61e6c39bfedd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:24.572336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5541ac-d282-479b-8e44-61e6c39bfedd None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:24.580041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-036e7e3f-dab3-48de-8817-65cbcb10a1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:24.580173 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 88/181] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:24 2022] GET /identity/v3/role_assignments?user.id=13c53024985741bf9865d5cec76fef6d&scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5&role.id=da30366a448b4b1f902c8160690d366e => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:24.682968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 94/182] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:24.814429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df3384-d4bd-467e-aafa-70dd8bef45b7 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:24.815118 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df3384-d4bd-467e-aafa-70dd8bef45b7 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:24.815427 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df3384-d4bd-467e-aafa-70dd8bef45b7 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:24.816826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 89/183] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:24.822675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48f3fb-5d65-40ed-ac1c-4c1607f01a51 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:24.823171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48f3fb-5d65-40ed-ac1c-4c1607f01a51 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:24.823371 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48f3fb-5d65-40ed-ac1c-4c1607f01a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:24.843284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-dd48f3fb-5d65-40ed-ac1c-4c1607f01a51 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:24.844510 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-dd48f3fb-5d65-40ed-ac1c-4c1607f01a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:24.934259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:24.940390 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 95/184] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:25.005077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df3384-d4bd-467e-aafa-70dd8bef45b7 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:25.033276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd4a37-9bd5-4931-9881-99a8d2ed29ba None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:25.033625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd4a37-9bd5-4931-9881-99a8d2ed29ba None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:25.033838 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd4a37-9bd5-4931-9881-99a8d2ed29ba None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:25.035202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 96/185] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:37:25.040913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570b7b-c8db-4b04-a63a-2218f63f3b37 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:25.041258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570b7b-c8db-4b04-a63a-2218f63f3b37 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:25.041471 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570b7b-c8db-4b04-a63a-2218f63f3b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:25.062544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-b2570b7b-c8db-4b04-a63a-2218f63f3b37 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:25.064312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b2570b7b-c8db-4b04-a63a-2218f63f3b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:25.163863 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df3384-d4bd-467e-aafa-70dd8bef45b7 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:25.164925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 97/186] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:25.203558 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebdbfc-2391-42ad-bea6-e4afbdc5c04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:25.205396 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebdbfc-2391-42ad-bea6-e4afbdc5c04c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:25.205850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebdbfc-2391-42ad-bea6-e4afbdc5c04c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:25.206265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebdbfc-2391-42ad-bea6-e4afbdc5c04c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:25.218394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ebdbfc-2391-42ad-bea6-e4afbdc5c04c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-36ebdbfc-2391-42ad-bea6-e4afbdc5c04c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:25.226072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:25.227489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:25.228499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:25.228499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:25.228499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:25.228499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:25.228499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:25.228499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:25.228499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:25.228499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:25.228499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:25.228499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:25.228499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:25.228499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:25.230458 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 90/187] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:37:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:25.237567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570b7b-c8db-4b04-a63a-2218f63f3b37 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:25.247404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebdbfc-2391-42ad-bea6-e4afbdc5c04c None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:25.316168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:25.369829 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570b7b-c8db-4b04-a63a-2218f63f3b37 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:25.384673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebdbfc-2391-42ad-bea6-e4afbdc5c04c None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:25.400934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:25.407059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4176b0-8a76-4d75-bdfb-295bcda11dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:25.408311 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4176b0-8a76-4d75-bdfb-295bcda11dff None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:25.408614 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4176b0-8a76-4d75-bdfb-295bcda11dff None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:25.408873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4176b0-8a76-4d75-bdfb-295bcda11dff None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:25.409561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4176b0-8a76-4d75-bdfb-295bcda11dff None admin] RBAC: Adding query filter params (name=admin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:25.409899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4176b0-8a76-4d75-bdfb-295bcda11dff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:25.411275 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4176b0-8a76-4d75-bdfb-295bcda11dff None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:25.424202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 98/188] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:25.426636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4176b0-8a76-4d75-bdfb-295bcda11dff None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:25.447536 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a67cc-bde1-4a94-b01a-b562ccc7da50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:25.448496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a67cc-bde1-4a94-b01a-b562ccc7da50 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:25.448793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a67cc-bde1-4a94-b01a-b562ccc7da50 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:25.449075 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a67cc-bde1-4a94-b01a-b562ccc7da50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:25.450392 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a67cc-bde1-4a94-b01a-b562ccc7da50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:25.452271 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a67cc-bde1-4a94-b01a-b562ccc7da50 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:25.455299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 91/189] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:37:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:25.461155 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a67cc-bde1-4a94-b01a-b562ccc7da50 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:25.554592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4176b0-8a76-4d75-bdfb-295bcda11dff None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:25.583833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a67cc-bde1-4a94-b01a-b562ccc7da50 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:25.599620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:25.600641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf20b62-8643-4279-9646-98d22dfbe637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:25.601284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf20b62-8643-4279-9646-98d22dfbe637 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:25.601818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf20b62-8643-4279-9646-98d22dfbe637 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:25.602090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf20b62-8643-4279-9646-98d22dfbe637 None admin] PATH_INFO: `/v3/users/b2f36a9620034923bcac3a1563b31aaf` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:25.621389 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf20b62-8643-4279-9646-98d22dfbe637 None admin] RBAC: Authorizing `identity:get_user(user_id=b2f36a9620034923bcac3a1563b31aaf)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:25.622913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf20b62-8643-4279-9646-98d22dfbe637 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:25.624650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 99/190] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:25 2022] GET /identity/v3/users/b2f36a9620034923bcac3a1563b31aaf => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:25.625432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf20b62-8643-4279-9646-98d22dfbe637 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:25.630895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7caa867-3bf0-4f9d-9a15-1968406a2973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:25.631524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caa867-3bf0-4f9d-9a15-1968406a2973 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:25.631888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caa867-3bf0-4f9d-9a15-1968406a2973 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:25.632604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caa867-3bf0-4f9d-9a15-1968406a2973 None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:25.633558 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7caa867-3bf0-4f9d-9a15-1968406a2973 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:25.635364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7caa867-3bf0-4f9d-9a15-1968406a2973 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:25.688084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:25.742838 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 92/191] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:37:25 2022] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:37:25.743046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf20b62-8643-4279-9646-98d22dfbe637 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:25.752657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7caa867-3bf0-4f9d-9a15-1968406a2973 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:25.793888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40aee1-7a85-4a44-a324-18f6af45fa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:25.794976 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40aee1-7a85-4a44-a324-18f6af45fa85 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:25.795535 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40aee1-7a85-4a44-a324-18f6af45fa85 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:25.796011 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40aee1-7a85-4a44-a324-18f6af45fa85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:25.811397 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40aee1-7a85-4a44-a324-18f6af45fa85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-7d40aee1-7a85-4a44-a324-18f6af45fa85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:25.817695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:25.818748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:25.819582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:25.819582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:25.819582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:25.819582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:25.819582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:25.819582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:25.819582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:25.819582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:25.819582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:25.819582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:25.819582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:25.819582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:25.822314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 100/192] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:37:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:25.831946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40aee1-7a85-4a44-a324-18f6af45fa85 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:25.901698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7caa867-3bf0-4f9d-9a15-1968406a2973 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:25.947523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ea8de-847d-407c-8926-f009feffb032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:25.949006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ea8de-847d-407c-8926-f009feffb032 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:25.949773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ea8de-847d-407c-8926-f009feffb032 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:25.950561 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ea8de-847d-407c-8926-f009feffb032 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:25.999512 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40aee1-7a85-4a44-a324-18f6af45fa85 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:26.000924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:26.011878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:26.045848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ea8de-847d-407c-8926-f009feffb032 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:26.047345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ea8de-847d-407c-8926-f009feffb032 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:26.052305 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5b1d4-4b15-46cb-a81d-c5719dd78bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:26.052933 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5b1d4-4b15-46cb-a81d-c5719dd78bc4 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:26.053216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5b1d4-4b15-46cb-a81d-c5719dd78bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:26.053488 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5b1d4-4b15-46cb-a81d-c5719dd78bc4 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:26.054226 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5b1d4-4b15-46cb-a81d-c5719dd78bc4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:26.054566 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5b1d4-4b15-46cb-a81d-c5719dd78bc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:26.056011 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5b1d4-4b15-46cb-a81d-c5719dd78bc4 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:26.066844 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 101/193] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:37:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:26.068122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8e226-5579-4246-b510-7da220b4e545 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:26.068463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8e226-5579-4246-b510-7da220b4e545 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:26.068738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8e226-5579-4246-b510-7da220b4e545 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:26.069987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 102/194] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:26.075073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8e226-5579-4246-b510-7da220b4e545 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:26.200991 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 93/195] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:26.203177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d51e7-1c58-476d-9227-ef486ef99400 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:26.203468 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d51e7-1c58-476d-9227-ef486ef99400 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:26.203746 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d51e7-1c58-476d-9227-ef486ef99400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:26.213920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8e226-5579-4246-b510-7da220b4e545 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:26.225604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-508d51e7-1c58-476d-9227-ef486ef99400 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:26.227600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-508d51e7-1c58-476d-9227-ef486ef99400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:26.258204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f5fda-b9c1-4443-9369-aa8c27978a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:26.259017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f5fda-b9c1-4443-9369-aa8c27978a20 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:26.259298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f5fda-b9c1-4443-9369-aa8c27978a20 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:26.259905 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f5fda-b9c1-4443-9369-aa8c27978a20 None admin] PATH_INFO: `/v3/users/b2f36a9620034923bcac3a1563b31aaf` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:26.261434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f5fda-b9c1-4443-9369-aa8c27978a20 None admin] RBAC: Authorizing `identity:get_user(user_id=b2f36a9620034923bcac3a1563b31aaf)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:26.263513 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f5fda-b9c1-4443-9369-aa8c27978a20 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:26.265482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 103/196] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:26 2022] GET /identity/v3/users/b2f36a9620034923bcac3a1563b31aaf => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:26.266299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f5fda-b9c1-4443-9369-aa8c27978a20 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:26.314433 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:26.319964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:26.328229 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 94/197] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:26.328229 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d51e7-1c58-476d-9227-ef486ef99400 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:26.450381 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f5fda-b9c1-4443-9369-aa8c27978a20 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:26.486944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d51e7-1c58-476d-9227-ef486ef99400 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:26.517533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb0e46-8d3c-4fcf-8934-f1a1db482155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:26.518199 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb0e46-8d3c-4fcf-8934-f1a1db482155 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:26.518590 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb0e46-8d3c-4fcf-8934-f1a1db482155 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:26.519063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb0e46-8d3c-4fcf-8934-f1a1db482155 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:26.521553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb0e46-8d3c-4fcf-8934-f1a1db482155 None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:26.523135 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb0e46-8d3c-4fcf-8934-f1a1db482155 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:26.524855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 104/198] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:26 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:26.531284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb0e46-8d3c-4fcf-8934-f1a1db482155 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:26.545372 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a44c3-b3f0-4676-8af4-3d8190e20b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:26.546002 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a44c3-b3f0-4676-8af4-3d8190e20b49 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:26.546283 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a44c3-b3f0-4676-8af4-3d8190e20b49 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:26.546560 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a44c3-b3f0-4676-8af4-3d8190e20b49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:26.674451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:26.682881 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a44c3-b3f0-4676-8af4-3d8190e20b49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:26.684548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a44c3-b3f0-4676-8af4-3d8190e20b49 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:26.724403 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb0e46-8d3c-4fcf-8934-f1a1db482155 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:26.735277 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:26.765423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22c933-9977-48d0-b626-2d63b63e2d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:26.767576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22c933-9977-48d0-b626-2d63b63e2d55 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:26.768949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22c933-9977-48d0-b626-2d63b63e2d55 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:26.769335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22c933-9977-48d0-b626-2d63b63e2d55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:26.770197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22c933-9977-48d0-b626-2d63b63e2d55 None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d, user.id=b2f36a9620034923bcac3a1563b31aaf) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:26.770640 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22c933-9977-48d0-b626-2d63b63e2d55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:26.772232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22c933-9977-48d0-b626-2d63b63e2d55 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:26.779246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 105/199] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:26 2022] GET /identity/v3/role_assignments?user.id=b2f36a9620034923bcac3a1563b31aaf&scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:26.780165 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22c933-9977-48d0-b626-2d63b63e2d55 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:26.853132 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 95/200] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:26.858643 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a44c3-b3f0-4676-8af4-3d8190e20b49 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:26.991262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22c933-9977-48d0-b626-2d63b63e2d55 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:27.025523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:27.030133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a44c3-b3f0-4676-8af4-3d8190e20b49 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:27.050056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33368540-e8d4-419b-aef8-83c2787f63bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:27.050793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33368540-e8d4-419b-aef8-83c2787f63bb None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:27.051080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33368540-e8d4-419b-aef8-83c2787f63bb None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:27.051356 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33368540-e8d4-419b-aef8-83c2787f63bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:27.069905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f938844-7303-4292-86a0-c34760144240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:27.070554 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f938844-7303-4292-86a0-c34760144240 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:27.070831 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f938844-7303-4292-86a0-c34760144240 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:27.071101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f938844-7303-4292-86a0-c34760144240 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:27.072706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f938844-7303-4292-86a0-c34760144240 None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:27.075789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f938844-7303-4292-86a0-c34760144240 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:27.078108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 96/201] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:26 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:27.084553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33368540-e8d4-419b-aef8-83c2787f63bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:27.084896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f938844-7303-4292-86a0-c34760144240 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-33368540-e8d4-419b-aef8-83c2787f63bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:27.090204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:27.092741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:27.094661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:27.094661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:27.094661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:27.094661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:27.094661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:27.094661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:27.094661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:27.094661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:27.094661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:27.094661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:27.094661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:27.094661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:27.094661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 106/202] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:27.110619 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33368540-e8d4-419b-aef8-83c2787f63bb None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:27.178427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:27.234140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f938844-7303-4292-86a0-c34760144240 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:27.299399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33368540-e8d4-419b-aef8-83c2787f63bb None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:27.336926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c94ea5-e4ed-4d8a-a5fc-b9eeb5ff895e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:27.337917 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c94ea5-e4ed-4d8a-a5fc-b9eeb5ff895e None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:27.338422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c94ea5-e4ed-4d8a-a5fc-b9eeb5ff895e None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:27.338888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c94ea5-e4ed-4d8a-a5fc-b9eeb5ff895e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:27.339839 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c94ea5-e4ed-4d8a-a5fc-b9eeb5ff895e None admin] RBAC: Adding query filter params (role.id=da30366a448b4b1f902c8160690d366e, scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d, user.id=b2f36a9620034923bcac3a1563b31aaf) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:27.340368 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c94ea5-e4ed-4d8a-a5fc-b9eeb5ff895e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:27.342032 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c94ea5-e4ed-4d8a-a5fc-b9eeb5ff895e None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:27.354897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062d1ba-2e04-4f9c-9be0-ff8c3c2f4156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:27.355899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062d1ba-2e04-4f9c-9be0-ff8c3c2f4156 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:27.356442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062d1ba-2e04-4f9c-9be0-ff8c3c2f4156 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:27.356666 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 97/203] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:27 2022] GET /identity/v3/role_assignments?user.id=b2f36a9620034923bcac3a1563b31aaf&scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d&role.id=da30366a448b4b1f902c8160690d366e => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:27.357150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062d1ba-2e04-4f9c-9be0-ff8c3c2f4156 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:27.358141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062d1ba-2e04-4f9c-9be0-ff8c3c2f4156 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:27.358660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062d1ba-2e04-4f9c-9be0-ff8c3c2f4156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:27.360467 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062d1ba-2e04-4f9c-9be0-ff8c3c2f4156 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:27.376559 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 107/204] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:27.382229 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c94ea5-e4ed-4d8a-a5fc-b9eeb5ff895e None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:27.445241 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:27.566188 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c94ea5-e4ed-4d8a-a5fc-b9eeb5ff895e None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:27.625468 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0d4d2-7b98-4fc8-85cb-a61d6dfc5e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:27.626736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0d4d2-7b98-4fc8-85cb-a61d6dfc5e05 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:27.627332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0d4d2-7b98-4fc8-85cb-a61d6dfc5e05 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:27.627824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0d4d2-7b98-4fc8-85cb-a61d6dfc5e05 None admin] PATH_INFO: `/v3/users/fbf90c60a12549e7b0398fbbcc916a3b` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:27.632280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0d4d2-7b98-4fc8-85cb-a61d6dfc5e05 None admin] RBAC: Authorizing `identity:get_user(user_id=fbf90c60a12549e7b0398fbbcc916a3b)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:27.634056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0d4d2-7b98-4fc8-85cb-a61d6dfc5e05 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:27.635937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 98/205] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:27 2022] GET /identity/v3/users/fbf90c60a12549e7b0398fbbcc916a3b => generated 289 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:27.642467 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062d1ba-2e04-4f9c-9be0-ff8c3c2f4156 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:27.776945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:27.781455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062d1ba-2e04-4f9c-9be0-ff8c3c2f4156 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:27.822347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d138a9-73c0-4b6a-962f-25c632c7c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:27.823386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d138a9-73c0-4b6a-962f-25c632c7c86e None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:27.823879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d138a9-73c0-4b6a-962f-25c632c7c86e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:27.824500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d138a9-73c0-4b6a-962f-25c632c7c86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:27.927819 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d138a9-73c0-4b6a-962f-25c632c7c86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:27.929687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d138a9-73c0-4b6a-962f-25c632c7c86e None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:28.047717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:28.057014 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 108/206] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:28.062961 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0d4d2-7b98-4fc8-85cb-a61d6dfc5e05 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:28.132690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f57a4-4680-471c-8678-ecd77ecfd91f None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:28.133242 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f57a4-4680-471c-8678-ecd77ecfd91f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:28.133693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f57a4-4680-471c-8678-ecd77ecfd91f None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:28.135326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 109/207] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:37:28.143414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab029d01-d8b0-4378-ab8e-448e5ca4fbda None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:28.144022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab029d01-d8b0-4378-ab8e-448e5ca4fbda None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:28.144491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab029d01-d8b0-4378-ab8e-448e5ca4fbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:28.175246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-ab029d01-d8b0-4378-ab8e-448e5ca4fbda None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:28.177816 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ab029d01-d8b0-4378-ab8e-448e5ca4fbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:28.231809 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:28.238362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0d4d2-7b98-4fc8-85cb-a61d6dfc5e05 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:28.311569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228952eb-0a93-4c9f-b99d-56496c009dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:28.312712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228952eb-0a93-4c9f-b99d-56496c009dbe None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:28.314757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228952eb-0a93-4c9f-b99d-56496c009dbe None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:28.315265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228952eb-0a93-4c9f-b99d-56496c009dbe None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:28.316989 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228952eb-0a93-4c9f-b99d-56496c009dbe None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:28.318943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 110/208] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 29 22:37:28.320621 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228952eb-0a93-4c9f-b99d-56496c009dbe None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:28.322471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 99/209] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:28 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:28.331386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab029d01-d8b0-4378-ab8e-448e5ca4fbda None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:28.512114 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab029d01-d8b0-4378-ab8e-448e5ca4fbda None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:28.543602 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:28.559239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef79c1-62cf-430f-b89e-2d1fec3a68a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:28.559860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef79c1-62cf-430f-b89e-2d1fec3a68a2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:28.560142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef79c1-62cf-430f-b89e-2d1fec3a68a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:28.560513 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef79c1-62cf-430f-b89e-2d1fec3a68a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:28.561263 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef79c1-62cf-430f-b89e-2d1fec3a68a2 None admin] RBAC: Adding query filter params (role.id=071203b5be0a4780aa2292e2be3fe13c, scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5, user.id=fbf90c60a12549e7b0398fbbcc916a3b) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:28.561609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef79c1-62cf-430f-b89e-2d1fec3a68a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:28.563140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef79c1-62cf-430f-b89e-2d1fec3a68a2 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:28.573162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 111/210] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:28 2022] GET /identity/v3/role_assignments?user.id=fbf90c60a12549e7b0398fbbcc916a3b&scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5&role.id=071203b5be0a4780aa2292e2be3fe13c => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:28.767806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d125be5-8bfe-4fa7-a3b5-9b042bea2114 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:28.768420 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d125be5-8bfe-4fa7-a3b5-9b042bea2114 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:28.768936 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d125be5-8bfe-4fa7-a3b5-9b042bea2114 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:28.771789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 100/211] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:28.781007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0e1a2-240b-4176-b0d7-f328987ce028 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:28.781519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0e1a2-240b-4176-b0d7-f328987ce028 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:28.782022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0e1a2-240b-4176-b0d7-f328987ce028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:28.814959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-dba0e1a2-240b-4176-b0d7-f328987ce028 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:28.817123 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-dba0e1a2-240b-4176-b0d7-f328987ce028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:28.913363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d125be5-8bfe-4fa7-a3b5-9b042bea2114 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:28.953433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 112/212] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:29.139453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d125be5-8bfe-4fa7-a3b5-9b042bea2114 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:29.215078 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e04a7-c660-4889-83e3-1d52a73c7b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:29.216120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e04a7-c660-4889-83e3-1d52a73c7b67 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:29.216654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e04a7-c660-4889-83e3-1d52a73c7b67 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:29.217123 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e04a7-c660-4889-83e3-1d52a73c7b67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:29.237872 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e04a7-c660-4889-83e3-1d52a73c7b67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:29.238197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94eabe-39d5-4af6-b9ed-72dae6efd441 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:29.238617 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94eabe-39d5-4af6-b9ed-72dae6efd441 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:29.238772 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94eabe-39d5-4af6-b9ed-72dae6efd441 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:29.240297 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 113/213] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-fa3e04a7-c660-4889-83e3-1d52a73c7b67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:29.246539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:29.247728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:29.248588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:29.248588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:29.248588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:29.248588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:29.248588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:29.248588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:29.248588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:29.248588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:29.248588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:29.248588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:29.248588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:29.248588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:29.249189 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 101/214] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:37:29.249551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638b6ef-5c2b-4428-b1a6-dee740e40d52 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:29.249868 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638b6ef-5c2b-4428-b1a6-dee740e40d52 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:29.250104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638b6ef-5c2b-4428-b1a6-dee740e40d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:29.261931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e04a7-c660-4889-83e3-1d52a73c7b67 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:29.271039 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f638b6ef-5c2b-4428-b1a6-dee740e40d52 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:29.272278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f638b6ef-5c2b-4428-b1a6-dee740e40d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:29.312314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:29.344589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 114/215] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:29.346026 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638b6ef-5c2b-4428-b1a6-dee740e40d52 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:29.406663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:29.459306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638b6ef-5c2b-4428-b1a6-dee740e40d52 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:29.467441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e04a7-c660-4889-83e3-1d52a73c7b67 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:29.498907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6201a4-f3dd-4a1a-b53d-384288397a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:29.499935 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6201a4-f3dd-4a1a-b53d-384288397a36 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:29.500432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6201a4-f3dd-4a1a-b53d-384288397a36 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:29.501271 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6201a4-f3dd-4a1a-b53d-384288397a36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:29.502758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6201a4-f3dd-4a1a-b53d-384288397a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:29.504498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6201a4-f3dd-4a1a-b53d-384288397a36 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:29.506392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 115/216] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:37:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:29.512275 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6201a4-f3dd-4a1a-b53d-384288397a36 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:29.515764 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b72817-ef3e-4eaa-a164-833277fbd8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:29.516763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b72817-ef3e-4eaa-a164-833277fbd8e4 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:29.517056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b72817-ef3e-4eaa-a164-833277fbd8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:29.517388 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b72817-ef3e-4eaa-a164-833277fbd8e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:29.518364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b72817-ef3e-4eaa-a164-833277fbd8e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:29.518671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b72817-ef3e-4eaa-a164-833277fbd8e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:29.520489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b72817-ef3e-4eaa-a164-833277fbd8e4 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:29.535516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 102/217] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:29.544061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b72817-ef3e-4eaa-a164-833277fbd8e4 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:29.625709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6201a4-f3dd-4a1a-b53d-384288397a36 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:29.646163 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:29.664873 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:29.671078 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4149de8-0869-4840-a26e-d13c5b3a9f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:29.671709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4149de8-0869-4840-a26e-d13c5b3a9f8c None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:29.672085 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4149de8-0869-4840-a26e-d13c5b3a9f8c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:29.677746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4149de8-0869-4840-a26e-d13c5b3a9f8c None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:29.679211 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4149de8-0869-4840-a26e-d13c5b3a9f8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:29.681184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b72817-ef3e-4eaa-a164-833277fbd8e4 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:29.681359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4149de8-0869-4840-a26e-d13c5b3a9f8c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:29.722373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f53bf5-262e-4d5d-b7ca-1284ad8b244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:29.723136 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f53bf5-262e-4d5d-b7ca-1284ad8b244b None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:29.723399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f53bf5-262e-4d5d-b7ca-1284ad8b244b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:29.723671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f53bf5-262e-4d5d-b7ca-1284ad8b244b None admin] PATH_INFO: `/v3/users/fa25d1c0597f4cd180d99e502feafe56` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:29.742622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f53bf5-262e-4d5d-b7ca-1284ad8b244b None admin] RBAC: Authorizing `identity:get_user(user_id=fa25d1c0597f4cd180d99e502feafe56)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:29.744143 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f53bf5-262e-4d5d-b7ca-1284ad8b244b None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:29.745890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 103/218] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:29 2022] GET /identity/v3/users/fa25d1c0597f4cd180d99e502feafe56 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:29.750769 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f53bf5-262e-4d5d-b7ca-1284ad8b244b None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:29.793509 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 116/219] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:37:29 2022] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:37:29.794437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4149de8-0869-4840-a26e-d13c5b3a9f8c None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:29.898450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f53bf5-262e-4d5d-b7ca-1284ad8b244b None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:29.944083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4149de8-0869-4840-a26e-d13c5b3a9f8c None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:29.952678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc6d80-e6a7-490a-a462-27f2fbc97606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:29.953015 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc6d80-e6a7-490a-a462-27f2fbc97606 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:29.953247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc6d80-e6a7-490a-a462-27f2fbc97606 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:29.953514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc6d80-e6a7-490a-a462-27f2fbc97606 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:29.967354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc6d80-e6a7-490a-a462-27f2fbc97606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-abdc6d80-e6a7-490a-a462-27f2fbc97606 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:29.973047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:29.974001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:29.974787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:29.974787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:29.974787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:29.974787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:29.974787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:29.974787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:29.974787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:29.974787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:29.974787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:29.974787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:29.974787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:29.974787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:29.974787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 104/220] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:37:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:29.976026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286a096-1608-4136-8331-52e795c57c81 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:29.976643 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286a096-1608-4136-8331-52e795c57c81 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:29.976923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286a096-1608-4136-8331-52e795c57c81 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:29.978207 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 105/221] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:29.983214 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286a096-1608-4136-8331-52e795c57c81 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:29.994823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:29.995028 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dd9a2-ae11-4d47-a7e3-101d1f1a1618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:29.995495 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dd9a2-ae11-4d47-a7e3-101d1f1a1618 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:29.995996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dd9a2-ae11-4d47-a7e3-101d1f1a1618 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:29.996131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dd9a2-ae11-4d47-a7e3-101d1f1a1618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:30.057884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:30.096037 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dd9a2-ae11-4d47-a7e3-101d1f1a1618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:30.098248 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dd9a2-ae11-4d47-a7e3-101d1f1a1618 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:30.119066 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286a096-1608-4136-8331-52e795c57c81 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:30.165230 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aed3c3-bd7c-4189-910f-74bc7a0ca9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:30.165854 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aed3c3-bd7c-4189-910f-74bc7a0ca9f9 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:30.166131 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aed3c3-bd7c-4189-910f-74bc7a0ca9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:30.166399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aed3c3-bd7c-4189-910f-74bc7a0ca9f9 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:30.167068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aed3c3-bd7c-4189-910f-74bc7a0ca9f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:30.167368 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aed3c3-bd7c-4189-910f-74bc7a0ca9f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:30.168820 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aed3c3-bd7c-4189-910f-74bc7a0ca9f9 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:30.181503 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 106/222] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:30.182958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac2bc4-58b9-45fc-bad4-25c9416d112f None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:30.183241 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac2bc4-58b9-45fc-bad4-25c9416d112f None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:30.183510 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac2bc4-58b9-45fc-bad4-25c9416d112f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:30.209662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-37ac2bc4-58b9-45fc-bad4-25c9416d112f None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:30.211654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-37ac2bc4-58b9-45fc-bad4-25c9416d112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:30.228334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 117/223] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:30.232595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dd9a2-ae11-4d47-a7e3-101d1f1a1618 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:30.295191 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:30.302246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 107/224] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:30.308267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac2bc4-58b9-45fc-bad4-25c9416d112f None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:30.329650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:30.381758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dd9a2-ae11-4d47-a7e3-101d1f1a1618 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:30.426543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac2bc4-58b9-45fc-bad4-25c9416d112f None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:30.470222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1d93f-16ef-4a1f-8838-e8f2440b4971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:30.470222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1d93f-16ef-4a1f-8838-e8f2440b4971 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:30.470222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1d93f-16ef-4a1f-8838-e8f2440b4971 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:30.470222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1d93f-16ef-4a1f-8838-e8f2440b4971 None admin] PATH_INFO: `/v3/users/b2f36a9620034923bcac3a1563b31aaf` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:30.470719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a427dd9-9604-4617-8822-eb59225b9757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:30.470719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a427dd9-9604-4617-8822-eb59225b9757 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:30.470719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a427dd9-9604-4617-8822-eb59225b9757 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:30.470719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a427dd9-9604-4617-8822-eb59225b9757 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:30.472419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a427dd9-9604-4617-8822-eb59225b9757 None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:30.472549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1d93f-16ef-4a1f-8838-e8f2440b4971 None admin] RBAC: Authorizing `identity:get_user(user_id=b2f36a9620034923bcac3a1563b31aaf)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:30.473978 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1d93f-16ef-4a1f-8838-e8f2440b4971 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:30.474715 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a427dd9-9604-4617-8822-eb59225b9757 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:30.475944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 118/225] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:30 2022] GET /identity/v3/users/b2f36a9620034923bcac3a1563b31aaf => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:30.477226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 108/226] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:30 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:30.481394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1d93f-16ef-4a1f-8838-e8f2440b4971 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:30.483428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a427dd9-9604-4617-8822-eb59225b9757 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:30.592638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:30.631903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a427dd9-9604-4617-8822-eb59225b9757 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:30.667982 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96608937-0e37-42cc-b453-517e7ddb98a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:30.669037 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96608937-0e37-42cc-b453-517e7ddb98a9 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:30.669531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96608937-0e37-42cc-b453-517e7ddb98a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:30.669995 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96608937-0e37-42cc-b453-517e7ddb98a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:30.670925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96608937-0e37-42cc-b453-517e7ddb98a9 None admin] RBAC: Adding query filter params (role.id=bebe72a018ea47b992e9e6715060fadb, scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d, user.id=fa25d1c0597f4cd180d99e502feafe56) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:30.671429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96608937-0e37-42cc-b453-517e7ddb98a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:30.673703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96608937-0e37-42cc-b453-517e7ddb98a9 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:30.680039 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 109/227] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:30 2022] GET /identity/v3/role_assignments?user.id=fa25d1c0597f4cd180d99e502feafe56&scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d&role.id=bebe72a018ea47b992e9e6715060fadb => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:30.691186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1d93f-16ef-4a1f-8838-e8f2440b4971 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:30.712903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96608937-0e37-42cc-b453-517e7ddb98a9 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:30.785339 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d47aa-4d63-4905-9cc0-e6d1e874cfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:30.786227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d47aa-4d63-4905-9cc0-e6d1e874cfd4 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:30.786508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d47aa-4d63-4905-9cc0-e6d1e874cfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:30.787084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d47aa-4d63-4905-9cc0-e6d1e874cfd4 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:30.788025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d47aa-4d63-4905-9cc0-e6d1e874cfd4 None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:30.789609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d47aa-4d63-4905-9cc0-e6d1e874cfd4 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:30.791407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 119/228] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:30 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:30.797513 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d47aa-4d63-4905-9cc0-e6d1e874cfd4 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:30.827058 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:30.853133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96608937-0e37-42cc-b453-517e7ddb98a9 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:30.891138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:30.899735 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80468564-8312-42c1-829f-e62711c185fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:30.900830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80468564-8312-42c1-829f-e62711c185fb None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:30.901946 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80468564-8312-42c1-829f-e62711c185fb None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:30.902395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80468564-8312-42c1-829f-e62711c185fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:30.916579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80468564-8312-42c1-829f-e62711c185fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-80468564-8312-42c1-829f-e62711c185fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:30.923958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:30.924964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:30.925745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:30.925745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:30.925745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:30.925745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:30.925745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:30.925745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:30.925745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:30.925745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:30.925745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:30.925745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:30.925745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:30.925745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:30.930119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 110/229] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:37:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:37:30.934261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80468564-8312-42c1-829f-e62711c185fb None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:31.071072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80468564-8312-42c1-829f-e62711c185fb None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:31.073833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d47aa-4d63-4905-9cc0-e6d1e874cfd4 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:31.115449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2efb6-812c-4588-8f5a-2719702c9296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:31.116948 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2efb6-812c-4588-8f5a-2719702c9296 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:31.117432 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2efb6-812c-4588-8f5a-2719702c9296 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:31.117896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2efb6-812c-4588-8f5a-2719702c9296 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:31.118786 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2efb6-812c-4588-8f5a-2719702c9296 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:31.119385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2efb6-812c-4588-8f5a-2719702c9296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:31.121183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2efb6-812c-4588-8f5a-2719702c9296 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:31.133111 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 111/230] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:37:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:31.143590 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2efb6-812c-4588-8f5a-2719702c9296 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:31.155649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96914fb-5eaa-4076-89d0-4b8c57c10d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:31.156432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96914fb-5eaa-4076-89d0-4b8c57c10d0a None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:31.156641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96914fb-5eaa-4076-89d0-4b8c57c10d0a None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:31.156913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96914fb-5eaa-4076-89d0-4b8c57c10d0a None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d/users/b2f36a9620034923bcac3a1563b31aaf/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:31.160104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96914fb-5eaa-4076-89d0-4b8c57c10d0a None admin] RBAC: Authorizing `identity:create_grant(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d, user_id=b2f36a9620034923bcac3a1563b31aaf, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:31.161602 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96914fb-5eaa-4076-89d0-4b8c57c10d0a None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:31.206470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:31.262984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 120/231] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:37:30 2022] PUT /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d/users/b2f36a9620034923bcac3a1563b31aaf/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:37:31.264110 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2efb6-812c-4588-8f5a-2719702c9296 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:31.305571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85498f42-2a15-4db5-8608-9a0abfa90a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:31.307062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85498f42-2a15-4db5-8608-9a0abfa90a51 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:31.307700 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85498f42-2a15-4db5-8608-9a0abfa90a51 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:31.308250 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85498f42-2a15-4db5-8608-9a0abfa90a51 None admin] PATH_INFO: `/v3/users/b2f36a9620034923bcac3a1563b31aaf` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:31.309726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85498f42-2a15-4db5-8608-9a0abfa90a51 None admin] RBAC: Authorizing `identity:get_user(user_id=b2f36a9620034923bcac3a1563b31aaf)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:31.311445 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85498f42-2a15-4db5-8608-9a0abfa90a51 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:31.313926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 112/232] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:31 2022] GET /identity/v3/users/b2f36a9620034923bcac3a1563b31aaf => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:31.320323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96914fb-5eaa-4076-89d0-4b8c57c10d0a None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:31.447679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:31.487555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96914fb-5eaa-4076-89d0-4b8c57c10d0a None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:31.525003 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ec3d2-a247-40bc-b3cd-ee3966507278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:31.525641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ec3d2-a247-40bc-b3cd-ee3966507278 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:31.525925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ec3d2-a247-40bc-b3cd-ee3966507278 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:31.526289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ec3d2-a247-40bc-b3cd-ee3966507278 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:31.527481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ec3d2-a247-40bc-b3cd-ee3966507278 None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:31.528968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ec3d2-a247-40bc-b3cd-ee3966507278 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:31.530836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 121/233] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:31 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:31.536971 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85498f42-2a15-4db5-8608-9a0abfa90a51 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:31.645164 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85498f42-2a15-4db5-8608-9a0abfa90a51 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:31.669394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:31.687421 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79575e-5c74-4bf7-a85b-60e238c6625d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:31.687421 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79575e-5c74-4bf7-a85b-60e238c6625d None admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:31.687421 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79575e-5c74-4bf7-a85b-60e238c6625d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:31.687421 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79575e-5c74-4bf7-a85b-60e238c6625d None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d/users/b2f36a9620034923bcac3a1563b31aaf/roles/da30366a448b4b1f902c8160690d366e` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:31.687817 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79575e-5c74-4bf7-a85b-60e238c6625d None admin] RBAC: Authorizing `identity:create_grant(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d, user_id=b2f36a9620034923bcac3a1563b31aaf, role_id=da30366a448b4b1f902c8160690d366e)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:31.687817 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79575e-5c74-4bf7-a85b-60e238c6625d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:31.793046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 113/234] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:37:31 2022] PUT /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d/users/b2f36a9620034923bcac3a1563b31aaf/roles/da30366a448b4b1f902c8160690d366e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:37:32.229437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5a504-15bb-436a-84e6-e58a2b61ac3f None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:32.229820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5a504-15bb-436a-84e6-e58a2b61ac3f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:32.230055 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5a504-15bb-436a-84e6-e58a2b61ac3f None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:32.231650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 122/235] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:32.238347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd9b8-54f5-4575-a6ac-410aa1d61292 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:32.238634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd9b8-54f5-4575-a6ac-410aa1d61292 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:32.238913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd9b8-54f5-4575-a6ac-410aa1d61292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:32.259381 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-ef2cd9b8-54f5-4575-a6ac-410aa1d61292 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:32.260621 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-ef2cd9b8-54f5-4575-a6ac-410aa1d61292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:32.350608 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 114/236] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:32.379858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aaee5-1465-498f-bc9b-4c679494f816 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:32.380169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aaee5-1465-498f-bc9b-4c679494f816 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:32.380435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aaee5-1465-498f-bc9b-4c679494f816 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:32.382113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 123/237] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:32.390542 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc0fdc-d63f-4fc6-8afd-569a5787422c None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:32.390847 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc0fdc-d63f-4fc6-8afd-569a5787422c None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:32.391166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc0fdc-d63f-4fc6-8afd-569a5787422c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:32.417007 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-b1cc0fdc-d63f-4fc6-8afd-569a5787422c None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:32.418301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b1cc0fdc-d63f-4fc6-8afd-569a5787422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:32.520566 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 115/238] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:32.720123 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aaee5-1465-498f-bc9b-4c679494f816 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:32.875888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aaee5-1465-498f-bc9b-4c679494f816 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:32.918711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc0fdc-d63f-4fc6-8afd-569a5787422c None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:32.949098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722fd6b-1af7-4924-9e2f-d4a2ae425f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:32.950197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722fd6b-1af7-4924-9e2f-d4a2ae425f72 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:32.950697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722fd6b-1af7-4924-9e2f-d4a2ae425f72 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:32.951187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722fd6b-1af7-4924-9e2f-d4a2ae425f72 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:32.962259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:32.999113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722fd6b-1af7-4924-9e2f-d4a2ae425f72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-d722fd6b-1af7-4924-9e2f-d4a2ae425f72 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:33.013951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:33.016800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:33.017774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:33.017774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:33.017774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:33.017774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:33.017774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:33.017774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:33.017774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:33.017774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:33.017774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:33.017774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:33.017774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:33.017774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:33.017774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 124/239] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:33.021896 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722fd6b-1af7-4924-9e2f-d4a2ae425f72 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:33.044704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:33.116382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc0fdc-d63f-4fc6-8afd-569a5787422c None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:33.156763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27310364-ec4f-4937-87ee-9898cfb9cd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:33.158292 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27310364-ec4f-4937-87ee-9898cfb9cd49 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:33.158576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27310364-ec4f-4937-87ee-9898cfb9cd49 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:33.158851 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27310364-ec4f-4937-87ee-9898cfb9cd49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:33.160778 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27310364-ec4f-4937-87ee-9898cfb9cd49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:33.162960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27310364-ec4f-4937-87ee-9898cfb9cd49 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:33.165646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 116/240] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:37:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:33.167302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6bb9e-169a-43c7-ad90-87b86ef7bd7d None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:33.167585 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6bb9e-169a-43c7-ad90-87b86ef7bd7d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:33.167861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6bb9e-169a-43c7-ad90-87b86ef7bd7d None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:33.169252 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 117/241] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:33.170302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722fd6b-1af7-4924-9e2f-d4a2ae425f72 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:33.176019 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6bb9e-169a-43c7-ad90-87b86ef7bd7d None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:33.224276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ee9d4-e6e1-49bb-893a-a3574cb85327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:33.225001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ee9d4-e6e1-49bb-893a-a3574cb85327 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:33.225353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ee9d4-e6e1-49bb-893a-a3574cb85327 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:33.225631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ee9d4-e6e1-49bb-893a-a3574cb85327 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:33.226580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ee9d4-e6e1-49bb-893a-a3574cb85327 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:33.226879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ee9d4-e6e1-49bb-893a-a3574cb85327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:33.228536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ee9d4-e6e1-49bb-893a-a3574cb85327 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:33.242141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 125/242] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:33.244248 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7c8d2-cfde-47b5-b9ff-9c20fcb53d80 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:33.244624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7c8d2-cfde-47b5-b9ff-9c20fcb53d80 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:33.244903 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7c8d2-cfde-47b5-b9ff-9c20fcb53d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:33.271495 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-1ca7c8d2-cfde-47b5-b9ff-9c20fcb53d80 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:33.273218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-1ca7c8d2-cfde-47b5-b9ff-9c20fcb53d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:33.313563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6bb9e-169a-43c7-ad90-87b86ef7bd7d None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:33.326829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:33.364925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2fe9c-df98-4cce-a0b3-c1f6a6e7fe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:33.366299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2fe9c-df98-4cce-a0b3-c1f6a6e7fe79 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:33.367041 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2fe9c-df98-4cce-a0b3-c1f6a6e7fe79 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:33.367554 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2fe9c-df98-4cce-a0b3-c1f6a6e7fe79 None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:33.368490 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2fe9c-df98-4cce-a0b3-c1f6a6e7fe79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:33.370412 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2fe9c-df98-4cce-a0b3-c1f6a6e7fe79 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:33.397797 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:33.424796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 126/243] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:33.433949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7c8d2-cfde-47b5-b9ff-9c20fcb53d80 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:33.457235 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 118/244] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:37:33 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:37:33.627106 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7c8d2-cfde-47b5-b9ff-9c20fcb53d80 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:33.667664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfd187-c63a-4331-a7b3-563d587c9de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:33.668363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfd187-c63a-4331-a7b3-563d587c9de3 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:33.668643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfd187-c63a-4331-a7b3-563d587c9de3 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:33.668914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfd187-c63a-4331-a7b3-563d587c9de3 None admin] PATH_INFO: `/v3/users/93759ace21a04c2fb7bf1f467220cd78` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:33.685520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cfd187-c63a-4331-a7b3-563d587c9de3 None admin] RBAC: Authorizing `identity:get_user(user_id=93759ace21a04c2fb7bf1f467220cd78)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:33.686930 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cfd187-c63a-4331-a7b3-563d587c9de3 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:33.689518 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 127/245] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:33 2022] GET /identity/v3/users/93759ace21a04c2fb7bf1f467220cd78 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:33.695961 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2fe9c-df98-4cce-a0b3-c1f6a6e7fe79 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:33.811798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091406e-8ad6-4f95-af16-3556959c1069 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:33.812661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091406e-8ad6-4f95-af16-3556959c1069 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:33.812661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091406e-8ad6-4f95-af16-3556959c1069 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:33.814571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 128/246] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:33.820346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a2cec-558e-453d-ba55-9f9fcce9ed91 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:33.820654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a2cec-558e-453d-ba55-9f9fcce9ed91 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:33.820896 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a2cec-558e-453d-ba55-9f9fcce9ed91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:33.857370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-0e0a2cec-558e-453d-ba55-9f9fcce9ed91 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:33.858616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-0e0a2cec-558e-453d-ba55-9f9fcce9ed91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:33.885849 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2fe9c-df98-4cce-a0b3-c1f6a6e7fe79 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:33.933062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:33.942323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602fe6e-ac38-4ef0-be34-35fd6deda09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:33.943049 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602fe6e-ac38-4ef0-be34-35fd6deda09d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:33.943334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602fe6e-ac38-4ef0-be34-35fd6deda09d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:33.943910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602fe6e-ac38-4ef0-be34-35fd6deda09d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:33.964372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 129/247] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:33.965707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a2cec-558e-453d-ba55-9f9fcce9ed91 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:33.999569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:34.051369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602fe6e-ac38-4ef0-be34-35fd6deda09d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:34.052905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602fe6e-ac38-4ef0-be34-35fd6deda09d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:34.092209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a2cec-558e-453d-ba55-9f9fcce9ed91 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:34.135685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee1ea8-0794-452d-9629-52ccba12a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:34.136839 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee1ea8-0794-452d-9629-52ccba12a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:34.137330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee1ea8-0794-452d-9629-52ccba12a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:34.137829 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee1ea8-0794-452d-9629-52ccba12a8d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:34.150876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee1ea8-0794-452d-9629-52ccba12a8d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-54ee1ea8-0794-452d-9629-52ccba12a8d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:34.156779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:34.158214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:34.159006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:34.159006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:34.159006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:34.159006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:34.159006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:34.159006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:34.159006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:34.159006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:34.159006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:34.159006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:34.159006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:34.159006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:34.161470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 130/248] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:34.167871 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee1ea8-0794-452d-9629-52ccba12a8d8 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:34.171389 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 119/249] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:34.184261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602fe6e-ac38-4ef0-be34-35fd6deda09d None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:34.211884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:34.262299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:34.288618 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee1ea8-0794-452d-9629-52ccba12a8d8 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:34.307192 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602fe6e-ac38-4ef0-be34-35fd6deda09d None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:34.329665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b878c-d981-4073-b7cf-432ccca98945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:34.330536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b878c-d981-4073-b7cf-432ccca98945 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:34.330921 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b878c-d981-4073-b7cf-432ccca98945 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:34.331301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b878c-d981-4073-b7cf-432ccca98945 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:34.332082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b878c-d981-4073-b7cf-432ccca98945 None admin] RBAC: Adding query filter params (name=member) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:34.332508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b878c-d981-4073-b7cf-432ccca98945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:34.334026 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b878c-d981-4073-b7cf-432ccca98945 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:34.346667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 131/250] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:34.347811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b878c-d981-4073-b7cf-432ccca98945 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:34.355073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59068db1-595f-4430-9a94-305ce3571ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:34.355724 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59068db1-595f-4430-9a94-305ce3571ec2 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:34.356001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59068db1-595f-4430-9a94-305ce3571ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:34.357858 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59068db1-595f-4430-9a94-305ce3571ec2 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:34.361042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59068db1-595f-4430-9a94-305ce3571ec2 None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:34.362834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59068db1-595f-4430-9a94-305ce3571ec2 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:34.365916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 120/251] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:34 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:34.367550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59068db1-595f-4430-9a94-305ce3571ec2 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:34.521176 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59068db1-595f-4430-9a94-305ce3571ec2 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:34.527085 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:34.531629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b878c-d981-4073-b7cf-432ccca98945 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:34.555177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:34.560392 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258ef5d-0c8a-4a04-8914-92f846e31573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:34.561033 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258ef5d-0c8a-4a04-8914-92f846e31573 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:34.561309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258ef5d-0c8a-4a04-8914-92f846e31573 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:34.561578 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258ef5d-0c8a-4a04-8914-92f846e31573 None admin] PATH_INFO: `/v3/users/fa25d1c0597f4cd180d99e502feafe56` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:34.562867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258ef5d-0c8a-4a04-8914-92f846e31573 None admin] RBAC: Authorizing `identity:get_user(user_id=fa25d1c0597f4cd180d99e502feafe56)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:34.565588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258ef5d-0c8a-4a04-8914-92f846e31573 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:34.567261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 121/252] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:34 2022] GET /identity/v3/users/fa25d1c0597f4cd180d99e502feafe56 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:34.568113 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258ef5d-0c8a-4a04-8914-92f846e31573 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:34.569435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a671d42-2f5d-4725-94ab-13a6865a8374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:34.570256 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a671d42-2f5d-4725-94ab-13a6865a8374 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:34.571293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a671d42-2f5d-4725-94ab-13a6865a8374 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:34.571576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a671d42-2f5d-4725-94ab-13a6865a8374 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:34.584000 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a671d42-2f5d-4725-94ab-13a6865a8374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-7a671d42-2f5d-4725-94ab-13a6865a8374 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:34.589897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:34.590777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:34.592172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:34.592172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:34.592172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:34.592172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:34.592172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:34.592172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:34.592172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:34.592172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:34.592172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:34.592172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:34.592172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:34.592172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:34.592172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 132/253] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:37:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:34.592866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6aec9a-9576-446b-a547-b8391bbaec0a None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:34.593100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6aec9a-9576-446b-a547-b8391bbaec0a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:34.594893 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6aec9a-9576-446b-a547-b8391bbaec0a None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:34.594893 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 133/254] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:34.595877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6aec9a-9576-446b-a547-b8391bbaec0a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:34.702088 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258ef5d-0c8a-4a04-8914-92f846e31573 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:34.723686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6aec9a-9576-446b-a547-b8391bbaec0a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:34.740255 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791fc56-5af1-4383-bbe3-86ec2080a4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:34.740887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791fc56-5af1-4383-bbe3-86ec2080a4ae None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:34.741166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791fc56-5af1-4383-bbe3-86ec2080a4ae None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:34.741437 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791fc56-5af1-4383-bbe3-86ec2080a4ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:34.742240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791fc56-5af1-4383-bbe3-86ec2080a4ae None admin] RBAC: Adding query filter params (role.id=071203b5be0a4780aa2292e2be3fe13c, scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d, user.id=93759ace21a04c2fb7bf1f467220cd78) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:34.742553 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791fc56-5af1-4383-bbe3-86ec2080a4ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:34.744400 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791fc56-5af1-4383-bbe3-86ec2080a4ae None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:34.752284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 122/255] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:34 2022] GET /identity/v3/role_assignments?user.id=93759ace21a04c2fb7bf1f467220cd78&scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d&role.id=071203b5be0a4780aa2292e2be3fe13c => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:34.753193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791fc56-5af1-4383-bbe3-86ec2080a4ae None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:34.773929 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31830fb8-b550-46ad-ab73-394a19ec4f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:34.774510 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31830fb8-b550-46ad-ab73-394a19ec4f06 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:34.774790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31830fb8-b550-46ad-ab73-394a19ec4f06 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:34.775135 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31830fb8-b550-46ad-ab73-394a19ec4f06 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:34.776526 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31830fb8-b550-46ad-ab73-394a19ec4f06 None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:34.778844 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31830fb8-b550-46ad-ab73-394a19ec4f06 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:34.780692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 134/256] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:34 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:34.782650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d8489-616d-42d4-bac6-f4b5c9005ec7 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:34.782938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d8489-616d-42d4-bac6-f4b5c9005ec7 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:34.783207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d8489-616d-42d4-bac6-f4b5c9005ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:34.807806 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-df2d8489-616d-42d4-bac6-f4b5c9005ec7 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:34.809140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-df2d8489-616d-42d4-bac6-f4b5c9005ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:34.837751 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:34.906670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 135/257] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:34.917306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d8489-616d-42d4-bac6-f4b5c9005ec7 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:34.922022 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:35.020331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791fc56-5af1-4383-bbe3-86ec2080a4ae None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:35.071253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d8489-616d-42d4-bac6-f4b5c9005ec7 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:35.080097 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f42e89-5a7c-4a00-b7f6-18d4350683c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:35.080797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f42e89-5a7c-4a00-b7f6-18d4350683c3 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:35.081075 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f42e89-5a7c-4a00-b7f6-18d4350683c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:35.081343 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f42e89-5a7c-4a00-b7f6-18d4350683c3 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:35.082016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f42e89-5a7c-4a00-b7f6-18d4350683c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:35.083008 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f42e89-5a7c-4a00-b7f6-18d4350683c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:35.084428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f42e89-5a7c-4a00-b7f6-18d4350683c3 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:35.096832 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 123/258] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:35.103907 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f42e89-5a7c-4a00-b7f6-18d4350683c3 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:35.146645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160f5a2-f08d-42f0-814c-a0c7b9cd9bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:35.147323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160f5a2-f08d-42f0-814c-a0c7b9cd9bb7 None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:35.147597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160f5a2-f08d-42f0-814c-a0c7b9cd9bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:35.147864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160f5a2-f08d-42f0-814c-a0c7b9cd9bb7 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d/users/fa25d1c0597f4cd180d99e502feafe56/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:35.151209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160f5a2-f08d-42f0-814c-a0c7b9cd9bb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d, user_id=fa25d1c0597f4cd180d99e502feafe56, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:35.154459 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160f5a2-f08d-42f0-814c-a0c7b9cd9bb7 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:35.257161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 136/259] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:37:34 2022] PUT /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d/users/fa25d1c0597f4cd180d99e502feafe56/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:37:35.259704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f42e89-5a7c-4a00-b7f6-18d4350683c3 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:35.292423 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:35.301906 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08f283-5ed1-4bee-80e2-ea2473c3e058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:35.302769 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08f283-5ed1-4bee-80e2-ea2473c3e058 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:35.303054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08f283-5ed1-4bee-80e2-ea2473c3e058 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:35.303324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08f283-5ed1-4bee-80e2-ea2473c3e058 None admin] PATH_INFO: `/v3/users/b2f36a9620034923bcac3a1563b31aaf` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:35.304653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08f283-5ed1-4bee-80e2-ea2473c3e058 None admin] RBAC: Authorizing `identity:get_user(user_id=b2f36a9620034923bcac3a1563b31aaf)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:35.306220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08f283-5ed1-4bee-80e2-ea2473c3e058 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:35.308708 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 124/260] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:35 2022] GET /identity/v3/users/b2f36a9620034923bcac3a1563b31aaf => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:35.317499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160f5a2-f08d-42f0-814c-a0c7b9cd9bb7 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:35.343750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:35.372612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08f283-5ed1-4bee-80e2-ea2473c3e058 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:35.520170 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08f283-5ed1-4bee-80e2-ea2473c3e058 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:35.533505 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160f5a2-f08d-42f0-814c-a0c7b9cd9bb7 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:35.559340 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d08c63-79e5-4864-a4ed-bb69a14aed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:35.559985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d08c63-79e5-4864-a4ed-bb69a14aed63 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:35.560308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d08c63-79e5-4864-a4ed-bb69a14aed63 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:35.560579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d08c63-79e5-4864-a4ed-bb69a14aed63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:35.572124 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d08c63-79e5-4864-a4ed-bb69a14aed63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-05d08c63-79e5-4864-a4ed-bb69a14aed63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:35.578244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:35.579996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:35.581373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:35.581373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:35.581373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:35.581373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:35.581373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:35.581373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:35.581373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:35.581373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:35.581373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:35.581373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:35.581373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:35.581373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:35.581373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 125/261] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:37:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:37:35.589571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d08c63-79e5-4864-a4ed-bb69a14aed63 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:35.610370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bb279-ebdd-4d04-86c9-f70270feaa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:35.611455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bb279-ebdd-4d04-86c9-f70270feaa4f None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:35.611732 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bb279-ebdd-4d04-86c9-f70270feaa4f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:35.612002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bb279-ebdd-4d04-86c9-f70270feaa4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:35.694150 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:35.755504 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bb279-ebdd-4d04-86c9-f70270feaa4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:35.757036 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bb279-ebdd-4d04-86c9-f70270feaa4f None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:35.784105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d08c63-79e5-4864-a4ed-bb69a14aed63 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:35.800067 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:35.862808 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49398ff-4c64-4e64-9e0b-d00cd6470ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:35.863405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49398ff-4c64-4e64-9e0b-d00cd6470ed6 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:35.863686 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49398ff-4c64-4e64-9e0b-d00cd6470ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:35.864056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49398ff-4c64-4e64-9e0b-d00cd6470ed6 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:35.864806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49398ff-4c64-4e64-9e0b-d00cd6470ed6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:35.865106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49398ff-4c64-4e64-9e0b-d00cd6470ed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:35.866681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49398ff-4c64-4e64-9e0b-d00cd6470ed6 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:35.886619 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 126/262] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:37:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:35.899093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49398ff-4c64-4e64-9e0b-d00cd6470ed6 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:36.000323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 137/263] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:36.013393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bb279-ebdd-4d04-86c9-f70270feaa4f None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:36.125550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49398ff-4c64-4e64-9e0b-d00cd6470ed6 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:36.153749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bb279-ebdd-4d04-86c9-f70270feaa4f None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:36.161798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:36.173530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:36.200887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc235b-8373-4d06-ac49-b0cb1fa8679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:36.202530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc235b-8373-4d06-ac49-b0cb1fa8679e None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:36.203206 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc235b-8373-4d06-ac49-b0cb1fa8679e None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:36.205506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc235b-8373-4d06-ac49-b0cb1fa8679e None admin] PATH_INFO: `/v3/users/b2f36a9620034923bcac3a1563b31aaf` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:36.206997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc235b-8373-4d06-ac49-b0cb1fa8679e None admin] RBAC: Authorizing `identity:get_user(user_id=b2f36a9620034923bcac3a1563b31aaf)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:36.214005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc235b-8373-4d06-ac49-b0cb1fa8679e None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:36.217052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 127/264] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:35 2022] GET /identity/v3/users/b2f36a9620034923bcac3a1563b31aaf => generated 283 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:36.224343 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc235b-8373-4d06-ac49-b0cb1fa8679e None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:36.228941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0654b3-a7ca-471b-9ff4-c9e6a977b0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:36.229624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0654b3-a7ca-471b-9ff4-c9e6a977b0f4 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:36.229902 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0654b3-a7ca-471b-9ff4-c9e6a977b0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:36.230172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0654b3-a7ca-471b-9ff4-c9e6a977b0f4 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:36.241047 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0654b3-a7ca-471b-9ff4-c9e6a977b0f4 None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:36.242548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0654b3-a7ca-471b-9ff4-c9e6a977b0f4 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:36.244320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 138/265] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:36 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:36.250366 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0654b3-a7ca-471b-9ff4-c9e6a977b0f4 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:36.450090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc235b-8373-4d06-ac49-b0cb1fa8679e None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:36.494862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0654b3-a7ca-471b-9ff4-c9e6a977b0f4 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:36.541912 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6735db9-a9a7-4b29-b8de-1ac4665c18ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:36.542552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6735db9-a9a7-4b29-b8de-1ac4665c18ce None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:36.542838 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6735db9-a9a7-4b29-b8de-1ac4665c18ce None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:36.543117 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6735db9-a9a7-4b29-b8de-1ac4665c18ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:36.580807 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d6be6-2d05-44db-82f2-68d61c5aebdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:36.581430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d6be6-2d05-44db-82f2-68d61c5aebdc None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:36.581780 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d6be6-2d05-44db-82f2-68d61c5aebdc None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:36.582060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d6be6-2d05-44db-82f2-68d61c5aebdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:36.582806 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d6be6-2d05-44db-82f2-68d61c5aebdc None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d, user.id=b2f36a9620034923bcac3a1563b31aaf) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:36.583118 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d6be6-2d05-44db-82f2-68d61c5aebdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:36.584622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d6be6-2d05-44db-82f2-68d61c5aebdc None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:36.605350 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 139/266] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:36 2022] GET /identity/v3/role_assignments?user.id=b2f36a9620034923bcac3a1563b31aaf&scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 608 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:36.606906 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44975747-1f61-4f92-b480-879d301d4aa1 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:36.607361 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44975747-1f61-4f92-b480-879d301d4aa1 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:36.610989 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44975747-1f61-4f92-b480-879d301d4aa1 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:36.613426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 140/267] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:36.619519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd31b5-9d88-419f-85d9-75d66d049412 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:36.619809 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd31b5-9d88-419f-85d9-75d66d049412 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:36.620086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd31b5-9d88-419f-85d9-75d66d049412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:36.678040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-76cd31b5-9d88-419f-85d9-75d66d049412 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:36.679238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-76cd31b5-9d88-419f-85d9-75d66d049412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:36.687279 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:36.764654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:36.797136 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6735db9-a9a7-4b29-b8de-1ac4665c18ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:36.799184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6735db9-a9a7-4b29-b8de-1ac4665c18ce None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:36.802980 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 141/268] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:36.805767 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cac085-8579-4d07-83d1-b44b9b20eadb None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:36.806133 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cac085-8579-4d07-83d1-b44b9b20eadb None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:36.806478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cac085-8579-4d07-83d1-b44b9b20eadb None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:36.807862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 142/269] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:36.814623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb43bf0-cc44-435a-b7f9-2c90265c6d8f None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:36.814922 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb43bf0-cc44-435a-b7f9-2c90265c6d8f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:36.815154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb43bf0-cc44-435a-b7f9-2c90265c6d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:36.852575 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-cfb43bf0-cc44-435a-b7f9-2c90265c6d8f None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:36.854571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-cfb43bf0-cc44-435a-b7f9-2c90265c6d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:36.937280 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 143/270] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:37.095158 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 128/271] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 871 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:37.101432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb43bf0-cc44-435a-b7f9-2c90265c6d8f None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:37.239904 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb43bf0-cc44-435a-b7f9-2c90265c6d8f None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:37.256883 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:37.294630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07407a55-1190-4bb8-86ad-75be87fba18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:37.295319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07407a55-1190-4bb8-86ad-75be87fba18a None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:37.295604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07407a55-1190-4bb8-86ad-75be87fba18a None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:37.295884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07407a55-1190-4bb8-86ad-75be87fba18a None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:37.298048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07407a55-1190-4bb8-86ad-75be87fba18a None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:37.298923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6735db9-a9a7-4b29-b8de-1ac4665c18ce None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:37.299874 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07407a55-1190-4bb8-86ad-75be87fba18a None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:37.303187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 144/272] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:37 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:37.313879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07407a55-1190-4bb8-86ad-75be87fba18a None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:37.462749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:37.488264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6735db9-a9a7-4b29-b8de-1ac4665c18ce None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:37.492369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07407a55-1190-4bb8-86ad-75be87fba18a None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:37.538571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749519c7-1d79-491f-bb27-20e5c7a27cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:37.539478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749519c7-1d79-491f-bb27-20e5c7a27cc6 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:37.539933 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749519c7-1d79-491f-bb27-20e5c7a27cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:37.540381 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749519c7-1d79-491f-bb27-20e5c7a27cc6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:37.556236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749519c7-1d79-491f-bb27-20e5c7a27cc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-749519c7-1d79-491f-bb27-20e5c7a27cc6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:37.567636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:37.569081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:37.571516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:37.571516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:37.571516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:37.571516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:37.571516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:37.571516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:37.571516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:37.571516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:37.571516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:37.571516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:37.571516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:37.571516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:37.571516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 129/273] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:37.573397 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749519c7-1d79-491f-bb27-20e5c7a27cc6 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:37.578938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01470335-b714-4658-9732-f7a4fec22129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:37.580537 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01470335-b714-4658-9732-f7a4fec22129 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:37.581010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01470335-b714-4658-9732-f7a4fec22129 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:37.581510 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01470335-b714-4658-9732-f7a4fec22129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:37.584381 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01470335-b714-4658-9732-f7a4fec22129 None admin] RBAC: Adding query filter params (role.id=da30366a448b4b1f902c8160690d366e, scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d, user.id=b2f36a9620034923bcac3a1563b31aaf) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:37.584946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01470335-b714-4658-9732-f7a4fec22129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:37.587950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01470335-b714-4658-9732-f7a4fec22129 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:37.604938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 145/274] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:37 2022] GET /identity/v3/role_assignments?user.id=b2f36a9620034923bcac3a1563b31aaf&scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d&role.id=da30366a448b4b1f902c8160690d366e => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:37.606544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01470335-b714-4658-9732-f7a4fec22129 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:37.705962 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:37.799395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01470335-b714-4658-9732-f7a4fec22129 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:37.827354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749519c7-1d79-491f-bb27-20e5c7a27cc6 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:37.839700 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6dc78-b83e-4e6a-9085-4d11dcfff041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:37.840513 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6dc78-b83e-4e6a-9085-4d11dcfff041 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:37.840894 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6dc78-b83e-4e6a-9085-4d11dcfff041 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:37.841322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6dc78-b83e-4e6a-9085-4d11dcfff041 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:37.842221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6dc78-b83e-4e6a-9085-4d11dcfff041 None admin] RBAC: Adding query filter params (name=member) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:37.842671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6dc78-b83e-4e6a-9085-4d11dcfff041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:37.844896 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6dc78-b83e-4e6a-9085-4d11dcfff041 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:37.855957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 146/275] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:37.864711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6dc78-b83e-4e6a-9085-4d11dcfff041 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:37.910585 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571f1f9-75e1-416a-bed9-ac8d046abd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:37.911964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571f1f9-75e1-416a-bed9-ac8d046abd8a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:37.912705 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571f1f9-75e1-416a-bed9-ac8d046abd8a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:37.913395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571f1f9-75e1-416a-bed9-ac8d046abd8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:37.915779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571f1f9-75e1-416a-bed9-ac8d046abd8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:37.918821 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571f1f9-75e1-416a-bed9-ac8d046abd8a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:37.921979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 130/276] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:37:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:37.939964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571f1f9-75e1-416a-bed9-ac8d046abd8a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:37.968869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:37.997022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6dc78-b83e-4e6a-9085-4d11dcfff041 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:37.999352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:38.046941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3524b-5554-4a8a-8833-9a3e95b546dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:38.048345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3524b-5554-4a8a-8833-9a3e95b546dd None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:38.048623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3524b-5554-4a8a-8833-9a3e95b546dd None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:38.048895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3524b-5554-4a8a-8833-9a3e95b546dd None admin] PATH_INFO: `/v3/users/91c1c279835e43c9a2150f62182e46b7` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:38.067280 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3524b-5554-4a8a-8833-9a3e95b546dd None admin] RBAC: Authorizing `identity:get_user(user_id=91c1c279835e43c9a2150f62182e46b7)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:38.069132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3524b-5554-4a8a-8833-9a3e95b546dd None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:38.070956 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 147/277] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:37 2022] GET /identity/v3/users/91c1c279835e43c9a2150f62182e46b7 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:38.072041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b03bfd-87cc-4fb9-a345-d9fefe752548 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:38.072375 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b03bfd-87cc-4fb9-a345-d9fefe752548 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:38.072659 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b03bfd-87cc-4fb9-a345-d9fefe752548 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:38.074212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 148/278] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:38.077103 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b03bfd-87cc-4fb9-a345-d9fefe752548 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:38.096706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571f1f9-75e1-416a-bed9-ac8d046abd8a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:38.135635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af1020-8f1f-4e7e-ac5d-a4d709c8c50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:38.136301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af1020-8f1f-4e7e-ac5d-a4d709c8c50e None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:38.136590 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af1020-8f1f-4e7e-ac5d-a4d709c8c50e None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:38.136865 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af1020-8f1f-4e7e-ac5d-a4d709c8c50e None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:38.138033 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af1020-8f1f-4e7e-ac5d-a4d709c8c50e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:38.139508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af1020-8f1f-4e7e-ac5d-a4d709c8c50e None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:38.186799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b03bfd-87cc-4fb9-a345-d9fefe752548 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:38.223367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21010b43-9da5-496d-91bb-bb940bac8d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:38.223968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21010b43-9da5-496d-91bb-bb940bac8d9e None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:38.224272 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21010b43-9da5-496d-91bb-bb940bac8d9e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:38.224583 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21010b43-9da5-496d-91bb-bb940bac8d9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:38.225301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21010b43-9da5-496d-91bb-bb940bac8d9e None admin] RBAC: Adding query filter params (role.id=bebe72a018ea47b992e9e6715060fadb, user.id=91c1c279835e43c9a2150f62182e46b7, scope.system=all) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:38.225599 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21010b43-9da5-496d-91bb-bb940bac8d9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:38.227290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21010b43-9da5-496d-91bb-bb940bac8d9e None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:38.232474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 149/279] 10.222.0.72 () {56 vars in 1308 bytes} [Mon Aug 29 22:37:38 2022] GET /identity/v3/role_assignments?user.id=91c1c279835e43c9a2150f62182e46b7&scope.system=all&role.id=bebe72a018ea47b992e9e6715060fadb => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:38.233630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6a0e4-1fcd-4d7d-bcd0-434d9aa0eb01 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:38.233909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6a0e4-1fcd-4d7d-bcd0-434d9aa0eb01 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:38.234179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6a0e4-1fcd-4d7d-bcd0-434d9aa0eb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:38.254346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-e4c6a0e4-1fcd-4d7d-bcd0-434d9aa0eb01 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:38.255605 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e4c6a0e4-1fcd-4d7d-bcd0-434d9aa0eb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:38.264433 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 131/280] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:37:37 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:37:38.267897 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271b2c4-8935-4c6c-b7d7-aac90b2a5591 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:38.268686 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271b2c4-8935-4c6c-b7d7-aac90b2a5591 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:38.269908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271b2c4-8935-4c6c-b7d7-aac90b2a5591 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:38.272718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 132/281] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:38.278819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2601bf-bc6a-48af-9fd1-88becee975c8 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:38.279332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2601bf-bc6a-48af-9fd1-88becee975c8 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:38.279332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2601bf-bc6a-48af-9fd1-88becee975c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:38.286927 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:38.302009 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-8a2601bf-bc6a-48af-9fd1-88becee975c8 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:38.303423 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8a2601bf-bc6a-48af-9fd1-88becee975c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:38.377996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 150/282] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:38.405956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:38.413525 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 133/283] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:38.664118 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6a0e4-1fcd-4d7d-bcd0-434d9aa0eb01 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:38.701645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2601bf-bc6a-48af-9fd1-88becee975c8 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:38.794835 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6a0e4-1fcd-4d7d-bcd0-434d9aa0eb01 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:38.843355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d873e48-4731-40db-ac9c-f24b852ae02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:38.844036 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d873e48-4731-40db-ac9c-f24b852ae02e None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:38.845141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d873e48-4731-40db-ac9c-f24b852ae02e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:38.845251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d873e48-4731-40db-ac9c-f24b852ae02e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:38.878275 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d873e48-4731-40db-ac9c-f24b852ae02e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-7d873e48-4731-40db-ac9c-f24b852ae02e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:38.885576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:38.886622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:38.887545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:38.887545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:38.887545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:38.887545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:38.887545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:38.887545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:38.887545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:38.887545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:38.887545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:38.887545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:38.887545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:38.887545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:38.890162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 151/284] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:38.897447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d873e48-4731-40db-ac9c-f24b852ae02e None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:38.911311 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2601bf-bc6a-48af-9fd1-88becee975c8 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:38.921767 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:38.985164 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77539bef-3417-416f-8662-d9c80a8e87bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:38.986214 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77539bef-3417-416f-8662-d9c80a8e87bf None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:38.987572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77539bef-3417-416f-8662-d9c80a8e87bf None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:38.988039 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77539bef-3417-416f-8662-d9c80a8e87bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:39.008958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77539bef-3417-416f-8662-d9c80a8e87bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-77539bef-3417-416f-8662-d9c80a8e87bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:39.017379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:39.018342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:39.019126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:39.019126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:39.019126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:39.019126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:39.019126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:39.019126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:39.019126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:39.019126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:39.019126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:39.019126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:39.019126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:39.019126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:39.021829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 134/285] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:37:39.028323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77539bef-3417-416f-8662-d9c80a8e87bf None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:39.083251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d873e48-4731-40db-ac9c-f24b852ae02e None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:39.138554 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:39.138891 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f40b1f-4876-4178-b491-7a3babf9d33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:39.139473 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f40b1f-4876-4178-b491-7a3babf9d33c None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:39.139749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f40b1f-4876-4178-b491-7a3babf9d33c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:39.140017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f40b1f-4876-4178-b491-7a3babf9d33c None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:39.140719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f40b1f-4876-4178-b491-7a3babf9d33c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:39.142363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f40b1f-4876-4178-b491-7a3babf9d33c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:39.143764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f40b1f-4876-4178-b491-7a3babf9d33c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:39.161344 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 152/286] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:39.167267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f40b1f-4876-4178-b491-7a3babf9d33c None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:39.218427 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77539bef-3417-416f-8662-d9c80a8e87bf None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:39.258816 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:39.306500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f40b1f-4876-4178-b491-7a3babf9d33c None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:39.311499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cfe7b-a73b-4ee7-9905-bd53d4648ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:39.312140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cfe7b-a73b-4ee7-9905-bd53d4648ee8 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:39.312448 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cfe7b-a73b-4ee7-9905-bd53d4648ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:39.312757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cfe7b-a73b-4ee7-9905-bd53d4648ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:39.313509 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cfe7b-a73b-4ee7-9905-bd53d4648ee8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:39.313814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cfe7b-a73b-4ee7-9905-bd53d4648ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:39.315245 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cfe7b-a73b-4ee7-9905-bd53d4648ee8 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:39.335885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 135/287] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:39.341584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cfe7b-a73b-4ee7-9905-bd53d4648ee8 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:39.375539 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d3898-6b34-4c8e-8fc2-5390802715db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:39.376624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d3898-6b34-4c8e-8fc2-5390802715db None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:39.377143 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d3898-6b34-4c8e-8fc2-5390802715db None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:39.377645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d3898-6b34-4c8e-8fc2-5390802715db None admin] PATH_INFO: `/v3/users/93759ace21a04c2fb7bf1f467220cd78` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:39.379049 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d3898-6b34-4c8e-8fc2-5390802715db None admin] RBAC: Authorizing `identity:get_user(user_id=93759ace21a04c2fb7bf1f467220cd78)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:39.380729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d3898-6b34-4c8e-8fc2-5390802715db None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:39.383671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 153/288] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:39 2022] GET /identity/v3/users/93759ace21a04c2fb7bf1f467220cd78 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:39.390257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d3898-6b34-4c8e-8fc2-5390802715db None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:39.521801 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cfe7b-a73b-4ee7-9905-bd53d4648ee8 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:39.544089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:39.561630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d674a9-1da1-429d-bc7c-0d8a12a07a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:39.562273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d674a9-1da1-429d-bc7c-0d8a12a07a02 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:39.562559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d674a9-1da1-429d-bc7c-0d8a12a07a02 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:39.562988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d674a9-1da1-429d-bc7c-0d8a12a07a02 None admin] PATH_INFO: `/v3/users/fa25d1c0597f4cd180d99e502feafe56` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:39.565051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d674a9-1da1-429d-bc7c-0d8a12a07a02 None admin] RBAC: Authorizing `identity:get_user(user_id=fa25d1c0597f4cd180d99e502feafe56)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:39.566512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d674a9-1da1-429d-bc7c-0d8a12a07a02 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:39.568117 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 136/289] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:39 2022] GET /identity/v3/users/fa25d1c0597f4cd180d99e502feafe56 => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:39.573941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d674a9-1da1-429d-bc7c-0d8a12a07a02 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:39.599796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d3898-6b34-4c8e-8fc2-5390802715db None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:39.658160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f310c2-e317-47ec-890e-c72e71bd13c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:39.659407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f310c2-e317-47ec-890e-c72e71bd13c4 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:39.659407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f310c2-e317-47ec-890e-c72e71bd13c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:39.659407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f310c2-e317-47ec-890e-c72e71bd13c4 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:39.660614 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f310c2-e317-47ec-890e-c72e71bd13c4 None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:39.662078 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f310c2-e317-47ec-890e-c72e71bd13c4 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:39.664165 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 154/290] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:39 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:39.669947 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f310c2-e317-47ec-890e-c72e71bd13c4 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:39.698152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:39.768596 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d674a9-1da1-429d-bc7c-0d8a12a07a02 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:39.844497 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbff1c-4713-47bc-af23-c010b6cb8d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:39.844497 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbff1c-4713-47bc-af23-c010b6cb8d07 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:39.844497 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbff1c-4713-47bc-af23-c010b6cb8d07 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:39.844497 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbff1c-4713-47bc-af23-c010b6cb8d07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:39.869477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f310c2-e317-47ec-890e-c72e71bd13c4 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:39.938906 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:39.961709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28ee1d-27c0-40db-be13-b7042b256cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:39.962406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28ee1d-27c0-40db-be13-b7042b256cef None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:39.962691 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28ee1d-27c0-40db-be13-b7042b256cef None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:39.963078 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28ee1d-27c0-40db-be13-b7042b256cef None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d/users/93759ace21a04c2fb7bf1f467220cd78/roles/071203b5be0a4780aa2292e2be3fe13c` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:39.965860 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbff1c-4713-47bc-af23-c010b6cb8d07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:39.966910 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28ee1d-27c0-40db-be13-b7042b256cef None admin] RBAC: Authorizing `identity:create_grant(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d, user_id=93759ace21a04c2fb7bf1f467220cd78, role_id=071203b5be0a4780aa2292e2be3fe13c)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:39.968428 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28ee1d-27c0-40db-be13-b7042b256cef None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:39.972964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbff1c-4713-47bc-af23-c010b6cb8d07 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:40.046479 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 155/291] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:37:39 2022] PUT /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d/users/93759ace21a04c2fb7bf1f467220cd78/roles/071203b5be0a4780aa2292e2be3fe13c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:37:40.122228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 137/292] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 22:37:40.128896 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28ee1d-27c0-40db-be13-b7042b256cef None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:40.246074 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:40.277520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28ee1d-27c0-40db-be13-b7042b256cef None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:40.317777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7b2cc-a850-4be1-a177-052a41eaef36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:40.318444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7b2cc-a850-4be1-a177-052a41eaef36 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:40.318728 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7b2cc-a850-4be1-a177-052a41eaef36 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:40.319005 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7b2cc-a850-4be1-a177-052a41eaef36 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:40.320285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7b2cc-a850-4be1-a177-052a41eaef36 None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:40.321936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7b2cc-a850-4be1-a177-052a41eaef36 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:40.323792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 156/293] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:40 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:40.330543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbff1c-4713-47bc-af23-c010b6cb8d07 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:40.481287 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:40.495891 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbff1c-4713-47bc-af23-c010b6cb8d07 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:40.521900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5cf5d-d870-4563-8bf0-99e6451117e7 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:40.522563 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5cf5d-d870-4563-8bf0-99e6451117e7 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:40.523025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5cf5d-d870-4563-8bf0-99e6451117e7 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:40.524678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 157/294] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:40.530553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fa6c2-9eb7-4212-b10a-45e58887a034 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:40.530835 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fa6c2-9eb7-4212-b10a-45e58887a034 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:40.531116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fa6c2-9eb7-4212-b10a-45e58887a034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:40.537719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a97f7d-09c8-4ea6-a98a-8828f792ceef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:40.538359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a97f7d-09c8-4ea6-a98a-8828f792ceef None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:40.538647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a97f7d-09c8-4ea6-a98a-8828f792ceef None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:40.538928 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a97f7d-09c8-4ea6-a98a-8828f792ceef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:40.539684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a97f7d-09c8-4ea6-a98a-8828f792ceef None admin] RBAC: Adding query filter params (role.id=bebe72a018ea47b992e9e6715060fadb, scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d, user.id=fa25d1c0597f4cd180d99e502feafe56) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:40.540000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a97f7d-09c8-4ea6-a98a-8828f792ceef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:40.542568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a97f7d-09c8-4ea6-a98a-8828f792ceef None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:40.549137 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 138/295] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:40 2022] GET /identity/v3/role_assignments?user.id=fa25d1c0597f4cd180d99e502feafe56&scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d&role.id=bebe72a018ea47b992e9e6715060fadb => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:40.579228 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-441fa6c2-9eb7-4212-b10a-45e58887a034 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:40.580224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-441fa6c2-9eb7-4212-b10a-45e58887a034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:40.689572 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 158/296] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:40.996024 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df71952-79b5-435b-a973-8423f57a350b None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:40.996560 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df71952-79b5-435b-a973-8423f57a350b None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:40.996634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df71952-79b5-435b-a973-8423f57a350b None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:40.998260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 139/297] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:41.005264 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0ab3e-830b-4975-9b14-eb2bd937a1c3 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:41.005552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0ab3e-830b-4975-9b14-eb2bd937a1c3 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:41.005804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0ab3e-830b-4975-9b14-eb2bd937a1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:41.009424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df71952-79b5-435b-a973-8423f57a350b None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:41.027951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-65f0ab3e-830b-4975-9b14-eb2bd937a1c3 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:41.029172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-65f0ab3e-830b-4975-9b14-eb2bd937a1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:41.116735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:41.122125 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 159/298] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:41.129402 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7270f6-6375-4718-93df-cc3c31128ffb None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:41.129747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7270f6-6375-4718-93df-cc3c31128ffb None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:41.134544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7270f6-6375-4718-93df-cc3c31128ffb None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:41.134544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 160/299] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:37:41.136703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49ba3-3535-4389-b075-62bc1b5d6b1c None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:41.137026 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49ba3-3535-4389-b075-62bc1b5d6b1c None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:41.137238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49ba3-3535-4389-b075-62bc1b5d6b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:41.153297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df71952-79b5-435b-a973-8423f57a350b None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:41.158178 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-8cf49ba3-3535-4389-b075-62bc1b5d6b1c None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:41.160454 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8cf49ba3-3535-4389-b075-62bc1b5d6b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:41.202600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3de65c-f977-447f-99b6-3f0cc16f54fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:41.203964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3de65c-f977-447f-99b6-3f0cc16f54fe None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:41.205207 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3de65c-f977-447f-99b6-3f0cc16f54fe None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:41.205487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3de65c-f977-447f-99b6-3f0cc16f54fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:41.218746 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3de65c-f977-447f-99b6-3f0cc16f54fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-2d3de65c-f977-447f-99b6-3f0cc16f54fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:41.224632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:41.225526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:41.226539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:41.226539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:41.226539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:41.226539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:41.226539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:41.226539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:41.226539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:41.226539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:41.226539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:41.226539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:41.226539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:41.226539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:41.227727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 140/300] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:41.236225 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3de65c-f977-447f-99b6-3f0cc16f54fe None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:41.246216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 161/301] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:41.255277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:41.357028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3de65c-f977-447f-99b6-3f0cc16f54fe None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:41.400714 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866c449-9713-458f-a953-8835e185bc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:41.401341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866c449-9713-458f-a953-8835e185bc6c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:41.401619 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866c449-9713-458f-a953-8835e185bc6c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:41.401892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866c449-9713-458f-a953-8835e185bc6c None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:41.402633 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866c449-9713-458f-a953-8835e185bc6c None admin] RBAC: Adding query filter params (name=member) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:41.402943 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866c449-9713-458f-a953-8835e185bc6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:41.404357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866c449-9713-458f-a953-8835e185bc6c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:41.416091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 141/302] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:41.425348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf49ba3-3535-4389-b075-62bc1b5d6b1c None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:41.428049 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866c449-9713-458f-a953-8835e185bc6c None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:41.536033 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:41.563950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866c449-9713-458f-a953-8835e185bc6c None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:41.564609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf49ba3-3535-4389-b075-62bc1b5d6b1c None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:41.596376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:41.603067 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6deece-98fb-421c-a82f-7557ccdf98ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:41.603887 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6deece-98fb-421c-a82f-7557ccdf98ed None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:41.604168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6deece-98fb-421c-a82f-7557ccdf98ed None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:41.604479 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6deece-98fb-421c-a82f-7557ccdf98ed None admin] PATH_INFO: `/v3/users/91c1c279835e43c9a2150f62182e46b7` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:41.605022 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91df979-6956-4c21-884e-f398ca4eb5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:41.605671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6deece-98fb-421c-a82f-7557ccdf98ed None admin] RBAC: Authorizing `identity:get_user(user_id=91c1c279835e43c9a2150f62182e46b7)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:41.605783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91df979-6956-4c21-884e-f398ca4eb5e8 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:41.606054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91df979-6956-4c21-884e-f398ca4eb5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:41.606364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91df979-6956-4c21-884e-f398ca4eb5e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:41.607113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6deece-98fb-421c-a82f-7557ccdf98ed None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:41.614364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 162/303] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:41 2022] GET /identity/v3/users/91c1c279835e43c9a2150f62182e46b7 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:41.614364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6deece-98fb-421c-a82f-7557ccdf98ed None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:41.623242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91df979-6956-4c21-884e-f398ca4eb5e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-b91df979-6956-4c21-884e-f398ca4eb5e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:41.629750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:41.630944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:41.631988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:41.631988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:41.631988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:41.631988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:41.631988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:41.631988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:41.631988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:41.631988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:41.631988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:41.631988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:41.631988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:41.631988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:41.631988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 142/304] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:41.632694 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91df979-6956-4c21-884e-f398ca4eb5e8 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:41.736174 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6deece-98fb-421c-a82f-7557ccdf98ed None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:41.756184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91df979-6956-4c21-884e-f398ca4eb5e8 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:41.775224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eecae-d48e-4528-953e-7ab60af95ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:41.775650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eecae-d48e-4528-953e-7ab60af95ea3 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:41.775936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eecae-d48e-4528-953e-7ab60af95ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:41.776239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eecae-d48e-4528-953e-7ab60af95ea3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:41.777390 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9eecae-d48e-4528-953e-7ab60af95ea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:41.778875 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9eecae-d48e-4528-953e-7ab60af95ea3 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:41.780727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 163/305] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:37:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:41.781664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eecae-d48e-4528-953e-7ab60af95ea3 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:41.801713 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee33f93-0802-4459-97c6-e922838b8097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:41.802387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee33f93-0802-4459-97c6-e922838b8097 None admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:41.802676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee33f93-0802-4459-97c6-e922838b8097 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:41.802966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee33f93-0802-4459-97c6-e922838b8097 None admin] PATH_INFO: `/v3/system/users/91c1c279835e43c9a2150f62182e46b7/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:41.804790 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee33f93-0802-4459-97c6-e922838b8097 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=91c1c279835e43c9a2150f62182e46b7, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:41.806192 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee33f93-0802-4459-97c6-e922838b8097 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:41.808028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:41.855641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:41.893150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eecae-d48e-4528-953e-7ab60af95ea3 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:41.895125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 143/306] 10.222.0.72 () {58 vars in 1334 bytes} [Mon Aug 29 22:37:41 2022] PUT /identity/v3/system/users/91c1c279835e43c9a2150f62182e46b7/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:37:41.895973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee33f93-0802-4459-97c6-e922838b8097 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:41.944012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1a77a-ed99-4dad-930a-e052862932f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:41.945013 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1a77a-ed99-4dad-930a-e052862932f2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:41.945466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1a77a-ed99-4dad-930a-e052862932f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:41.945918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1a77a-ed99-4dad-930a-e052862932f2 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:41.946743 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1a77a-ed99-4dad-930a-e052862932f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:41.947204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1a77a-ed99-4dad-930a-e052862932f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:41.948651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1a77a-ed99-4dad-930a-e052862932f2 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:41.959053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 164/307] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:41.965098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1a77a-ed99-4dad-930a-e052862932f2 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:42.054522 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee33f93-0802-4459-97c6-e922838b8097 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:42.093095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1a77a-ed99-4dad-930a-e052862932f2 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:42.101604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7efb9f-168b-4169-9a46-a8584ba27f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:42.101604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7efb9f-168b-4169-9a46-a8584ba27f50 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:42.101604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7efb9f-168b-4169-9a46-a8584ba27f50 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:42.101604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7efb9f-168b-4169-9a46-a8584ba27f50 None admin] PATH_INFO: `/v3/groups` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:42.102023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7efb9f-168b-4169-9a46-a8584ba27f50 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:42.102880 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7efb9f-168b-4169-9a46-a8584ba27f50 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:42.132853 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:42.141667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba275239-dd5d-4f22-8f84-e33815521da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:42.142460 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba275239-dd5d-4f22-8f84-e33815521da6 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:42.142637 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba275239-dd5d-4f22-8f84-e33815521da6 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:42.142957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba275239-dd5d-4f22-8f84-e33815521da6 None admin] PATH_INFO: `/v3/users/8cf80abad8f64dffb3faee6206503100` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:42.158900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba275239-dd5d-4f22-8f84-e33815521da6 None admin] RBAC: Authorizing `identity:get_user(user_id=8cf80abad8f64dffb3faee6206503100)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:42.160394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba275239-dd5d-4f22-8f84-e33815521da6 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:42.162315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 165/308] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:41 2022] GET /identity/v3/users/8cf80abad8f64dffb3faee6206503100 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:42.168039 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba275239-dd5d-4f22-8f84-e33815521da6 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:42.184903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 144/309] 10.222.0.72 () {60 vars in 1134 bytes} [Mon Aug 29 22:37:41 2022] POST /identity/v3/groups => generated 229 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:37:42.270104 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81528ff6-a2d2-4b42-a9d9-d09a8994599f None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:42.270430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81528ff6-a2d2-4b42-a9d9-d09a8994599f None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:42.270893 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81528ff6-a2d2-4b42-a9d9-d09a8994599f None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:42.272125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 145/310] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:37:42.279862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed727b8-23ec-4142-bdb9-4ef2208d90f4 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:42.280549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed727b8-23ec-4142-bdb9-4ef2208d90f4 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:42.281028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed727b8-23ec-4142-bdb9-4ef2208d90f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:42.300029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba275239-dd5d-4f22-8f84-e33815521da6 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:42.310090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-eed727b8-23ec-4142-bdb9-4ef2208d90f4 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:42.312159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-eed727b8-23ec-4142-bdb9-4ef2208d90f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:42.344498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670631e-82ca-420e-a0ce-885255b59b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:42.345137 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670631e-82ca-420e-a0ce-885255b59b2d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:42.345416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670631e-82ca-420e-a0ce-885255b59b2d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:42.345685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670631e-82ca-420e-a0ce-885255b59b2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:42.346422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670631e-82ca-420e-a0ce-885255b59b2d None admin] RBAC: Adding query filter params (role.id=071203b5be0a4780aa2292e2be3fe13c, user.id=8cf80abad8f64dffb3faee6206503100, scope.system=all) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:42.346727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670631e-82ca-420e-a0ce-885255b59b2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:42.348229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670631e-82ca-420e-a0ce-885255b59b2d None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:42.357936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 166/311] 10.222.0.72 () {56 vars in 1308 bytes} [Mon Aug 29 22:37:42 2022] GET /identity/v3/role_assignments?user.id=8cf80abad8f64dffb3faee6206503100&scope.system=all&role.id=071203b5be0a4780aa2292e2be3fe13c => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:42.395241 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:42.412801 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 146/312] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:42.699476 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670631e-82ca-420e-a0ce-885255b59b2d None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:42.754233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:42.808794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670631e-82ca-420e-a0ce-885255b59b2d None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:42.847942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2a5a2-48fd-47b2-afb0-c072d92048c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:42.848613 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2a5a2-48fd-47b2-afb0-c072d92048c8 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:42.848891 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2a5a2-48fd-47b2-afb0-c072d92048c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:42.849163 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2a5a2-48fd-47b2-afb0-c072d92048c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:42.861277 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2a5a2-48fd-47b2-afb0-c072d92048c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-9cf2a5a2-48fd-47b2-afb0-c072d92048c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:42.866229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:42.867081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:42.867863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:42.867863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:42.867863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:42.867863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:42.867863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:42.867863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:42.867863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:42.867863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:42.867863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:42.867863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:42.867863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:42.867863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:42.867863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 167/313] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:42.874974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed727b8-23ec-4142-bdb9-4ef2208d90f4 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:42.985406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed727b8-23ec-4142-bdb9-4ef2208d90f4 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:43.021663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbc91a-2445-4ce2-8ef4-71b7f6b1cb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:43.022207 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbc91a-2445-4ce2-8ef4-71b7f6b1cb2d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:43.022487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbc91a-2445-4ce2-8ef4-71b7f6b1cb2d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:43.022759 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbc91a-2445-4ce2-8ef4-71b7f6b1cb2d None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:43.023433 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbc91a-2445-4ce2-8ef4-71b7f6b1cb2d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:43.023730 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbc91a-2445-4ce2-8ef4-71b7f6b1cb2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:43.025157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbc91a-2445-4ce2-8ef4-71b7f6b1cb2d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:43.034536 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 147/314] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:43.039898 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2a5a2-48fd-47b2-afb0-c072d92048c8 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:43.152331 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2a5a2-48fd-47b2-afb0-c072d92048c8 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:43.164402 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:43.189625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9eae67-cf42-4353-8a3a-a5d424771591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:43.190266 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9eae67-cf42-4353-8a3a-a5d424771591 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:43.190546 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9eae67-cf42-4353-8a3a-a5d424771591 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:43.192975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9eae67-cf42-4353-8a3a-a5d424771591 None admin] PATH_INFO: `/v3/users/93759ace21a04c2fb7bf1f467220cd78` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:43.192975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9eae67-cf42-4353-8a3a-a5d424771591 None admin] RBAC: Authorizing `identity:get_user(user_id=93759ace21a04c2fb7bf1f467220cd78)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:43.193448 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9eae67-cf42-4353-8a3a-a5d424771591 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:43.195533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 168/315] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:43 2022] GET /identity/v3/users/93759ace21a04c2fb7bf1f467220cd78 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:43.201304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbc91a-2445-4ce2-8ef4-71b7f6b1cb2d None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:43.259244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:43.319486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbc91a-2445-4ce2-8ef4-71b7f6b1cb2d None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:43.356115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe880ab-fe79-4665-9060-d3e1a37906c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:43.356754 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe880ab-fe79-4665-9060-d3e1a37906c1 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:43.357029 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe880ab-fe79-4665-9060-d3e1a37906c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:43.357299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe880ab-fe79-4665-9060-d3e1a37906c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:43.434521 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe880ab-fe79-4665-9060-d3e1a37906c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:43.435977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe880ab-fe79-4665-9060-d3e1a37906c1 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:43.491802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:43.549854 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 148/316] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:43.555290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9eae67-cf42-4353-8a3a-a5d424771591 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:43.677832 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9eae67-cf42-4353-8a3a-a5d424771591 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:43.729219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663bf59-0cf2-4d26-9d66-b8b763b65d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:43.729859 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663bf59-0cf2-4d26-9d66-b8b763b65d66 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:43.730134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663bf59-0cf2-4d26-9d66-b8b763b65d66 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:43.730462 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663bf59-0cf2-4d26-9d66-b8b763b65d66 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:43.731618 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663bf59-0cf2-4d26-9d66-b8b763b65d66 None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:43.733110 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663bf59-0cf2-4d26-9d66-b8b763b65d66 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:43.735918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 169/317] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:43 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:43.745085 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe880ab-fe79-4665-9060-d3e1a37906c1 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:43.859439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe880ab-fe79-4665-9060-d3e1a37906c1 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:43.896913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585eb0b7-98c2-42f0-a482-9042f05b9a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:43.897530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585eb0b7-98c2-42f0-a482-9042f05b9a5a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:43.897806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585eb0b7-98c2-42f0-a482-9042f05b9a5a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:43.898077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585eb0b7-98c2-42f0-a482-9042f05b9a5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:43.898813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585eb0b7-98c2-42f0-a482-9042f05b9a5a None admin] RBAC: Adding query filter params (role.id=071203b5be0a4780aa2292e2be3fe13c, scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d, user.id=93759ace21a04c2fb7bf1f467220cd78) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:43.899118 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585eb0b7-98c2-42f0-a482-9042f05b9a5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:43.900575 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585eb0b7-98c2-42f0-a482-9042f05b9a5a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:43.907799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 149/318] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:37:43 2022] GET /identity/v3/role_assignments?user.id=93759ace21a04c2fb7bf1f467220cd78&scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d&role.id=071203b5be0a4780aa2292e2be3fe13c => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:44.017970 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3a686-e3d1-406b-b920-acce215cdf6e None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:44.018319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3a686-e3d1-406b-b920-acce215cdf6e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:44.018527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3a686-e3d1-406b-b920-acce215cdf6e None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:44.020247 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 170/319] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:44.025931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c77ac-5172-43e5-8982-9314d026dffb None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:44.026237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c77ac-5172-43e5-8982-9314d026dffb None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:44.026489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c77ac-5172-43e5-8982-9314d026dffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:44.046839 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-230c77ac-5172-43e5-8982-9314d026dffb None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:44.049016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-230c77ac-5172-43e5-8982-9314d026dffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:44.060239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:44.128933 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 150/320] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:44.325231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab708f-cd8e-4a13-994b-23ebc45553c6 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:44.325541 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab708f-cd8e-4a13-994b-23ebc45553c6 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:44.326028 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab708f-cd8e-4a13-994b-23ebc45553c6 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:44.327579 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 171/321] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:44.333460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc19277-5362-404a-9dfc-fc5165f2222a None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:44.333919 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc19277-5362-404a-9dfc-fc5165f2222a None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:44.334014 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc19277-5362-404a-9dfc-fc5165f2222a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:44.354906 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-cdc19277-5362-404a-9dfc-fc5165f2222a None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:44.356166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-cdc19277-5362-404a-9dfc-fc5165f2222a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:44.395615 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab708f-cd8e-4a13-994b-23ebc45553c6 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:44.444825 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 151/322] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:44.454357 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:44.510894 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab708f-cd8e-4a13-994b-23ebc45553c6 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:44.513115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11e3f6-ca66-4ad4-888a-dc111953402d None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:44.513402 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11e3f6-ca66-4ad4-888a-dc111953402d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:44.513674 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11e3f6-ca66-4ad4-888a-dc111953402d None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:44.515021 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 152/323] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:37:44.520315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef80ab-00af-4983-9306-ce495fbe57e2 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:44.520603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef80ab-00af-4983-9306-ce495fbe57e2 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:44.520881 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef80ab-00af-4983-9306-ce495fbe57e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:44.539617 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-65ef80ab-00af-4983-9306-ce495fbe57e2 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:44.540849 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-65ef80ab-00af-4983-9306-ce495fbe57e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:44.549336 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d889de-e1a4-47e6-a681-bb7db202b307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:44.550048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d889de-e1a4-47e6-a681-bb7db202b307 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:44.550330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d889de-e1a4-47e6-a681-bb7db202b307 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:44.550600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d889de-e1a4-47e6-a681-bb7db202b307 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:44.563176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d889de-e1a4-47e6-a681-bb7db202b307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-e1d889de-e1a4-47e6-a681-bb7db202b307 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:44.568766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:44.569625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:44.570578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:44.570578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:44.570578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:44.570578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:44.570578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:44.570578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:44.570578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:44.570578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:44.570578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:44.570578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:44.570578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:44.570578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:44.570578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 172/324] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:37:44.575706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d889de-e1a4-47e6-a681-bb7db202b307 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:44.617307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 153/325] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:44.687368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d889de-e1a4-47e6-a681-bb7db202b307 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:44.695679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:44.718090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef80ab-00af-4983-9306-ce495fbe57e2 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:44.721768 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:44.725736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6da8a-8f56-45b8-8c80-f33d299863f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:44.726650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6da8a-8f56-45b8-8c80-f33d299863f9 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:44.726930 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6da8a-8f56-45b8-8c80-f33d299863f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:44.727242 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6da8a-8f56-45b8-8c80-f33d299863f9 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:44.727932 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6da8a-8f56-45b8-8c80-f33d299863f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:44.728281 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6da8a-8f56-45b8-8c80-f33d299863f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:44.736425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6da8a-8f56-45b8-8c80-f33d299863f9 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:44.743118 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 173/326] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:44.743844 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6da8a-8f56-45b8-8c80-f33d299863f9 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:44.833168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef80ab-00af-4983-9306-ce495fbe57e2 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:44.862324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6da8a-8f56-45b8-8c80-f33d299863f9 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:44.875850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ece6c-9859-4919-ade1-b9ecbb0273ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:44.876881 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ece6c-9859-4919-ade1-b9ecbb0273ef None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:44.877165 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ece6c-9859-4919-ade1-b9ecbb0273ef None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:44.877448 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ece6c-9859-4919-ade1-b9ecbb0273ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:44.878718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ece6c-9859-4919-ade1-b9ecbb0273ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:44.880331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ece6c-9859-4919-ade1-b9ecbb0273ef None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:44.881925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 154/327] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:37:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:44.887417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ece6c-9859-4919-ade1-b9ecbb0273ef None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:44.907162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcf3a9-4a5f-4703-97b1-2edae4213cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:44.907901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcf3a9-4a5f-4703-97b1-2edae4213cc2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:44.908183 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcf3a9-4a5f-4703-97b1-2edae4213cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:44.908486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcf3a9-4a5f-4703-97b1-2edae4213cc2 None admin] PATH_INFO: `/v3/users/91c1c279835e43c9a2150f62182e46b7` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:44.909628 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcf3a9-4a5f-4703-97b1-2edae4213cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=91c1c279835e43c9a2150f62182e46b7)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:44.911081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcf3a9-4a5f-4703-97b1-2edae4213cc2 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:44.912909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 174/328] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:44 2022] GET /identity/v3/users/91c1c279835e43c9a2150f62182e46b7 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:44.913490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcf3a9-4a5f-4703-97b1-2edae4213cc2 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:44.956957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:44.965245 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:44.996095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ece6c-9859-4919-ade1-b9ecbb0273ef None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:45.027412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcf3a9-4a5f-4703-97b1-2edae4213cc2 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:45.030568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8e098-6e9a-450a-83a6-f8bf2ab66438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:45.031240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8e098-6e9a-450a-83a6-f8bf2ab66438 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:45.032042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8e098-6e9a-450a-83a6-f8bf2ab66438 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:45.032349 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8e098-6e9a-450a-83a6-f8bf2ab66438 None admin] PATH_INFO: `/v3/groups` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:45.032992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8e098-6e9a-450a-83a6-f8bf2ab66438 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:45.034443 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8e098-6e9a-450a-83a6-f8bf2ab66438 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:45.061630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8736057-091c-4d94-82fb-87becd6ff8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:45.062261 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8736057-091c-4d94-82fb-87becd6ff8c2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:45.062713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8736057-091c-4d94-82fb-87becd6ff8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:45.062991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8736057-091c-4d94-82fb-87becd6ff8c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:45.074101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8736057-091c-4d94-82fb-87becd6ff8c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-c8736057-091c-4d94-82fb-87becd6ff8c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:45.080326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:45.083424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:45.084221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:45.084221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:45.084221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:45.084221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:45.084221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:45.084221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:45.084221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:45.084221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:45.084221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:45.084221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:45.084221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:45.084221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:45.084221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 175/329] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:45.084221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8736057-091c-4d94-82fb-87becd6ff8c2 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:45.135996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 155/330] 10.222.0.72 () {60 vars in 1134 bytes} [Mon Aug 29 22:37:44 2022] POST /identity/v3/groups => generated 226 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:37:45.135996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8e098-6e9a-450a-83a6-f8bf2ab66438 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:45.190989 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:45.198741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8736057-091c-4d94-82fb-87becd6ff8c2 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:45.241705 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0aad4-6f69-4508-8d8a-937cd8ea0ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:45.242367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0aad4-6f69-4508-8d8a-937cd8ea0ba0 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:45.242653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0aad4-6f69-4508-8d8a-937cd8ea0ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:45.242929 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0aad4-6f69-4508-8d8a-937cd8ea0ba0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:45.243676 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0aad4-6f69-4508-8d8a-937cd8ea0ba0 None admin] RBAC: Adding query filter params (role.id=bebe72a018ea47b992e9e6715060fadb, user.id=91c1c279835e43c9a2150f62182e46b7, scope.system=all) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:45.243986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0aad4-6f69-4508-8d8a-937cd8ea0ba0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:45.245547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0aad4-6f69-4508-8d8a-937cd8ea0ba0 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:45.259357 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 176/331] 10.222.0.72 () {56 vars in 1308 bytes} [Mon Aug 29 22:37:45 2022] GET /identity/v3/role_assignments?user.id=91c1c279835e43c9a2150f62182e46b7&scope.system=all&role.id=bebe72a018ea47b992e9e6715060fadb => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:45.276055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8e098-6e9a-450a-83a6-f8bf2ab66438 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:45.318557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:45.324227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495139a6-ecf9-4568-88be-58368f689cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:45.324854 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495139a6-ecf9-4568-88be-58368f689cd4 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:45.325142 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495139a6-ecf9-4568-88be-58368f689cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:45.325422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495139a6-ecf9-4568-88be-58368f689cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:45.326119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495139a6-ecf9-4568-88be-58368f689cd4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:45.326422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495139a6-ecf9-4568-88be-58368f689cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:45.327855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495139a6-ecf9-4568-88be-58368f689cd4 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:45.339110 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 156/332] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:45.345978 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0aad4-6f69-4508-8d8a-937cd8ea0ba0 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:45.477240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0aad4-6f69-4508-8d8a-937cd8ea0ba0 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:45.521214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bceaf-4751-46e7-94f3-c4e81e7550f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:45.521898 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bceaf-4751-46e7-94f3-c4e81e7550f6 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:45.522179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bceaf-4751-46e7-94f3-c4e81e7550f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:45.522453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bceaf-4751-46e7-94f3-c4e81e7550f6 None admin] PATH_INFO: `/v3/users/8cf80abad8f64dffb3faee6206503100` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:45.523618 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bceaf-4751-46e7-94f3-c4e81e7550f6 None admin] RBAC: Authorizing `identity:get_user(user_id=8cf80abad8f64dffb3faee6206503100)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:45.525112 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bceaf-4751-46e7-94f3-c4e81e7550f6 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:45.526947 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 177/333] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:45 2022] GET /identity/v3/users/8cf80abad8f64dffb3faee6206503100 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:45.532858 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495139a6-ecf9-4568-88be-58368f689cd4 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:45.656758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495139a6-ecf9-4568-88be-58368f689cd4 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:45.710518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a14e-74f0-43d3-8769-27642a2674ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:45.711493 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a14e-74f0-43d3-8769-27642a2674ba None admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:45.711980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a14e-74f0-43d3-8769-27642a2674ba None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:45.712530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a14e-74f0-43d3-8769-27642a2674ba None admin] PATH_INFO: `/v3/system/users/8cf80abad8f64dffb3faee6206503100/roles/071203b5be0a4780aa2292e2be3fe13c` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:45.714383 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006a14e-74f0-43d3-8769-27642a2674ba None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8cf80abad8f64dffb3faee6206503100, role_id=071203b5be0a4780aa2292e2be3fe13c)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:45.715824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006a14e-74f0-43d3-8769-27642a2674ba None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:45.788711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 157/334] 10.222.0.72 () {58 vars in 1334 bytes} [Mon Aug 29 22:37:45 2022] PUT /identity/v3/system/users/8cf80abad8f64dffb3faee6206503100/roles/071203b5be0a4780aa2292e2be3fe13c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:37:47.694172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632d689-89ce-4758-b6b7-54f0bd3ec4d6 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:47.694707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632d689-89ce-4758-b6b7-54f0bd3ec4d6 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:47.694922 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632d689-89ce-4758-b6b7-54f0bd3ec4d6 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:47.696801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 178/335] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:47.712148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c227d-8033-47b4-8d88-663121970d17 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:47.712709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c227d-8033-47b4-8d88-663121970d17 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:47.712709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c227d-8033-47b4-8d88-663121970d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:47.741398 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-265c227d-8033-47b4-8d88-663121970d17 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:47.742650 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-265c227d-8033-47b4-8d88-663121970d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:47.807481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:47.825588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 158/336] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:47.873540 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36ecf4-4ccb-4c43-9fc2-69343f5d1656 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:47.873867 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36ecf4-4ccb-4c43-9fc2-69343f5d1656 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:47.874100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36ecf4-4ccb-4c43-9fc2-69343f5d1656 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:47.876741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 179/337] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:47.882250 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269250d-2476-4576-8092-ec7ad4d441b1 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:47.882539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269250d-2476-4576-8092-ec7ad4d441b1 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:47.882817 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269250d-2476-4576-8092-ec7ad4d441b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:47.902950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-9269250d-2476-4576-8092-ec7ad4d441b1 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:47.904165 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9269250d-2476-4576-8092-ec7ad4d441b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:47.988411 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 159/338] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:48.270698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36ecf4-4ccb-4c43-9fc2-69343f5d1656 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:48.299503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:48.391288 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36ecf4-4ccb-4c43-9fc2-69343f5d1656 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:48.396218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269250d-2476-4576-8092-ec7ad4d441b1 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:48.435403 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eddbb7-505d-418a-a906-c1063edfc97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:48.440072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eddbb7-505d-418a-a906-c1063edfc97e None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:48.440072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eddbb7-505d-418a-a906-c1063edfc97e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:48.440072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eddbb7-505d-418a-a906-c1063edfc97e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:48.453734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eddbb7-505d-418a-a906-c1063edfc97e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-c3eddbb7-505d-418a-a906-c1063edfc97e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:48.460221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:48.461187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:48.462004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:48.462004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:48.462004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:48.462004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:48.462004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:48.462004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:48.462004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:48.462004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:48.462004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:48.462004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:48.462004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:48.462004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:48.465376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 180/339] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:37:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:48.470288 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eddbb7-505d-418a-a906-c1063edfc97e None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:48.572769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:48.594272 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eddbb7-505d-418a-a906-c1063edfc97e None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:48.605300 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269250d-2476-4576-8092-ec7ad4d441b1 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:48.633731 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:48.637812 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced62f5c-59ec-49b5-b17f-69bf81028c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:48.638529 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced62f5c-59ec-49b5-b17f-69bf81028c98 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:48.638816 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced62f5c-59ec-49b5-b17f-69bf81028c98 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:48.639093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced62f5c-59ec-49b5-b17f-69bf81028c98 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:48.639821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced62f5c-59ec-49b5-b17f-69bf81028c98 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:48.640132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced62f5c-59ec-49b5-b17f-69bf81028c98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:48.642352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced62f5c-59ec-49b5-b17f-69bf81028c98 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:48.656663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 181/340] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:37:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:48.658108 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92caa0-046f-4929-b8c8-e62c7f2c2705 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:48.658392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92caa0-046f-4929-b8c8-e62c7f2c2705 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:48.658725 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92caa0-046f-4929-b8c8-e62c7f2c2705 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:48.660509 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 182/341] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:48.661669 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee4dca-1443-4929-b5ee-d09f2a3298ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:48.661830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76519540-7d46-4cc4-b971-5dbeef942efc None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:48.661957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76519540-7d46-4cc4-b971-5dbeef942efc None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:48.662230 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76519540-7d46-4cc4-b971-5dbeef942efc None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:48.662887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee4dca-1443-4929-b5ee-d09f2a3298ec None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:48.663322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee4dca-1443-4929-b5ee-d09f2a3298ec None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:48.663732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee4dca-1443-4929-b5ee-d09f2a3298ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:48.663847 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 183/342] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:48.664501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76519540-7d46-4cc4-b971-5dbeef942efc None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:48.685363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee4dca-1443-4929-b5ee-d09f2a3298ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-ddee4dca-1443-4929-b5ee-d09f2a3298ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:48.691685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:48.692642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:48.693546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:48.693546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:48.693546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:48.693546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:48.693546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:48.693546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:48.693546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:48.693546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:48.693546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:48.693546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:48.693546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:48.693546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:48.696299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 160/343] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:48.697797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00061615-0894-48c7-bbc0-2b47f3a4f0b6 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:48.698315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00061615-0894-48c7-bbc0-2b47f3a4f0b6 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:48.698794 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00061615-0894-48c7-bbc0-2b47f3a4f0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:48.722283 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-00061615-0894-48c7-bbc0-2b47f3a4f0b6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:48.724696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-00061615-0894-48c7-bbc0-2b47f3a4f0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:48.795901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76519540-7d46-4cc4-b971-5dbeef942efc None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:48.814508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 161/344] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:48.820431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7c5d5-7652-46a7-b125-f1e1c6d3ca15 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:48.821089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7c5d5-7652-46a7-b125-f1e1c6d3ca15 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:48.821625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7c5d5-7652-46a7-b125-f1e1c6d3ca15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:48.838643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754526a-83c1-4186-8235-25446805f37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:48.839178 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754526a-83c1-4186-8235-25446805f37c None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:48.839461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754526a-83c1-4186-8235-25446805f37c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:48.839739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754526a-83c1-4186-8235-25446805f37c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:48.855869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-9ba7c5d5-7652-46a7-b125-f1e1c6d3ca15 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:48.857767 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:48.858291 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9ba7c5d5-7652-46a7-b125-f1e1c6d3ca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:48.920795 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754526a-83c1-4186-8235-25446805f37c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:48.922508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754526a-83c1-4186-8235-25446805f37c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:48.981270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 162/345] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:48.982475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7c5d5-7652-46a7-b125-f1e1c6d3ca15 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:49.043073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 184/346] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:49.046921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:49.047823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b96815-b10e-442e-8eff-245c665de43a None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:49.048148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b96815-b10e-442e-8eff-245c665de43a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:49.048459 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b96815-b10e-442e-8eff-245c665de43a None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:49.050311 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 185/347] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:49.057518 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d890df-dbe6-40d5-947e-c26a74fc7ce6 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:49.057798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d890df-dbe6-40d5-947e-c26a74fc7ce6 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:49.058081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d890df-dbe6-40d5-947e-c26a74fc7ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:49.082329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-96d890df-dbe6-40d5-947e-c26a74fc7ce6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:49.083591 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-96d890df-dbe6-40d5-947e-c26a74fc7ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:49.140895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:49.159094 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7c5d5-7652-46a7-b125-f1e1c6d3ca15 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:49.167068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 186/348] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:49.168058 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d890df-dbe6-40d5-947e-c26a74fc7ce6 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:49.232934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95de19-6448-47a6-a637-a58b6651ff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:49.233622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95de19-6448-47a6-a637-a58b6651ff52 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:49.233931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95de19-6448-47a6-a637-a58b6651ff52 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:49.234827 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95de19-6448-47a6-a637-a58b6651ff52 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:49.235553 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95de19-6448-47a6-a637-a58b6651ff52 None admin] RBAC: Adding query filter params (name=member) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:49.235854 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95de19-6448-47a6-a637-a58b6651ff52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:49.237326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95de19-6448-47a6-a637-a58b6651ff52 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:49.249197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 163/349] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:49.254713 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95de19-6448-47a6-a637-a58b6651ff52 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:49.327617 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d890df-dbe6-40d5-947e-c26a74fc7ce6 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:49.381760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055102f4-04c5-42ca-9419-e0e957b9ed60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:49.382419 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055102f4-04c5-42ca-9419-e0e957b9ed60 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:49.382703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055102f4-04c5-42ca-9419-e0e957b9ed60 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:49.382983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055102f4-04c5-42ca-9419-e0e957b9ed60 None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:49.384655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055102f4-04c5-42ca-9419-e0e957b9ed60 None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:49.385872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055102f4-04c5-42ca-9419-e0e957b9ed60 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:49.387824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 187/350] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:49 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:49.396288 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055102f4-04c5-42ca-9419-e0e957b9ed60 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:49.410273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:49.413509 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95de19-6448-47a6-a637-a58b6651ff52 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:49.460460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bfbed-d58b-4272-b363-88867056b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:49.461525 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bfbed-d58b-4272-b363-88867056b5ba None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:49.462022 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bfbed-d58b-4272-b363-88867056b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:49.462737 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bfbed-d58b-4272-b363-88867056b5ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:49.471991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:49.559880 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055102f4-04c5-42ca-9419-e0e957b9ed60 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:49.604083 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bfbed-d58b-4272-b363-88867056b5ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:49.605614 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bfbed-d58b-4272-b363-88867056b5ba None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:49.619245 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fa3f9-bd79-4ae6-88da-d566a20908f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:49.619906 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fa3f9-bd79-4ae6-88da-d566a20908f2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:49.620215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fa3f9-bd79-4ae6-88da-d566a20908f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:49.620639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fa3f9-bd79-4ae6-88da-d566a20908f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:49.636347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fa3f9-bd79-4ae6-88da-d566a20908f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-290fa3f9-bd79-4ae6-88da-d566a20908f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:49.642171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:49.643134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:49.643959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:49.643959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:49.643959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:49.643959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:49.643959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:49.643959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:49.643959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:49.643959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:49.643959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:49.643959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:49.643959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:37:49.643959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:49.643959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 188/351] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:49.644676 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fa3f9-bd79-4ae6-88da-d566a20908f2 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:49.763690 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:49.769234 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 164/352] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 22:37:49.770117 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bfbed-d58b-4272-b363-88867056b5ba None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:49.779116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fa3f9-bd79-4ae6-88da-d566a20908f2 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:49.781312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:49.824946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8b2de-7874-47ed-acf4-2ac025332ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:49.825624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8b2de-7874-47ed-acf4-2ac025332ba6 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:49.825836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8b2de-7874-47ed-acf4-2ac025332ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:49.826154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8b2de-7874-47ed-acf4-2ac025332ba6 None admin] PATH_INFO: `/v3/groups/edda4bcf37024c2890a06f051aee45f2` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:49.835961 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8b2de-7874-47ed-acf4-2ac025332ba6 None admin] RBAC: Authorizing `identity:get_group(group_id=edda4bcf37024c2890a06f051aee45f2)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:49.837484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8b2de-7874-47ed-acf4-2ac025332ba6 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:49.844259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 189/353] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Aug 29 22:37:49 2022] GET /identity/v3/groups/edda4bcf37024c2890a06f051aee45f2 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:49.844259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8b2de-7874-47ed-acf4-2ac025332ba6 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:49.927679 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bfbed-d58b-4272-b363-88867056b5ba None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:49.983131 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dee8d8-5343-49f4-bd55-f5e4c169fac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:49.983867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dee8d8-5343-49f4-bd55-f5e4c169fac8 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:49.984204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dee8d8-5343-49f4-bd55-f5e4c169fac8 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:49.984512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dee8d8-5343-49f4-bd55-f5e4c169fac8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:49.990096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8b2de-7874-47ed-acf4-2ac025332ba6 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:49.997836 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dee8d8-5343-49f4-bd55-f5e4c169fac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-d2dee8d8-5343-49f4-bd55-f5e4c169fac8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:50.003574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:50.004662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:50.005469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:50.005469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:50.005469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:50.005469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:50.005469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:50.005469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:50.005469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:50.005469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:50.005469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:50.005469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:50.005469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:50.005469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:50.005469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 165/354] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:50.006101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dee8d8-5343-49f4-bd55-f5e4c169fac8 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:50.042096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c76dc9-e786-4cb6-ba9f-8310c0ea3cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:50.042633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c76dc9-e786-4cb6-ba9f-8310c0ea3cc7 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:50.042910 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c76dc9-e786-4cb6-ba9f-8310c0ea3cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:50.043181 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c76dc9-e786-4cb6-ba9f-8310c0ea3cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:50.043851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c76dc9-e786-4cb6-ba9f-8310c0ea3cc7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:50.044152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c76dc9-e786-4cb6-ba9f-8310c0ea3cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:50.045576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c76dc9-e786-4cb6-ba9f-8310c0ea3cc7 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:50.055653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 190/355] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:50.056451 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c76dc9-e786-4cb6-ba9f-8310c0ea3cc7 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:50.085743 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:50.089123 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:50.138289 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dee8d8-5343-49f4-bd55-f5e4c169fac8 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:50.179854 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb17437-7c5e-492d-b00d-630fbffb6136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:50.180652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb17437-7c5e-492d-b00d-630fbffb6136 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:50.180800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c76dc9-e786-4cb6-ba9f-8310c0ea3cc7 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:50.181014 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb17437-7c5e-492d-b00d-630fbffb6136 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:50.181293 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb17437-7c5e-492d-b00d-630fbffb6136 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:50.194323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb17437-7c5e-492d-b00d-630fbffb6136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-9eb17437-7c5e-492d-b00d-630fbffb6136 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:50.199413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:50.200358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:50.201213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:50.201213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:50.201213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:50.201213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:50.201213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:50.201213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:50.201213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:50.201213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:50.201213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:50.201213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:50.201213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:50.201213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:50.201213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 166/356] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:37:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:50.201871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb17437-7c5e-492d-b00d-630fbffb6136 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:50.232310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc91b04-b7bd-4fe5-830d-3b0766a6caba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:50.232995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc91b04-b7bd-4fe5-830d-3b0766a6caba None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:50.233249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc91b04-b7bd-4fe5-830d-3b0766a6caba None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:50.233536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc91b04-b7bd-4fe5-830d-3b0766a6caba None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:50.235802 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc91b04-b7bd-4fe5-830d-3b0766a6caba None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:50.237438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc91b04-b7bd-4fe5-830d-3b0766a6caba None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:50.239111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 191/357] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:50 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:50.239979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc91b04-b7bd-4fe5-830d-3b0766a6caba None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:50.336788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb17437-7c5e-492d-b00d-630fbffb6136 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:50.362948 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:50.367233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:50.373393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc91b04-b7bd-4fe5-830d-3b0766a6caba None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:50.386118 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd00009-79e4-4667-b26d-02aa0fba3091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:50.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd00009-79e4-4667-b26d-02aa0fba3091 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:50.387034 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd00009-79e4-4667-b26d-02aa0fba3091 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:50.387306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd00009-79e4-4667-b26d-02aa0fba3091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:50.388054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd00009-79e4-4667-b26d-02aa0fba3091 None admin] RBAC: Adding query filter params (group.id=edda4bcf37024c2890a06f051aee45f2, role.id=da30366a448b4b1f902c8160690d366e, scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:50.388397 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd00009-79e4-4667-b26d-02aa0fba3091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:50.389866 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd00009-79e4-4667-b26d-02aa0fba3091 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:50.400884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 167/358] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Aug 29 22:37:50 2022] GET /identity/v3/role_assignments?group.id=edda4bcf37024c2890a06f051aee45f2&scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5&role.id=da30366a448b4b1f902c8160690d366e => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:50.402905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e170e4c-daf8-46eb-a27b-abd64940e4b8 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:50.402905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e170e4c-daf8-46eb-a27b-abd64940e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:50.402905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e170e4c-daf8-46eb-a27b-abd64940e4b8 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:50.404022 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 168/359] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:50.404823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e170e4c-daf8-46eb-a27b-abd64940e4b8 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:50.415666 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f988a4-ab61-4211-9ea9-7fe3ae54bbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:50.419035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f988a4-ab61-4211-9ea9-7fe3ae54bbc2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:50.419035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f988a4-ab61-4211-9ea9-7fe3ae54bbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:50.419035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f988a4-ab61-4211-9ea9-7fe3ae54bbc2 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:50.423457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f988a4-ab61-4211-9ea9-7fe3ae54bbc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:50.423707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f988a4-ab61-4211-9ea9-7fe3ae54bbc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:50.425224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f988a4-ab61-4211-9ea9-7fe3ae54bbc2 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:50.443052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 192/360] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:50.443833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f988a4-ab61-4211-9ea9-7fe3ae54bbc2 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:50.574782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e170e4c-daf8-46eb-a27b-abd64940e4b8 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:50.597698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f988a4-ab61-4211-9ea9-7fe3ae54bbc2 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:50.625154 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6702a-f4a6-455b-a05e-fd687c76dc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:50.626728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6702a-f4a6-455b-a05e-fd687c76dc08 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:50.626728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6702a-f4a6-455b-a05e-fd687c76dc08 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:50.626728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6702a-f4a6-455b-a05e-fd687c76dc08 None admin] PATH_INFO: `/v3/users/8cf80abad8f64dffb3faee6206503100` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:50.629199 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6702a-f4a6-455b-a05e-fd687c76dc08 None admin] RBAC: Authorizing `identity:get_user(user_id=8cf80abad8f64dffb3faee6206503100)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:50.631447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6702a-f4a6-455b-a05e-fd687c76dc08 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:50.633560 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 169/361] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:37:50 2022] GET /identity/v3/users/8cf80abad8f64dffb3faee6206503100 => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:50.634715 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6702a-f4a6-455b-a05e-fd687c76dc08 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:50.650507 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508811e-a0b8-49d6-85e3-a424c2cd2c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:50.651909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508811e-a0b8-49d6-85e3-a424c2cd2c34 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:50.652433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508811e-a0b8-49d6-85e3-a424c2cd2c34 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:50.652896 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508811e-a0b8-49d6-85e3-a424c2cd2c34 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:50.653799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508811e-a0b8-49d6-85e3-a424c2cd2c34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:50.654299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508811e-a0b8-49d6-85e3-a424c2cd2c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:50.656069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508811e-a0b8-49d6-85e3-a424c2cd2c34 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:50.670620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 193/362] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:37:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:50.672447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d40ee8-b90f-4844-b1e1-4fa25dc80786 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:50.672789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d40ee8-b90f-4844-b1e1-4fa25dc80786 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:50.673025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d40ee8-b90f-4844-b1e1-4fa25dc80786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:50.693934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-50d40ee8-b90f-4844-b1e1-4fa25dc80786 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:50.695111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-50d40ee8-b90f-4844-b1e1-4fa25dc80786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:50.713786 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:50.716771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:50.776641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6702a-f4a6-455b-a05e-fd687c76dc08 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:50.788282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 194/363] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:50.788282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d40ee8-b90f-4844-b1e1-4fa25dc80786 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:50.826430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fe02a-7861-43a9-9e4d-072ec5246abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:50.827090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fe02a-7861-43a9-9e4d-072ec5246abe None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:50.827375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fe02a-7861-43a9-9e4d-072ec5246abe None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:50.827687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fe02a-7861-43a9-9e4d-072ec5246abe None admin] PATH_INFO: `/v3/groups/edda4bcf37024c2890a06f051aee45f2` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:50.830996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fe02a-7861-43a9-9e4d-072ec5246abe None admin] RBAC: Authorizing `identity:get_group(group_id=edda4bcf37024c2890a06f051aee45f2)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:50.832738 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fe02a-7861-43a9-9e4d-072ec5246abe None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:50.835425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 170/364] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Aug 29 22:37:50 2022] GET /identity/v3/groups/edda4bcf37024c2890a06f051aee45f2 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:50.836238 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fe02a-7861-43a9-9e4d-072ec5246abe None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:50.920825 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d40ee8-b90f-4844-b1e1-4fa25dc80786 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:50.974230 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98739a33-c1eb-4b66-a91f-b514051cf2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:50.974869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98739a33-c1eb-4b66-a91f-b514051cf2da None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:50.975435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98739a33-c1eb-4b66-a91f-b514051cf2da None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:50.975719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98739a33-c1eb-4b66-a91f-b514051cf2da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:50.993324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fe02a-7861-43a9-9e4d-072ec5246abe None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:51.003818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:51.028615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:51.044224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5767a77-1b7f-461a-947c-5840f7cb773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:51.044912 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5767a77-1b7f-461a-947c-5840f7cb773f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:51.045198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5767a77-1b7f-461a-947c-5840f7cb773f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:51.045474 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5767a77-1b7f-461a-947c-5840f7cb773f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:51.046209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5767a77-1b7f-461a-947c-5840f7cb773f None admin] RBAC: Adding query filter params (role.id=071203b5be0a4780aa2292e2be3fe13c, user.id=8cf80abad8f64dffb3faee6206503100, scope.system=all) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:51.047179 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5767a77-1b7f-461a-947c-5840f7cb773f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:51.050431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5767a77-1b7f-461a-947c-5840f7cb773f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:51.064095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98739a33-c1eb-4b66-a91f-b514051cf2da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:51.065336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 171/365] 10.222.0.72 () {56 vars in 1308 bytes} [Mon Aug 29 22:37:50 2022] GET /identity/v3/role_assignments?user.id=8cf80abad8f64dffb3faee6206503100&scope.system=all&role.id=071203b5be0a4780aa2292e2be3fe13c => generated 510 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:51.065719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98739a33-c1eb-4b66-a91f-b514051cf2da None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:51.066057 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5767a77-1b7f-461a-947c-5840f7cb773f None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:51.192005 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 195/366] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:51.192991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98739a33-c1eb-4b66-a91f-b514051cf2da None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:51.218076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5767a77-1b7f-461a-947c-5840f7cb773f None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:51.262540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5a48f-4b35-405a-8262-4d3c099bc8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:51.263180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5a48f-4b35-405a-8262-4d3c099bc8d7 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:51.263341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:51.263451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5a48f-4b35-405a-8262-4d3c099bc8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:51.263717 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5a48f-4b35-405a-8262-4d3c099bc8d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:51.327792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:51.330747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98739a33-c1eb-4b66-a91f-b514051cf2da None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:51.354749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5a48f-4b35-405a-8262-4d3c099bc8d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:51.356285 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5a48f-4b35-405a-8262-4d3c099bc8d7 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:51.384469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ad996-0b82-4f1f-847c-68427536a794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:51.385101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ad996-0b82-4f1f-847c-68427536a794 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:51.385382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ad996-0b82-4f1f-847c-68427536a794 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:51.385652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ad996-0b82-4f1f-847c-68427536a794 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:51.386396 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ad996-0b82-4f1f-847c-68427536a794 None admin] RBAC: Adding query filter params (group.id=edda4bcf37024c2890a06f051aee45f2, role.id=bebe72a018ea47b992e9e6715060fadb, scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:51.386704 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ad996-0b82-4f1f-847c-68427536a794 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:51.388247 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ad996-0b82-4f1f-847c-68427536a794 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:51.395341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 196/367] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Aug 29 22:37:51 2022] GET /identity/v3/role_assignments?group.id=edda4bcf37024c2890a06f051aee45f2&scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5&role.id=bebe72a018ea47b992e9e6715060fadb => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:51.400747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ad996-0b82-4f1f-847c-68427536a794 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:51.517147 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 172/368] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:51.518098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5a48f-4b35-405a-8262-4d3c099bc8d7 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:51.560764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ad996-0b82-4f1f-847c-68427536a794 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:51.585663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:51.618939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29487be3-07bf-47f2-988a-e35d82225bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:51.620284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29487be3-07bf-47f2-988a-e35d82225bb0 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:51.620918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29487be3-07bf-47f2-988a-e35d82225bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:51.621448 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29487be3-07bf-47f2-988a-e35d82225bb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:51.644617 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29487be3-07bf-47f2-988a-e35d82225bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:51.645275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-29487be3-07bf-47f2-988a-e35d82225bb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:51.659410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:51.660446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:51.661237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:51.661237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:51.661237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:51.661237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:51.661237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:51.661237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:51.661237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:51.661237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:51.661237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:51.661237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:51.661237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:51.661237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:51.662296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 197/369] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:37:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:51.663680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29487be3-07bf-47f2-988a-e35d82225bb0 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:51.677919 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5a48f-4b35-405a-8262-4d3c099bc8d7 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:51.729736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0649c-42ea-46f2-ba1e-f66601b6d32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:51.730599 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0649c-42ea-46f2-ba1e-f66601b6d32f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:51.731068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0649c-42ea-46f2-ba1e-f66601b6d32f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:51.731561 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0649c-42ea-46f2-ba1e-f66601b6d32f None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:51.734328 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0649c-42ea-46f2-ba1e-f66601b6d32f None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:51.743429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0649c-42ea-46f2-ba1e-f66601b6d32f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:51.743429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 173/370] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:51 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:51.743429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0649c-42ea-46f2-ba1e-f66601b6d32f None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:51.818501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29487be3-07bf-47f2-988a-e35d82225bb0 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:51.868033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bd059-d631-4d24-8c74-d5bc6a82d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:51.868977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bd059-d631-4d24-8c74-d5bc6a82d421 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:51.869440 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bd059-d631-4d24-8c74-d5bc6a82d421 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:51.869853 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bd059-d631-4d24-8c74-d5bc6a82d421 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:51.871360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bd059-d631-4d24-8c74-d5bc6a82d421 None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:51.873110 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bd059-d631-4d24-8c74-d5bc6a82d421 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:51.875831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 198/371] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:51 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:51.876857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bd059-d631-4d24-8c74-d5bc6a82d421 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:51.913082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0649c-42ea-46f2-ba1e-f66601b6d32f None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:51.941611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:51.964484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835c262-43d2-4141-804a-4a52e230f6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:51.965224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835c262-43d2-4141-804a-4a52e230f6ee None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:51.965510 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835c262-43d2-4141-804a-4a52e230f6ee None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:51.965784 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835c262-43d2-4141-804a-4a52e230f6ee None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:51.966469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835c262-43d2-4141-804a-4a52e230f6ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:51.966802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835c262-43d2-4141-804a-4a52e230f6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:51.969111 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835c262-43d2-4141-804a-4a52e230f6ee None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:51.981824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 174/372] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:51.982708 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835c262-43d2-4141-804a-4a52e230f6ee None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:52.002809 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:52.027207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bd059-d631-4d24-8c74-d5bc6a82d421 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:52.074507 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e8c58-1bd5-4ef2-a0a8-354912853e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:52.075265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e8c58-1bd5-4ef2-a0a8-354912853e75 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:52.075568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e8c58-1bd5-4ef2-a0a8-354912853e75 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:52.075846 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e8c58-1bd5-4ef2-a0a8-354912853e75 None admin] PATH_INFO: `/v3/groups/edda4bcf37024c2890a06f051aee45f2` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:52.078527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e8c58-1bd5-4ef2-a0a8-354912853e75 None admin] RBAC: Authorizing `identity:get_group(group_id=edda4bcf37024c2890a06f051aee45f2)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:52.080011 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e8c58-1bd5-4ef2-a0a8-354912853e75 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:52.081998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 199/373] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Aug 29 22:37:51 2022] GET /identity/v3/groups/edda4bcf37024c2890a06f051aee45f2 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:52.082875 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e8c58-1bd5-4ef2-a0a8-354912853e75 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:52.131101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835c262-43d2-4141-804a-4a52e230f6ee None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:52.177989 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e75b0-6532-40f8-be81-1d7f69b8c865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:52.178990 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e75b0-6532-40f8-be81-1d7f69b8c865 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:52.179568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e75b0-6532-40f8-be81-1d7f69b8c865 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:52.180033 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e75b0-6532-40f8-be81-1d7f69b8c865 None admin] PATH_INFO: `/v3/groups/edda4bcf37024c2890a06f051aee45f2` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:52.181762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e75b0-6532-40f8-be81-1d7f69b8c865 None admin] RBAC: Authorizing `identity:get_group(group_id=edda4bcf37024c2890a06f051aee45f2)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:52.184243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e75b0-6532-40f8-be81-1d7f69b8c865 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:52.186815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 175/374] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Aug 29 22:37:51 2022] GET /identity/v3/groups/edda4bcf37024c2890a06f051aee45f2 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:52.188725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e75b0-6532-40f8-be81-1d7f69b8c865 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:52.251529 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e8c58-1bd5-4ef2-a0a8-354912853e75 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:52.268806 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:52.307904 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ae8af-4586-4f62-9e30-f161d69aefab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:52.308109 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ae8af-4586-4f62-9e30-f161d69aefab None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:52.308434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ae8af-4586-4f62-9e30-f161d69aefab None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:52.308646 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ae8af-4586-4f62-9e30-f161d69aefab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:52.314107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:52.361508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e75b0-6532-40f8-be81-1d7f69b8c865 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:52.388758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ae8af-4586-4f62-9e30-f161d69aefab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:52.391336 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ae8af-4586-4f62-9e30-f161d69aefab None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:52.432544 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a7fec-dc76-4c6a-935d-cca3685dd514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:52.433885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a7fec-dc76-4c6a-935d-cca3685dd514 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:52.434559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a7fec-dc76-4c6a-935d-cca3685dd514 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:52.435345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a7fec-dc76-4c6a-935d-cca3685dd514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:52.436996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a7fec-dc76-4c6a-935d-cca3685dd514 None admin] RBAC: Adding query filter params (group.id=edda4bcf37024c2890a06f051aee45f2, role.id=bebe72a018ea47b992e9e6715060fadb, scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:52.438351 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a7fec-dc76-4c6a-935d-cca3685dd514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:52.441397 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a7fec-dc76-4c6a-935d-cca3685dd514 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:52.453681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 176/375] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Aug 29 22:37:52 2022] GET /identity/v3/role_assignments?group.id=edda4bcf37024c2890a06f051aee45f2&scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d&role.id=bebe72a018ea47b992e9e6715060fadb => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:52.455542 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a7fec-dc76-4c6a-935d-cca3685dd514 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:52.511811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 200/376] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:52.518191 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ae8af-4586-4f62-9e30-f161d69aefab None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:52.531437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:52.604249 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a7fec-dc76-4c6a-935d-cca3685dd514 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:52.639349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ae8af-4586-4f62-9e30-f161d69aefab None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:52.648497 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bc75e-ce51-49d5-b71c-90be49fe80ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:52.649419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bc75e-ce51-49d5-b71c-90be49fe80ce None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:52.649913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bc75e-ce51-49d5-b71c-90be49fe80ce None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:52.650386 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bc75e-ce51-49d5-b71c-90be49fe80ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:52.651379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bc75e-ce51-49d5-b71c-90be49fe80ce None admin] RBAC: Adding query filter params (group.id=edda4bcf37024c2890a06f051aee45f2, role.id=da30366a448b4b1f902c8160690d366e, scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:52.651967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bc75e-ce51-49d5-b71c-90be49fe80ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:52.653724 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bc75e-ce51-49d5-b71c-90be49fe80ce None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:52.662480 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 177/377] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Aug 29 22:37:52 2022] GET /identity/v3/role_assignments?group.id=edda4bcf37024c2890a06f051aee45f2&scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d&role.id=da30366a448b4b1f902c8160690d366e => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:52.689761 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30fc47-7dc1-4d56-a2fc-940220d7fd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:52.690499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30fc47-7dc1-4d56-a2fc-940220d7fd64 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:52.690778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30fc47-7dc1-4d56-a2fc-940220d7fd64 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:52.691050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30fc47-7dc1-4d56-a2fc-940220d7fd64 None admin] PATH_INFO: `/v3/projects/3c5435e2f5ae455ab9a7fc1e7c010ec4` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:52.692489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30fc47-7dc1-4d56-a2fc-940220d7fd64 None admin] RBAC: Authorizing `identity:get_project(project_id=3c5435e2f5ae455ab9a7fc1e7c010ec4)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:52.694041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30fc47-7dc1-4d56-a2fc-940220d7fd64 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:52.697232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3ab93-3826-4b39-a043-4e772a8d5bbb None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:52.697541 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3ab93-3826-4b39-a043-4e772a8d5bbb None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:52.697806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3ab93-3826-4b39-a043-4e772a8d5bbb None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:52.699484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 178/378] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:37:52.700674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 201/379] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:52 2022] GET /identity/v3/projects/3c5435e2f5ae455ab9a7fc1e7c010ec4 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:52.705448 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3ab93-3826-4b39-a043-4e772a8d5bbb None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:52.707828 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc065c9-37f3-4673-9f4c-95fa65bbe957 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:52.708105 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc065c9-37f3-4673-9f4c-95fa65bbe957 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:52.708416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc065c9-37f3-4673-9f4c-95fa65bbe957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:52.721301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:52.741364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-cdc065c9-37f3-4673-9f4c-95fa65bbe957 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:52.748861 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-cdc065c9-37f3-4673-9f4c-95fa65bbe957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:52.854662 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 202/380] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:52.861541 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3ab93-3826-4b39-a043-4e772a8d5bbb None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:52.904014 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdaebc0-b189-4d38-8183-e211a90cd8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:52.905030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdaebc0-b189-4d38-8183-e211a90cd8fd None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:52.905474 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdaebc0-b189-4d38-8183-e211a90cd8fd None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:52.905970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdaebc0-b189-4d38-8183-e211a90cd8fd None admin] PATH_INFO: `/v3/groups/25fa3f06a6b645b48bdb32af41efacad` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:52.913332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdaebc0-b189-4d38-8183-e211a90cd8fd None admin] RBAC: Authorizing `identity:get_group(group_id=25fa3f06a6b645b48bdb32af41efacad)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:52.915525 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdaebc0-b189-4d38-8183-e211a90cd8fd None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:52.917467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 179/381] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Aug 29 22:37:52 2022] GET /identity/v3/groups/25fa3f06a6b645b48bdb32af41efacad => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:52.923649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc065c9-37f3-4673-9f4c-95fa65bbe957 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:52.944840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:53.033949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc065c9-37f3-4673-9f4c-95fa65bbe957 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:53.071192 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12168f2-5ae9-4d28-8597-bedacc1ab597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:53.072358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12168f2-5ae9-4d28-8597-bedacc1ab597 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:53.072850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12168f2-5ae9-4d28-8597-bedacc1ab597 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:53.073295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12168f2-5ae9-4d28-8597-bedacc1ab597 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:53.074207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12168f2-5ae9-4d28-8597-bedacc1ab597 None admin] RBAC: Adding query filter params (group.id=25fa3f06a6b645b48bdb32af41efacad, role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=3c5435e2f5ae455ab9a7fc1e7c010ec4) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:53.074681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12168f2-5ae9-4d28-8597-bedacc1ab597 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:53.076337 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12168f2-5ae9-4d28-8597-bedacc1ab597 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:53.083083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 203/382] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Aug 29 22:37:52 2022] GET /identity/v3/role_assignments?group.id=25fa3f06a6b645b48bdb32af41efacad&scope.project.id=3c5435e2f5ae455ab9a7fc1e7c010ec4&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:53.405804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdaebc0-b189-4d38-8183-e211a90cd8fd None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:53.489046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:53.534926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdaebc0-b189-4d38-8183-e211a90cd8fd None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:53.576446 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb0838-b4e3-486f-a95f-509ae335aa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:53.577090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb0838-b4e3-486f-a95f-509ae335aa98 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:53.577370 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb0838-b4e3-486f-a95f-509ae335aa98 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:53.578195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb0838-b4e3-486f-a95f-509ae335aa98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:53.592692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb0838-b4e3-486f-a95f-509ae335aa98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-82bb0838-b4e3-486f-a95f-509ae335aa98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:53.599644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:53.600844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:53.602062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:53.602062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:53.602062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:53.602062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:53.602062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:53.602062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:53.602062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:53.602062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:53.602062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:53.602062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:53.602062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:53.602062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:53.602062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 180/383] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:37:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:53.610228 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12168f2-5ae9-4d28-8597-bedacc1ab597 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:53.747723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:53.810082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12168f2-5ae9-4d28-8597-bedacc1ab597 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:53.833798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43964cb-1437-451b-b928-c4926631fbde None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:53.834105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43964cb-1437-451b-b928-c4926631fbde None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:53.834348 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43964cb-1437-451b-b928-c4926631fbde None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:53.835969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 181/384] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:53.841181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f850c8-6515-47ad-bd4f-4278493b8f93 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:53.841489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f850c8-6515-47ad-bd4f-4278493b8f93 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:53.841764 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f850c8-6515-47ad-bd4f-4278493b8f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:53.862329 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-91f850c8-6515-47ad-bd4f-4278493b8f93 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:53.863581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-91f850c8-6515-47ad-bd4f-4278493b8f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:53.866335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ae7d1-a193-488e-954f-c1f960307398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:53.866958 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ae7d1-a193-488e-954f-c1f960307398 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:53.867239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ae7d1-a193-488e-954f-c1f960307398 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:53.867565 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ae7d1-a193-488e-954f-c1f960307398 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:53.868270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ae7d1-a193-488e-954f-c1f960307398 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:53.868588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ae7d1-a193-488e-954f-c1f960307398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:53.869990 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ae7d1-a193-488e-954f-c1f960307398 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:53.887499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 204/385] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:37:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:53.895060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ae7d1-a193-488e-954f-c1f960307398 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:53.984613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 182/386] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:54.074193 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ae7d1-a193-488e-954f-c1f960307398 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:54.119995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b951088-084c-4703-8e6a-af052495e5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:54.121071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b951088-084c-4703-8e6a-af052495e5c1 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:54.121615 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b951088-084c-4703-8e6a-af052495e5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:54.122093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b951088-084c-4703-8e6a-af052495e5c1 None admin] PATH_INFO: `/v3/groups/edda4bcf37024c2890a06f051aee45f2` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:54.123518 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b951088-084c-4703-8e6a-af052495e5c1 None admin] RBAC: Authorizing `identity:get_group(group_id=edda4bcf37024c2890a06f051aee45f2)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:54.125571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b951088-084c-4703-8e6a-af052495e5c1 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:54.127494 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 205/387] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Aug 29 22:37:53 2022] GET /identity/v3/groups/edda4bcf37024c2890a06f051aee45f2 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:54.133281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f850c8-6515-47ad-bd4f-4278493b8f93 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:54.209173 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:54.253621 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f850c8-6515-47ad-bd4f-4278493b8f93 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:54.308486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8ba64-6a27-40a3-b891-0ae4d9a46c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:54.309144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8ba64-6a27-40a3-b891-0ae4d9a46c6e None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:54.309474 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8ba64-6a27-40a3-b891-0ae4d9a46c6e None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:54.309752 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8ba64-6a27-40a3-b891-0ae4d9a46c6e None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:54.312914 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8ba64-6a27-40a3-b891-0ae4d9a46c6e None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:54.314469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8ba64-6a27-40a3-b891-0ae4d9a46c6e None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:54.316126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 183/388] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:54 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:54.322271 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b951088-084c-4703-8e6a-af052495e5c1 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:54.325549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:54.333475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8ba64-6a27-40a3-b891-0ae4d9a46c6e None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:54.512504 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8ba64-6a27-40a3-b891-0ae4d9a46c6e None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:54.542711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:54.547010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b951088-084c-4703-8e6a-af052495e5c1 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:54.562783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d363e3-cfc8-4b77-95c8-8bae4fd154ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:54.563442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d363e3-cfc8-4b77-95c8-8bae4fd154ca None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:54.563724 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d363e3-cfc8-4b77-95c8-8bae4fd154ca None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:54.564001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d363e3-cfc8-4b77-95c8-8bae4fd154ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:54.592085 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d363e3-cfc8-4b77-95c8-8bae4fd154ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-e2d363e3-cfc8-4b77-95c8-8bae4fd154ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:54.598447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:54.599350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:54.600404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:54.600404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:54.600404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:54.600404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:54.600404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:54.600404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:54.600404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:54.600404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:54.600404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:54.600404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:54.600404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:54.600404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:54.610487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 184/389] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:54.610487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d363e3-cfc8-4b77-95c8-8bae4fd154ca None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:54.630014 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f8005-6b8a-4804-a594-fce2c3db8d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:54.630768 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f8005-6b8a-4804-a594-fce2c3db8d97 None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:54.630977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f8005-6b8a-4804-a594-fce2c3db8d97 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:54.631262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f8005-6b8a-4804-a594-fce2c3db8d97 None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5/groups/edda4bcf37024c2890a06f051aee45f2/roles/da30366a448b4b1f902c8160690d366e` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:54.633510 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f8005-6b8a-4804-a594-fce2c3db8d97 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee30b1fbec25473ebc077e35e79c2ad5, group_id=edda4bcf37024c2890a06f051aee45f2, role_id=da30366a448b4b1f902c8160690d366e)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:54.634972 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f8005-6b8a-4804-a594-fce2c3db8d97 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:54.734275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d363e3-cfc8-4b77-95c8-8bae4fd154ca None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:54.734690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 206/390] 10.222.0.72 () {58 vars in 1442 bytes} [Mon Aug 29 22:37:54 2022] PUT /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5/groups/edda4bcf37024c2890a06f051aee45f2/roles/da30366a448b4b1f902c8160690d366e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:37:54.776789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529f0c9-c616-4d02-93d3-856a7237f72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:54.777687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529f0c9-c616-4d02-93d3-856a7237f72a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:54.778113 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529f0c9-c616-4d02-93d3-856a7237f72a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:54.778534 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529f0c9-c616-4d02-93d3-856a7237f72a None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:54.779384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529f0c9-c616-4d02-93d3-856a7237f72a None admin] RBAC: Adding query filter params (name=member) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:54.779865 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529f0c9-c616-4d02-93d3-856a7237f72a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:54.782323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529f0c9-c616-4d02-93d3-856a7237f72a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:54.792821 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 185/391] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:54.801663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f8005-6b8a-4804-a594-fce2c3db8d97 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:54.888888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:54.945933 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f8005-6b8a-4804-a594-fce2c3db8d97 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:55.001855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79ad53-0cb1-4dce-9662-9a0da36977a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:55.002558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79ad53-0cb1-4dce-9662-9a0da36977a4 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:55.002850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79ad53-0cb1-4dce-9662-9a0da36977a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:55.003128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79ad53-0cb1-4dce-9662-9a0da36977a4 None admin] PATH_INFO: `/v3/groups/edda4bcf37024c2890a06f051aee45f2` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:55.006492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79ad53-0cb1-4dce-9662-9a0da36977a4 None admin] RBAC: Authorizing `identity:get_group(group_id=edda4bcf37024c2890a06f051aee45f2)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:55.007982 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79ad53-0cb1-4dce-9662-9a0da36977a4 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:55.010199 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 207/392] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Aug 29 22:37:54 2022] GET /identity/v3/groups/edda4bcf37024c2890a06f051aee45f2 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:55.016281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529f0c9-c616-4d02-93d3-856a7237f72a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:55.049792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4974e23-e66d-43fc-935d-a0e8f64fd486 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:55.050747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4974e23-e66d-43fc-935d-a0e8f64fd486 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:55.051034 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4974e23-e66d-43fc-935d-a0e8f64fd486 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:55.052920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 208/393] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:55.064099 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4270d16-26ec-457f-bb0b-27e3ffb2198e None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:55.065084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4270d16-26ec-457f-bb0b-27e3ffb2198e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:55.065527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4270d16-26ec-457f-bb0b-27e3ffb2198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:55.089449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-e4270d16-26ec-457f-bb0b-27e3ffb2198e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:55.091963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e4270d16-26ec-457f-bb0b-27e3ffb2198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:55.115955 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:55.191010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 209/394] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:55.208557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529f0c9-c616-4d02-93d3-856a7237f72a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:55.275780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969578b-5330-4942-99cc-f63b41e3b921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:55.278616 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969578b-5330-4942-99cc-f63b41e3b921 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:55.278616 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969578b-5330-4942-99cc-f63b41e3b921 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:55.278616 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969578b-5330-4942-99cc-f63b41e3b921 None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:55.279842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969578b-5330-4942-99cc-f63b41e3b921 None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:55.281838 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969578b-5330-4942-99cc-f63b41e3b921 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:55.283992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 186/395] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:55 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:55.289888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4270d16-26ec-457f-bb0b-27e3ffb2198e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:55.371797 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:55.413559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb82d7-fb8a-4954-84d7-c6887d923384 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:55.414346 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb82d7-fb8a-4954-84d7-c6887d923384 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:55.414851 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb82d7-fb8a-4954-84d7-c6887d923384 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:55.416734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 187/396] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:37:55.424345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b8b52-a3cc-43e5-8dea-d184636d75c7 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:55.424838 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b8b52-a3cc-43e5-8dea-d184636d75c7 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:55.425338 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b8b52-a3cc-43e5-8dea-d184636d75c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:55.434691 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4270d16-26ec-457f-bb0b-27e3ffb2198e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:55.447239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-cf5b8b52-a3cc-43e5-8dea-d184636d75c7 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:55.448835 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-cf5b8b52-a3cc-43e5-8dea-d184636d75c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:55.501630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721ac38-63f1-45b1-8ea7-86171c63c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:55.502440 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721ac38-63f1-45b1-8ea7-86171c63c218 None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:55.502721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721ac38-63f1-45b1-8ea7-86171c63c218 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:55.502994 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721ac38-63f1-45b1-8ea7-86171c63c218 None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5/groups/edda4bcf37024c2890a06f051aee45f2/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:55.504934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721ac38-63f1-45b1-8ea7-86171c63c218 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee30b1fbec25473ebc077e35e79c2ad5, group_id=edda4bcf37024c2890a06f051aee45f2, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:55.506441 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721ac38-63f1-45b1-8ea7-86171c63c218 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:55.550208 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 188/397] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:55.550887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b8b52-a3cc-43e5-8dea-d184636d75c7 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:55.565150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 210/398] 10.222.0.72 () {58 vars in 1442 bytes} [Mon Aug 29 22:37:55 2022] PUT /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5/groups/edda4bcf37024c2890a06f051aee45f2/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:37:55.574894 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd5c16-380e-40ed-8e5d-38aa117d970a None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:55.575186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd5c16-380e-40ed-8e5d-38aa117d970a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:55.575452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd5c16-380e-40ed-8e5d-38aa117d970a None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:55.581878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 211/399] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:37:55.583909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52095a-ef7d-4190-8044-60fb1c863666 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:55.584308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52095a-ef7d-4190-8044-60fb1c863666 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:55.584665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52095a-ef7d-4190-8044-60fb1c863666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:55.607232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-1f52095a-ef7d-4190-8044-60fb1c863666 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:55.608950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-1f52095a-ef7d-4190-8044-60fb1c863666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:55.668664 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:55.748403 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 212/400] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:55.787011 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b8b52-a3cc-43e5-8dea-d184636d75c7 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:55.833834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6a5c8-3765-4cc1-9779-76bb6c0a6cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:55.834498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6a5c8-3765-4cc1-9779-76bb6c0a6cbd None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:55.834780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6a5c8-3765-4cc1-9779-76bb6c0a6cbd None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:55.835053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6a5c8-3765-4cc1-9779-76bb6c0a6cbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:55.848894 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6a5c8-3765-4cc1-9779-76bb6c0a6cbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-9ff6a5c8-3765-4cc1-9779-76bb6c0a6cbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:55.854410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:55.855371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:55.856138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:55.856138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:55.856138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:55.856138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:55.856138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:55.856138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:55.856138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:55.856138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:55.856138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:55.856138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:55.856138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:55.856138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:55.856138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 189/401] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:55.857996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52095a-ef7d-4190-8044-60fb1c863666 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:55.863554 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6a5c8-3765-4cc1-9779-76bb6c0a6cbd None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:55.932574 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:55.990577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52095a-ef7d-4190-8044-60fb1c863666 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:56.028919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b19a42-e5c3-4aa1-a3c8-cf56885da768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:56.029600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b19a42-e5c3-4aa1-a3c8-cf56885da768 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:56.029882 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b19a42-e5c3-4aa1-a3c8-cf56885da768 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:56.030260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b19a42-e5c3-4aa1-a3c8-cf56885da768 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:56.043383 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b19a42-e5c3-4aa1-a3c8-cf56885da768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-95b19a42-e5c3-4aa1-a3c8-cf56885da768 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:56.049584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:56.050474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:56.051267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:56.051267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:56.051267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:56.051267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:56.051267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:56.051267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:56.051267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:56.051267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:56.051267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:56.051267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:56.051267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:56.051267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:37:56.051267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 213/402] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:37:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:37:56.052986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6a5c8-3765-4cc1-9779-76bb6c0a6cbd None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:56.060249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b19a42-e5c3-4aa1-a3c8-cf56885da768 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:56.069755 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:56.141592 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f27092-6079-47d7-80c2-15caf325459f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:56.142225 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f27092-6079-47d7-80c2-15caf325459f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:56.142508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f27092-6079-47d7-80c2-15caf325459f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:56.142786 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f27092-6079-47d7-80c2-15caf325459f None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:56.143469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f27092-6079-47d7-80c2-15caf325459f None admin] RBAC: Adding query filter params (name=member) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:56.143775 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f27092-6079-47d7-80c2-15caf325459f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:56.145218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f27092-6079-47d7-80c2-15caf325459f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:56.158841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 190/403] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:56.160543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f27092-6079-47d7-80c2-15caf325459f None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:56.220772 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b19a42-e5c3-4aa1-a3c8-cf56885da768 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:56.236219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:56.273683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c9c49-eb86-470e-80b7-fe05ab9f00a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:56.274301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c9c49-eb86-470e-80b7-fe05ab9f00a4 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:56.274845 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c9c49-eb86-470e-80b7-fe05ab9f00a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:56.275118 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c9c49-eb86-470e-80b7-fe05ab9f00a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:56.276481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c9c49-eb86-470e-80b7-fe05ab9f00a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:56.276794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c9c49-eb86-470e-80b7-fe05ab9f00a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:56.278183 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c9c49-eb86-470e-80b7-fe05ab9f00a4 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:56.278364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f27092-6079-47d7-80c2-15caf325459f None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:56.292667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 214/404] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:37:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:56.293513 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c9c49-eb86-470e-80b7-fe05ab9f00a4 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:56.325614 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbe648-59e3-4bb9-ac44-f55cf89c8ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:56.326508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbe648-59e3-4bb9-ac44-f55cf89c8ba7 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:56.326792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbe648-59e3-4bb9-ac44-f55cf89c8ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:56.327067 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbe648-59e3-4bb9-ac44-f55cf89c8ba7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:56.342622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbe648-59e3-4bb9-ac44-f55cf89c8ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-9cfbe648-59e3-4bb9-ac44-f55cf89c8ba7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:56.350395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:56.351333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:56.352665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:56.352665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:56.352665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:56.352665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:56.352665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:56.352665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:56.352665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:56.352665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:56.352665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:56.352665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:56.352665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:37:56.352665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:56.356337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 191/405] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:37:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:56.358330 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbe648-59e3-4bb9-ac44-f55cf89c8ba7 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:56.391667 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:56.444822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c9c49-eb86-470e-80b7-fe05ab9f00a4 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:56.478030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbe648-59e3-4bb9-ac44-f55cf89c8ba7 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:56.492904 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e16ba5-7fcf-45e8-84df-2b0362b9cc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:56.493654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e16ba5-7fcf-45e8-84df-2b0362b9cc99 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:56.493971 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e16ba5-7fcf-45e8-84df-2b0362b9cc99 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:56.494682 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e16ba5-7fcf-45e8-84df-2b0362b9cc99 None admin] PATH_INFO: `/v3/groups/edda4bcf37024c2890a06f051aee45f2` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:56.496131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e16ba5-7fcf-45e8-84df-2b0362b9cc99 None admin] RBAC: Authorizing `identity:get_group(group_id=edda4bcf37024c2890a06f051aee45f2)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:56.497861 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e16ba5-7fcf-45e8-84df-2b0362b9cc99 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:56.504349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 215/406] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Aug 29 22:37:56 2022] GET /identity/v3/groups/edda4bcf37024c2890a06f051aee45f2 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:56.505487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e16ba5-7fcf-45e8-84df-2b0362b9cc99 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:56.528861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc52f7-9367-479d-b8f5-cffa2f366580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:56.529783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc52f7-9367-479d-b8f5-cffa2f366580 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:56.530131 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc52f7-9367-479d-b8f5-cffa2f366580 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:56.530991 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc52f7-9367-479d-b8f5-cffa2f366580 None admin] PATH_INFO: `/v3/groups/edda4bcf37024c2890a06f051aee45f2` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:56.532826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc52f7-9367-479d-b8f5-cffa2f366580 None admin] RBAC: Authorizing `identity:get_group(group_id=edda4bcf37024c2890a06f051aee45f2)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:56.534363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc52f7-9367-479d-b8f5-cffa2f366580 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:56.540569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 192/407] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Aug 29 22:37:56 2022] GET /identity/v3/groups/edda4bcf37024c2890a06f051aee45f2 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:56.541294 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc52f7-9367-479d-b8f5-cffa2f366580 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:56.562649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:56.629545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e16ba5-7fcf-45e8-84df-2b0362b9cc99 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:56.652004 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:56.659163 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc52f7-9367-479d-b8f5-cffa2f366580 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:56.672290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f9a2e-5941-44fc-97ce-587b793d4601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:56.673323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f9a2e-5941-44fc-97ce-587b793d4601 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:56.673877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f9a2e-5941-44fc-97ce-587b793d4601 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:56.674484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f9a2e-5941-44fc-97ce-587b793d4601 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:56.675555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f9a2e-5941-44fc-97ce-587b793d4601 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:56.676257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f9a2e-5941-44fc-97ce-587b793d4601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:56.678265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f9a2e-5941-44fc-97ce-587b793d4601 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:56.688389 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 216/408] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:56.689689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f9a2e-5941-44fc-97ce-587b793d4601 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:56.704950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906870e-2dfb-43f3-b1b4-959a2a8c7992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:56.705596 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906870e-2dfb-43f3-b1b4-959a2a8c7992 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:56.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906870e-2dfb-43f3-b1b4-959a2a8c7992 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:56.706264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906870e-2dfb-43f3-b1b4-959a2a8c7992 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:56.707356 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906870e-2dfb-43f3-b1b4-959a2a8c7992 None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:56.708856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906870e-2dfb-43f3-b1b4-959a2a8c7992 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:56.715655 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 193/409] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:56 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:56.716647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906870e-2dfb-43f3-b1b4-959a2a8c7992 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:56.809647 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f9a2e-5941-44fc-97ce-587b793d4601 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:56.812472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:56.832321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906870e-2dfb-43f3-b1b4-959a2a8c7992 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:56.851454 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f14f7d-9522-4662-9ebf-c232844c49b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:56.852511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f14f7d-9522-4662-9ebf-c232844c49b2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:56.852992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f14f7d-9522-4662-9ebf-c232844c49b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:56.853481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f14f7d-9522-4662-9ebf-c232844c49b2 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:56.854882 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f14f7d-9522-4662-9ebf-c232844c49b2 None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:56.856711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f14f7d-9522-4662-9ebf-c232844c49b2 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:56.859707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 217/410] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:56 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:56.860784 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f14f7d-9522-4662-9ebf-c232844c49b2 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:56.875034 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e591bd-e27f-48cb-b9de-d7917a67cc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:56.876236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e591bd-e27f-48cb-b9de-d7917a67cc8b None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:56.876785 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e591bd-e27f-48cb-b9de-d7917a67cc8b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:56.877167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e591bd-e27f-48cb-b9de-d7917a67cc8b None admin] PATH_INFO: `/v3/groups/25fa3f06a6b645b48bdb32af41efacad` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:56.878679 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e591bd-e27f-48cb-b9de-d7917a67cc8b None admin] RBAC: Authorizing `identity:get_group(group_id=25fa3f06a6b645b48bdb32af41efacad)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:56.880352 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e591bd-e27f-48cb-b9de-d7917a67cc8b None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:56.887276 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 194/411] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Aug 29 22:37:56 2022] GET /identity/v3/groups/25fa3f06a6b645b48bdb32af41efacad => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:56.888536 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e591bd-e27f-48cb-b9de-d7917a67cc8b None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:56.928623 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:56.986134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f14f7d-9522-4662-9ebf-c232844c49b2 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:57.000660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e591bd-e27f-48cb-b9de-d7917a67cc8b None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:57.024171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a8826-cf70-4803-a686-f82ca2fbbd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:57.025406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a8826-cf70-4803-a686-f82ca2fbbd4f None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:57.025949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a8826-cf70-4803-a686-f82ca2fbbd4f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:57.026424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a8826-cf70-4803-a686-f82ca2fbbd4f None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d/groups/edda4bcf37024c2890a06f051aee45f2/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:57.028667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a8826-cf70-4803-a686-f82ca2fbbd4f None admin] RBAC: Authorizing `identity:create_grant(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d, group_id=edda4bcf37024c2890a06f051aee45f2, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:57.031230 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a8826-cf70-4803-a686-f82ca2fbbd4f None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:57.039007 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661884e-f582-454f-932a-afd2e25a0cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:57.039791 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661884e-f582-454f-932a-afd2e25a0cf1 None admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:57.040073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661884e-f582-454f-932a-afd2e25a0cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:57.040390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661884e-f582-454f-932a-afd2e25a0cf1 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d/groups/edda4bcf37024c2890a06f051aee45f2/roles/da30366a448b4b1f902c8160690d366e` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:57.044074 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661884e-f582-454f-932a-afd2e25a0cf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d, group_id=edda4bcf37024c2890a06f051aee45f2, role_id=da30366a448b4b1f902c8160690d366e)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:57.044074 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661884e-f582-454f-932a-afd2e25a0cf1 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:57.125444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 218/412] 10.222.0.72 () {58 vars in 1442 bytes} [Mon Aug 29 22:37:56 2022] PUT /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d/groups/edda4bcf37024c2890a06f051aee45f2/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:37:57.126755 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a8826-cf70-4803-a686-f82ca2fbbd4f None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:57.175622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:57.205060 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 195/413] 10.222.0.72 () {58 vars in 1442 bytes} [Mon Aug 29 22:37:56 2022] PUT /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d/groups/edda4bcf37024c2890a06f051aee45f2/roles/da30366a448b4b1f902c8160690d366e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:37:57.287563 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a8826-cf70-4803-a686-f82ca2fbbd4f None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:57.309526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7437c-aad1-4360-991a-361ab9242296 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:57.309816 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7437c-aad1-4360-991a-361ab9242296 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:57.310098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7437c-aad1-4360-991a-361ab9242296 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:57.311915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 196/414] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:37:57.317656 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187d40-d46e-4929-87a3-629fd34ab9ee None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:57.317937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187d40-d46e-4929-87a3-629fd34ab9ee None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:57.318215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187d40-d46e-4929-87a3-629fd34ab9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:57.338045 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-b8187d40-d46e-4929-87a3-629fd34ab9ee None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:57.339296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b8187d40-d46e-4929-87a3-629fd34ab9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:57.345623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b5fb4-6577-4657-920b-81e6cab049ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:57.346296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b5fb4-6577-4657-920b-81e6cab049ed None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:57.346572 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b5fb4-6577-4657-920b-81e6cab049ed None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:57.346844 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b5fb4-6577-4657-920b-81e6cab049ed None admin] PATH_INFO: `/v3/projects/3c5435e2f5ae455ab9a7fc1e7c010ec4` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:57.349003 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b5fb4-6577-4657-920b-81e6cab049ed None admin] RBAC: Authorizing `identity:get_project(project_id=3c5435e2f5ae455ab9a7fc1e7c010ec4)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:57.350948 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b5fb4-6577-4657-920b-81e6cab049ed None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:57.353199 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 219/415] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:57 2022] GET /identity/v3/projects/3c5435e2f5ae455ab9a7fc1e7c010ec4 => generated 344 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:57.359916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b5fb4-6577-4657-920b-81e6cab049ed None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:57.437538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 197/416] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:57.493149 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:57.497678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b5fb4-6577-4657-920b-81e6cab049ed None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:57.536470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240f2ab-435d-4844-aad0-0fd4f1b4f72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:57.537198 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240f2ab-435d-4844-aad0-0fd4f1b4f72c None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:57.537483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240f2ab-435d-4844-aad0-0fd4f1b4f72c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:57.537759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240f2ab-435d-4844-aad0-0fd4f1b4f72c None admin] PATH_INFO: `/v3/projects/3c5435e2f5ae455ab9a7fc1e7c010ec4/groups/25fa3f06a6b645b48bdb32af41efacad/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:57.539801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240f2ab-435d-4844-aad0-0fd4f1b4f72c None admin] RBAC: Authorizing `identity:create_grant(project_id=3c5435e2f5ae455ab9a7fc1e7c010ec4, group_id=25fa3f06a6b645b48bdb32af41efacad, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:57.541317 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240f2ab-435d-4844-aad0-0fd4f1b4f72c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:57.650260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 220/417] 10.222.0.72 () {58 vars in 1442 bytes} [Mon Aug 29 22:37:57 2022] PUT /identity/v3/projects/3c5435e2f5ae455ab9a7fc1e7c010ec4/groups/25fa3f06a6b645b48bdb32af41efacad/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:37:57.727670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8187d40-d46e-4929-87a3-629fd34ab9ee None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:57.757260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:57.848017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8187d40-d46e-4929-87a3-629fd34ab9ee None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:57.863072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a8723-e342-49c7-8f26-a53d9fe96afb None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:57.863501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a8723-e342-49c7-8f26-a53d9fe96afb None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:57.863786 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a8723-e342-49c7-8f26-a53d9fe96afb None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:57.865689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 221/418] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:57.871997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3e0be-dc43-4a7b-b20c-dbf52f641bf7 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:57.872888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3e0be-dc43-4a7b-b20c-dbf52f641bf7 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:57.873176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3e0be-dc43-4a7b-b20c-dbf52f641bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:57.888124 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088ed97-19ee-4b76-9012-dd01b7c534da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:57.888842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088ed97-19ee-4b76-9012-dd01b7c534da None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:57.889180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088ed97-19ee-4b76-9012-dd01b7c534da None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:57.889386 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088ed97-19ee-4b76-9012-dd01b7c534da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:57.908973 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-54a3e0be-dc43-4a7b-b20c-dbf52f641bf7 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:57.910233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-54a3e0be-dc43-4a7b-b20c-dbf52f641bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:57.912677 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088ed97-19ee-4b76-9012-dd01b7c534da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-9088ed97-19ee-4b76-9012-dd01b7c534da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:57.917855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:57.918777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:57.919570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:57.919570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:57.919570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:57.919570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:57.919570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:57.919570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:57.919570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:57.919570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:57.919570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:57.919570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:57.919570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:37:57.919570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:57.920890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 198/419] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:37:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:57.930456 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088ed97-19ee-4b76-9012-dd01b7c534da None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:58.023817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 222/420] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:37:58.052583 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:58.068063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088ed97-19ee-4b76-9012-dd01b7c534da None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:58.118279 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccfc7b-23dc-4896-a1ca-34725a02487c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:58.118906 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccfc7b-23dc-4896-a1ca-34725a02487c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:58.119189 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccfc7b-23dc-4896-a1ca-34725a02487c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:58.119451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccfc7b-23dc-4896-a1ca-34725a02487c None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:58.120123 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccfc7b-23dc-4896-a1ca-34725a02487c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:58.120452 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccfc7b-23dc-4896-a1ca-34725a02487c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:58.121921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccfc7b-23dc-4896-a1ca-34725a02487c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:58.136271 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 199/421] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:37:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:58.137799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3e0be-dc43-4a7b-b20c-dbf52f641bf7 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:58.287504 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:58.301790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3e0be-dc43-4a7b-b20c-dbf52f641bf7 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:58.352277 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c757a6-fa42-4f30-ae65-5c20e87c5df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:58.353344 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c757a6-fa42-4f30-ae65-5c20e87c5df9 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:58.353856 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c757a6-fa42-4f30-ae65-5c20e87c5df9 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:58.354330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c757a6-fa42-4f30-ae65-5c20e87c5df9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:58.421710 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccfc7b-23dc-4896-a1ca-34725a02487c None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:58.455293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c757a6-fa42-4f30-ae65-5c20e87c5df9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:58.458029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c757a6-fa42-4f30-ae65-5c20e87c5df9 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:58.560663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:58.571458 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 223/422] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:37:58.585299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c757a6-fa42-4f30-ae65-5c20e87c5df9 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:58.730500 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccfc7b-23dc-4896-a1ca-34725a02487c None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:58.806057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c757a6-fa42-4f30-ae65-5c20e87c5df9 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:58.841087 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c34ee9-ca08-451b-9b92-0a3c36c1e4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:58.841670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c34ee9-ca08-451b-9b92-0a3c36c1e4fd None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:58.841962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c34ee9-ca08-451b-9b92-0a3c36c1e4fd None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:58.842242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c34ee9-ca08-451b-9b92-0a3c36c1e4fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:58.852042 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f57201-d221-4db2-ba93-8b92d374e9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:58.852756 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f57201-d221-4db2-ba93-8b92d374e9bc None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:58.853142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f57201-d221-4db2-ba93-8b92d374e9bc None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:58.853461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f57201-d221-4db2-ba93-8b92d374e9bc None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:58.855153 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f57201-d221-4db2-ba93-8b92d374e9bc None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:58.856699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f57201-d221-4db2-ba93-8b92d374e9bc None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:58.859596 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 224/423] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:58 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:58.865703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f57201-d221-4db2-ba93-8b92d374e9bc None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:58.888962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c34ee9-ca08-451b-9b92-0a3c36c1e4fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-18c34ee9-ca08-451b-9b92-0a3c36c1e4fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:37:58.894665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:37:58.895654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:37:58.901073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:37:58.901073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:37:58.901073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:37:58.901073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:37:58.901073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:37:58.901073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:37:58.901073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:37:58.901073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:37:58.901073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:37:58.901073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:37:58.901073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:37:58.901073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:37:58.901073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 200/424] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:37:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 476 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:37:58.909295 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c34ee9-ca08-451b-9b92-0a3c36c1e4fd None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:58.926843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:58.960645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:59.047344 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f57201-d221-4db2-ba93-8b92d374e9bc None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:59.055267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c34ee9-ca08-451b-9b92-0a3c36c1e4fd None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:59.096205 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc2a48-cd08-4bb9-8172-ba073761a8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:59.097176 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc2a48-cd08-4bb9-8172-ba073761a8bd None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:59.097658 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc2a48-cd08-4bb9-8172-ba073761a8bd None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:59.098319 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc2a48-cd08-4bb9-8172-ba073761a8bd None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:59.100864 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc2a48-cd08-4bb9-8172-ba073761a8bd None admin] RBAC: Adding query filter params (name=member) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:59.101384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc2a48-cd08-4bb9-8172-ba073761a8bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:59.103241 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc2a48-cd08-4bb9-8172-ba073761a8bd None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:59.119710 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 201/425] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:37:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:59.129665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc2a48-cd08-4bb9-8172-ba073761a8bd None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:59.135688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8251ee-c4fa-422b-b954-a4199f6050eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:59.136659 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8251ee-c4fa-422b-b954-a4199f6050eb None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:59.137220 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8251ee-c4fa-422b-b954-a4199f6050eb None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:59.137708 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8251ee-c4fa-422b-b954-a4199f6050eb None admin] PATH_INFO: `/v3/groups/edda4bcf37024c2890a06f051aee45f2` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:59.139029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8251ee-c4fa-422b-b954-a4199f6050eb None admin] RBAC: Authorizing `identity:get_group(group_id=edda4bcf37024c2890a06f051aee45f2)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:59.142853 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8251ee-c4fa-422b-b954-a4199f6050eb None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:59.145197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 225/426] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Aug 29 22:37:58 2022] GET /identity/v3/groups/edda4bcf37024c2890a06f051aee45f2 => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:37:59.151078 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8251ee-c4fa-422b-b954-a4199f6050eb None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:59.236714 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:59.309768 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc2a48-cd08-4bb9-8172-ba073761a8bd None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:59.379515 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb8274-6656-4717-8ecb-ccd1e95d3bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:59.380211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb8274-6656-4717-8ecb-ccd1e95d3bb0 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:59.380638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb8274-6656-4717-8ecb-ccd1e95d3bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:59.380929 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb8274-6656-4717-8ecb-ccd1e95d3bb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:59.410453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8251ee-c4fa-422b-b954-a4199f6050eb None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:59.463003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb8274-6656-4717-8ecb-ccd1e95d3bb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:59.464507 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb8274-6656-4717-8ecb-ccd1e95d3bb0 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:59.494254 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:59.512117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c14be-5aa6-40f6-be8f-1a66d5a3ec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:59.513469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c14be-5aa6-40f6-be8f-1a66d5a3ec29 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:59.514103 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c14be-5aa6-40f6-be8f-1a66d5a3ec29 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:59.514866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c14be-5aa6-40f6-be8f-1a66d5a3ec29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:59.516386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c14be-5aa6-40f6-be8f-1a66d5a3ec29 None admin] RBAC: Adding query filter params (group.id=edda4bcf37024c2890a06f051aee45f2, role.id=da30366a448b4b1f902c8160690d366e, scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:37:59.517035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c14be-5aa6-40f6-be8f-1a66d5a3ec29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:59.520117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c14be-5aa6-40f6-be8f-1a66d5a3ec29 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:59.532334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 226/427] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Aug 29 22:37:59 2022] GET /identity/v3/role_assignments?group.id=edda4bcf37024c2890a06f051aee45f2&scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5&role.id=da30366a448b4b1f902c8160690d366e => generated 611 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:59.534625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51fa8d-3800-47eb-8597-2c5b227d8c44 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:59.535207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51fa8d-3800-47eb-8597-2c5b227d8c44 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:59.535764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51fa8d-3800-47eb-8597-2c5b227d8c44 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:59.538880 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 227/428] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:37:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:59.546587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a76a3-c699-4c1f-88b8-1dc218e945f9 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:59.547034 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a76a3-c699-4c1f-88b8-1dc218e945f9 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:59.547515 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a76a3-c699-4c1f-88b8-1dc218e945f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:59.567502 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:59.586562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-c21a76a3-c699-4c1f-88b8-1dc218e945f9 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:59.588630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c21a76a3-c699-4c1f-88b8-1dc218e945f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:59.691750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 202/429] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:37:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 22:37:59.697305 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb8274-6656-4717-8ecb-ccd1e95d3bb0 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:59.721042 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 228/430] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:37:59.835814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb8274-6656-4717-8ecb-ccd1e95d3bb0 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:59.878352 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91a86e-c74f-4ad9-a93e-4ffee222f07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:59.879000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91a86e-c74f-4ad9-a93e-4ffee222f07d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:59.879279 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91a86e-c74f-4ad9-a93e-4ffee222f07d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:59.879554 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91a86e-c74f-4ad9-a93e-4ffee222f07d None admin] PATH_INFO: `/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:59.880750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91a86e-c74f-4ad9-a93e-4ffee222f07d None admin] RBAC: Authorizing `identity:get_project(project_id=ee30b1fbec25473ebc077e35e79c2ad5)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:59.882410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91a86e-c74f-4ad9-a93e-4ffee222f07d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:59.884493 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 203/431] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:37:59 2022] GET /identity/v3/projects/ee30b1fbec25473ebc077e35e79c2ad5 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:37:59.890906 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a76a3-c699-4c1f-88b8-1dc218e945f9 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:00.007506 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a76a3-c699-4c1f-88b8-1dc218e945f9 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:00.030802 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:00.047701 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91a86e-c74f-4ad9-a93e-4ffee222f07d None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:00.054973 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1ea4b-671b-4421-9f65-6b4e12c74154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:00.072320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1ea4b-671b-4421-9f65-6b4e12c74154 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:00.072320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1ea4b-671b-4421-9f65-6b4e12c74154 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:00.072320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1ea4b-671b-4421-9f65-6b4e12c74154 None admin] PATH_INFO: `/v3/groups/edda4bcf37024c2890a06f051aee45f2` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:00.072320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1ea4b-671b-4421-9f65-6b4e12c74154 None admin] RBAC: Authorizing `identity:get_group(group_id=edda4bcf37024c2890a06f051aee45f2)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:00.072320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1ea4b-671b-4421-9f65-6b4e12c74154 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:00.072320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 229/432] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Aug 29 22:37:59 2022] GET /identity/v3/groups/edda4bcf37024c2890a06f051aee45f2 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:00.073221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1ea4b-671b-4421-9f65-6b4e12c74154 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:00.097451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:00.178443 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91a86e-c74f-4ad9-a93e-4ffee222f07d None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:00.192362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1ea4b-671b-4421-9f65-6b4e12c74154 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:00.217181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db3a41-e76a-4a17-af6d-353cf9a5dd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:00.217997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3a41-e76a-4a17-af6d-353cf9a5dd95 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:00.218375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3a41-e76a-4a17-af6d-353cf9a5dd95 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:00.218657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3a41-e76a-4a17-af6d-353cf9a5dd95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:00.230286 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eaa096-f1de-4ad1-8fab-54950fa010b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:00.230994 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaa096-f1de-4ad1-8fab-54950fa010b5 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:00.231346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaa096-f1de-4ad1-8fab-54950fa010b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:00.231623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaa096-f1de-4ad1-8fab-54950fa010b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:00.232399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaa096-f1de-4ad1-8fab-54950fa010b5 None admin] RBAC: Adding query filter params (group.id=edda4bcf37024c2890a06f051aee45f2, role.id=bebe72a018ea47b992e9e6715060fadb, scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:00.232545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db3a41-e76a-4a17-af6d-353cf9a5dd95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:00.232738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaa096-f1de-4ad1-8fab-54950fa010b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:00.234337 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaa096-f1de-4ad1-8fab-54950fa010b5 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-d9db3a41-e76a-4a17-af6d-353cf9a5dd95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:00.238109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:00.238999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:00.239783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:00.239783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:00.239783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:00.239783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:00.239783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:00.239783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:00.239783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:00.239783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:00.239783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:00.239783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:00.239783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:38:00.239783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:00.239783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 204/433] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:38:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:00.241035 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1d696-aaea-4e67-a71b-d6a3fb590558 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:00.241035 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1d696-aaea-4e67-a71b-d6a3fb590558 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:00.241315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1d696-aaea-4e67-a71b-d6a3fb590558 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:00.243011 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 205/434] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:00.245441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1d696-aaea-4e67-a71b-d6a3fb590558 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:00.248059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 230/435] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Aug 29 22:38:00 2022] GET /identity/v3/role_assignments?group.id=edda4bcf37024c2890a06f051aee45f2&scope.project.id=ee30b1fbec25473ebc077e35e79c2ad5&role.id=bebe72a018ea47b992e9e6715060fadb => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:00.250298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abc3cc-1d07-4fee-9b5d-b0262801ebec None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:00.250898 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abc3cc-1d07-4fee-9b5d-b0262801ebec None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:00.251430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abc3cc-1d07-4fee-9b5d-b0262801ebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:00.272085 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-46abc3cc-1d07-4fee-9b5d-b0262801ebec None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:00.273267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-46abc3cc-1d07-4fee-9b5d-b0262801ebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:00.332098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:00.363908 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 231/436] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:00.395643 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:00.404720 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1d696-aaea-4e67-a71b-d6a3fb590558 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:00.451650 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8b0e2-661a-4817-81db-ec4425486b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:00.453017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8b0e2-661a-4817-81db-ec4425486b6f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:00.453460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8b0e2-661a-4817-81db-ec4425486b6f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:00.453744 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8b0e2-661a-4817-81db-ec4425486b6f None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:00.454434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8b0e2-661a-4817-81db-ec4425486b6f None admin] RBAC: Adding query filter params (name=member) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:00.454740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8b0e2-661a-4817-81db-ec4425486b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:00.456126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8b0e2-661a-4817-81db-ec4425486b6f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:00.460240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6e169-b2fb-498f-bd20-a80aea77e958 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:00.460726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6e169-b2fb-498f-bd20-a80aea77e958 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:00.460831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6e169-b2fb-498f-bd20-a80aea77e958 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:00.462154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 232/437] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:38:00.467934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c734ee-9dd0-49a8-9eee-82d746fdf7eb None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:00.468600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c734ee-9dd0-49a8-9eee-82d746fdf7eb None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:00.468600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c734ee-9dd0-49a8-9eee-82d746fdf7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:00.469675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 206/438] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:38:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:00.476052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8b0e2-661a-4817-81db-ec4425486b6f None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:00.496338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-d5c734ee-9dd0-49a8-9eee-82d746fdf7eb None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:00.500246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d5c734ee-9dd0-49a8-9eee-82d746fdf7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:00.587157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 233/439] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:00.604028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8b0e2-661a-4817-81db-ec4425486b6f None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:00.644446 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a520523-c7a2-4496-874f-0e89b9688262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:00.645713 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a520523-c7a2-4496-874f-0e89b9688262 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:00.645986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a520523-c7a2-4496-874f-0e89b9688262 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:00.646257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c734ee-9dd0-49a8-9eee-82d746fdf7eb None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:00.646359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a520523-c7a2-4496-874f-0e89b9688262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:00.679449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:00.748562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a520523-c7a2-4496-874f-0e89b9688262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:00.750537 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a520523-c7a2-4496-874f-0e89b9688262 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:00.798059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c734ee-9dd0-49a8-9eee-82d746fdf7eb None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:00.814972 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:00.853889 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de452b-75b8-4741-9b54-fb451737fe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:00.854457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de452b-75b8-4741-9b54-fb451737fe2f None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:00.854802 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de452b-75b8-4741-9b54-fb451737fe2f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:00.855083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de452b-75b8-4741-9b54-fb451737fe2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:00.872797 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de452b-75b8-4741-9b54-fb451737fe2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-00de452b-75b8-4741-9b54-fb451737fe2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:00.878422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:00.879353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:00.880872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:00.880872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:00.880872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:00.880872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:00.880872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:00.880872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:00.880872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:00.880872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:00.880872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:00.880872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:00.880872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:38:00.880872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:00.880872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 234/440] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:38:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:00.880872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de452b-75b8-4741-9b54-fb451737fe2f None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:00.899761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 207/441] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:00.900670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a520523-c7a2-4496-874f-0e89b9688262 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:00.985330 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:01.018927 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de452b-75b8-4741-9b54-fb451737fe2f None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:01.031780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a520523-c7a2-4496-874f-0e89b9688262 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:01.053188 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996485b-e67a-4b64-959d-b4f984469278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:01.053823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996485b-e67a-4b64-959d-b4f984469278 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:01.054103 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996485b-e67a-4b64-959d-b4f984469278 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:01.054382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996485b-e67a-4b64-959d-b4f984469278 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:01.065368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996485b-e67a-4b64-959d-b4f984469278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:01.066111 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd276bb-eaf9-4973-9d33-72f256d6a68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:01.066707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd276bb-eaf9-4973-9d33-72f256d6a68e None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:01.066983 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd276bb-eaf9-4973-9d33-72f256d6a68e None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:01.067252 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd276bb-eaf9-4973-9d33-72f256d6a68e None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:01.067904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd276bb-eaf9-4973-9d33-72f256d6a68e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:01.068241 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd276bb-eaf9-4973-9d33-72f256d6a68e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:01.069605 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd276bb-eaf9-4973-9d33-72f256d6a68e None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-1996485b-e67a-4b64-959d-b4f984469278 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:01.070215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:01.071131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:01.072148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:01.072148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:01.072148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:01.072148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:01.072148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:01.072148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:01.072148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:01.072148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:01.072148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:01.072148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:01.072148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:38:01.072148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:01.072148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 235/442] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:38:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:01.072148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996485b-e67a-4b64-959d-b4f984469278 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:01.081604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 208/443] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:01.082684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd276bb-eaf9-4973-9d33-72f256d6a68e None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:01.106126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:01.185000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd276bb-eaf9-4973-9d33-72f256d6a68e None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:01.187854 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996485b-e67a-4b64-959d-b4f984469278 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:01.203520 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:01.222025 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d03b6-b061-427f-b4f0-514120077ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:01.222635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d03b6-b061-427f-b4f0-514120077ba8 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:01.222914 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d03b6-b061-427f-b4f0-514120077ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:01.223295 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d03b6-b061-427f-b4f0-514120077ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:01.223439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb141d-0825-4c5c-abb3-794a80ef1748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:01.223848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d03b6-b061-427f-b4f0-514120077ba8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:01.224077 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb141d-0825-4c5c-abb3-794a80ef1748 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:01.224164 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d03b6-b061-427f-b4f0-514120077ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:01.224385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb141d-0825-4c5c-abb3-794a80ef1748 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:01.224654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb141d-0825-4c5c-abb3-794a80ef1748 None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:01.225871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d03b6-b061-427f-b4f0-514120077ba8 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:01.226120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb141d-0825-4c5c-abb3-794a80ef1748 None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:01.227553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb141d-0825-4c5c-abb3-794a80ef1748 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:01.229245 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 236/444] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:38:01 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:01.230007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb141d-0825-4c5c-abb3-794a80ef1748 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:01.240463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 209/445] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:38:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:01.240463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d03b6-b061-427f-b4f0-514120077ba8 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:01.349187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:01.353452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb141d-0825-4c5c-abb3-794a80ef1748 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:01.368697 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d03b6-b061-427f-b4f0-514120077ba8 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:01.390571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708274a-8ceb-4f7c-8f64-9aed90783f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:01.391196 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708274a-8ceb-4f7c-8f64-9aed90783f84 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:01.391480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708274a-8ceb-4f7c-8f64-9aed90783f84 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:01.391757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708274a-8ceb-4f7c-8f64-9aed90783f84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:01.414748 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc663aa2-2078-4d7b-8ce0-9e1dd6b84893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:01.415387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc663aa2-2078-4d7b-8ce0-9e1dd6b84893 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:01.415663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc663aa2-2078-4d7b-8ce0-9e1dd6b84893 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:01.415930 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc663aa2-2078-4d7b-8ce0-9e1dd6b84893 None admin] PATH_INFO: `/v3/groups/edda4bcf37024c2890a06f051aee45f2` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:01.417256 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc663aa2-2078-4d7b-8ce0-9e1dd6b84893 None admin] RBAC: Authorizing `identity:get_group(group_id=edda4bcf37024c2890a06f051aee45f2)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:01.418711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc663aa2-2078-4d7b-8ce0-9e1dd6b84893 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:01.420210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 210/446] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Aug 29 22:38:01 2022] GET /identity/v3/groups/edda4bcf37024c2890a06f051aee45f2 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:01.426096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc663aa2-2078-4d7b-8ce0-9e1dd6b84893 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:01.475323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708274a-8ceb-4f7c-8f64-9aed90783f84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:01.476856 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708274a-8ceb-4f7c-8f64-9aed90783f84 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:01.481810 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:01.547416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc663aa2-2078-4d7b-8ce0-9e1dd6b84893 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:01.580897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:01.585168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799310c1-59a5-4d54-8d21-9432df67a59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:01.588761 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 237/447] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:01.593460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799310c1-59a5-4d54-8d21-9432df67a59e None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:01.593460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799310c1-59a5-4d54-8d21-9432df67a59e None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:01.593460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799310c1-59a5-4d54-8d21-9432df67a59e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:01.593946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708274a-8ceb-4f7c-8f64-9aed90783f84 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:01.660003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799310c1-59a5-4d54-8d21-9432df67a59e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:01.661420 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799310c1-59a5-4d54-8d21-9432df67a59e None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:01.712505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:01.719606 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708274a-8ceb-4f7c-8f64-9aed90783f84 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:01.760651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd769ed-1b07-4768-9194-05dd591b1c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:01.761278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd769ed-1b07-4768-9194-05dd591b1c46 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:01.761556 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd769ed-1b07-4768-9194-05dd591b1c46 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:01.761831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd769ed-1b07-4768-9194-05dd591b1c46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:01.762581 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd769ed-1b07-4768-9194-05dd591b1c46 None admin] RBAC: Adding query filter params (group.id=edda4bcf37024c2890a06f051aee45f2, role.id=bebe72a018ea47b992e9e6715060fadb, scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:01.762892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd769ed-1b07-4768-9194-05dd591b1c46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:01.764439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd769ed-1b07-4768-9194-05dd591b1c46 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:01.772211 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 238/448] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Aug 29 22:38:01 2022] GET /identity/v3/role_assignments?group.id=edda4bcf37024c2890a06f051aee45f2&scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d&role.id=bebe72a018ea47b992e9e6715060fadb => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:01.779197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd769ed-1b07-4768-9194-05dd591b1c46 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:01.779351 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 211/449] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:01.782982 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799310c1-59a5-4d54-8d21-9432df67a59e None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:01.864284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:01.911643 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799310c1-59a5-4d54-8d21-9432df67a59e None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:01.914504 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd769ed-1b07-4768-9194-05dd591b1c46 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:01.962377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40934173-3fb9-4c87-bc1b-3170d348f048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:01.963014 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40934173-3fb9-4c87-bc1b-3170d348f048 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:01.963300 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40934173-3fb9-4c87-bc1b-3170d348f048 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:01.963612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40934173-3fb9-4c87-bc1b-3170d348f048 None admin] PATH_INFO: `/v3/projects/3c5435e2f5ae455ab9a7fc1e7c010ec4` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:01.965478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40934173-3fb9-4c87-bc1b-3170d348f048 None admin] RBAC: Authorizing `identity:get_project(project_id=3c5435e2f5ae455ab9a7fc1e7c010ec4)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:01.967229 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40934173-3fb9-4c87-bc1b-3170d348f048 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:01.969819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 212/450] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:38:01 2022] GET /identity/v3/projects/3c5435e2f5ae455ab9a7fc1e7c010ec4 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:01.970079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6ab85-1f47-469e-a972-4e65969b4e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:01.970731 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6ab85-1f47-469e-a972-4e65969b4e1f None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:01.971008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6ab85-1f47-469e-a972-4e65969b4e1f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:01.971277 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6ab85-1f47-469e-a972-4e65969b4e1f None admin] PATH_INFO: `/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:01.972469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6ab85-1f47-469e-a972-4e65969b4e1f None admin] RBAC: Authorizing `identity:get_project(project_id=2d05a22ac3264ffe9c8fbad0fdbe019d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:01.973917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6ab85-1f47-469e-a972-4e65969b4e1f None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:01.975984 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40934173-3fb9-4c87-bc1b-3170d348f048 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:01.980432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 239/451] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:38:01 2022] GET /identity/v3/projects/2d05a22ac3264ffe9c8fbad0fdbe019d => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:01.981355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6ab85-1f47-469e-a972-4e65969b4e1f None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:01.997379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:02.106635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40934173-3fb9-4c87-bc1b-3170d348f048 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:02.123907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6ab85-1f47-469e-a972-4e65969b4e1f None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:02.149656 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd10b5-05e9-4376-b957-1abbb634ed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:02.150309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd10b5-05e9-4376-b957-1abbb634ed19 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:02.150594 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd10b5-05e9-4376-b957-1abbb634ed19 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:02.150867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd10b5-05e9-4376-b957-1abbb634ed19 None admin] PATH_INFO: `/v3/groups/25fa3f06a6b645b48bdb32af41efacad` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:02.152024 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd10b5-05e9-4376-b957-1abbb634ed19 None admin] RBAC: Authorizing `identity:get_group(group_id=25fa3f06a6b645b48bdb32af41efacad)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:02.153512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd10b5-05e9-4376-b957-1abbb634ed19 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:02.155861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 213/452] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Aug 29 22:38:01 2022] GET /identity/v3/groups/25fa3f06a6b645b48bdb32af41efacad => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:02.163098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd10b5-05e9-4376-b957-1abbb634ed19 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:02.163631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:02.171966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f62ec8-39d8-4bd5-b969-baf3247e494b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:02.176069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f62ec8-39d8-4bd5-b969-baf3247e494b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:02.176069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f62ec8-39d8-4bd5-b969-baf3247e494b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:02.176069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f62ec8-39d8-4bd5-b969-baf3247e494b None admin] PATH_INFO: `/v3/groups/edda4bcf37024c2890a06f051aee45f2` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:02.176069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f62ec8-39d8-4bd5-b969-baf3247e494b None admin] RBAC: Authorizing `identity:get_group(group_id=edda4bcf37024c2890a06f051aee45f2)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:02.176412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f62ec8-39d8-4bd5-b969-baf3247e494b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:02.178062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 240/453] 10.222.0.72 () {56 vars in 1180 bytes} [Mon Aug 29 22:38:01 2022] GET /identity/v3/groups/edda4bcf37024c2890a06f051aee45f2 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:02.184375 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f62ec8-39d8-4bd5-b969-baf3247e494b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:02.257435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:02.274121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd10b5-05e9-4376-b957-1abbb634ed19 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:02.294233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f62ec8-39d8-4bd5-b969-baf3247e494b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:02.309861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944b84a-802f-4e0e-8897-553f90f52ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:02.310473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944b84a-802f-4e0e-8897-553f90f52ff3 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:02.310752 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944b84a-802f-4e0e-8897-553f90f52ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:02.311022 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944b84a-802f-4e0e-8897-553f90f52ff3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:02.312110 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944b84a-802f-4e0e-8897-553f90f52ff3 None admin] RBAC: Adding query filter params (group.id=25fa3f06a6b645b48bdb32af41efacad, role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=3c5435e2f5ae455ab9a7fc1e7c010ec4) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:02.312564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944b84a-802f-4e0e-8897-553f90f52ff3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:02.314001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944b84a-802f-4e0e-8897-553f90f52ff3 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:02.319881 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 214/454] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Aug 29 22:38:02 2022] GET /identity/v3/role_assignments?group.id=25fa3f06a6b645b48bdb32af41efacad&scope.project.id=3c5435e2f5ae455ab9a7fc1e7c010ec4&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:02.331224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ed0d7-7718-4c3e-a9d9-e13b017aa491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:02.331841 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ed0d7-7718-4c3e-a9d9-e13b017aa491 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:02.332125 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ed0d7-7718-4c3e-a9d9-e13b017aa491 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:02.332456 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ed0d7-7718-4c3e-a9d9-e13b017aa491 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:02.333218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ed0d7-7718-4c3e-a9d9-e13b017aa491 None admin] RBAC: Adding query filter params (group.id=edda4bcf37024c2890a06f051aee45f2, role.id=da30366a448b4b1f902c8160690d366e, scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:02.333518 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ed0d7-7718-4c3e-a9d9-e13b017aa491 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:02.335041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ed0d7-7718-4c3e-a9d9-e13b017aa491 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:02.341724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 241/455] 10.222.0.72 () {56 vars in 1376 bytes} [Mon Aug 29 22:38:02 2022] GET /identity/v3/role_assignments?group.id=edda4bcf37024c2890a06f051aee45f2&scope.project.id=2d05a22ac3264ffe9c8fbad0fdbe019d&role.id=da30366a448b4b1f902c8160690d366e => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:05.057757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844de01-aa80-4233-bd3c-4a7a95edcfa4 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:05.058284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844de01-aa80-4233-bd3c-4a7a95edcfa4 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:05.058284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844de01-aa80-4233-bd3c-4a7a95edcfa4 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:05.060021 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 215/456] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:05.066298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83824320-2898-4a4b-894e-033513a782f4 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:05.066804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83824320-2898-4a4b-894e-033513a782f4 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:05.066996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83824320-2898-4a4b-894e-033513a782f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:05.097324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-83824320-2898-4a4b-894e-033513a782f4 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:05.098547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-83824320-2898-4a4b-894e-033513a782f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:05.141952 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba1b35-1397-4097-9609-897e6c8dcc0b None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:05.142384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba1b35-1397-4097-9609-897e6c8dcc0b None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:05.142882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba1b35-1397-4097-9609-897e6c8dcc0b None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:05.144732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 216/457] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:05.157998 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d776a5-a162-455a-998a-35bd3ba8b94e None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:05.158628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d776a5-a162-455a-998a-35bd3ba8b94e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:05.159173 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d776a5-a162-455a-998a-35bd3ba8b94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:05.181881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:05.197982 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 242/458] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:05.198681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-c5d776a5-a162-455a-998a-35bd3ba8b94e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:05.199915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c5d776a5-a162-455a-998a-35bd3ba8b94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:05.301362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 217/459] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:05.449652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b16ef2-daaa-47a2-a97c-34cd922655de None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:05.449972 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b16ef2-daaa-47a2-a97c-34cd922655de None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:05.450207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b16ef2-daaa-47a2-a97c-34cd922655de None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:05.451977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 243/460] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:05.457689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6dd49-9874-43f8-8686-dd3dfe58e191 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:05.458315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6dd49-9874-43f8-8686-dd3dfe58e191 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:05.459009 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6dd49-9874-43f8-8686-dd3dfe58e191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:05.496634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-0fe6dd49-9874-43f8-8686-dd3dfe58e191 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:05.499228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0fe6dd49-9874-43f8-8686-dd3dfe58e191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:05.590970 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b16ef2-daaa-47a2-a97c-34cd922655de None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:05.593242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 218/461] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:05.668018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6dd49-9874-43f8-8686-dd3dfe58e191 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:05.681753 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:05.788662 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b16ef2-daaa-47a2-a97c-34cd922655de None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:05.853578 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6dd49-9874-43f8-8686-dd3dfe58e191 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:05.856912 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa929383-60a2-4c83-8b32-10393354558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:05.857554 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa929383-60a2-4c83-8b32-10393354558b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:05.858464 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa929383-60a2-4c83-8b32-10393354558b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:05.859218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa929383-60a2-4c83-8b32-10393354558b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:05.878837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa929383-60a2-4c83-8b32-10393354558b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:05.880336 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa929383-60a2-4c83-8b32-10393354558b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:05.907758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fb4b5-462c-4dd5-ad27-3636cc15284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:05.908428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fb4b5-462c-4dd5-ad27-3636cc15284c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:05.908707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fb4b5-462c-4dd5-ad27-3636cc15284c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:05.908981 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fb4b5-462c-4dd5-ad27-3636cc15284c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-fa929383-60a2-4c83-8b32-10393354558b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:05.911975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:05.913888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:05.915934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:05.915934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:05.915934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:05.919366 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 244/462] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:05.921859 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa929383-60a2-4c83-8b32-10393354558b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:05.931957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fb4b5-462c-4dd5-ad27-3636cc15284c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:05.935112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fb4b5-462c-4dd5-ad27-3636cc15284c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-153fb4b5-462c-4dd5-ad27-3636cc15284c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:05.980890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:05.982718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:05.985224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:05.985224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:05.985224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:05.986600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 219/463] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:05.987369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:05.991478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fb4b5-462c-4dd5-ad27-3636cc15284c None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:06.062088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa929383-60a2-4c83-8b32-10393354558b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:06.084092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:06.101554 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70ded9-ee26-4437-88fe-0b82b3d7b8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:06.102273 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70ded9-ee26-4437-88fe-0b82b3d7b8d6 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:06.102632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70ded9-ee26-4437-88fe-0b82b3d7b8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:06.102988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70ded9-ee26-4437-88fe-0b82b3d7b8d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:06.115190 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70ded9-ee26-4437-88fe-0b82b3d7b8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:06.116810 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70ded9-ee26-4437-88fe-0b82b3d7b8d6 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-7e70ded9-ee26-4437-88fe-0b82b3d7b8d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:06.133338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:06.134436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:06.135850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:06.135850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:06.135850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:06.135850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 245/464] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:06.136503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70ded9-ee26-4437-88fe-0b82b3d7b8d6 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:06.148498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fb4b5-462c-4dd5-ad27-3636cc15284c None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:06.194673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e036c-5ffa-4334-89ec-13f45258bcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:06.195425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e036c-5ffa-4334-89ec-13f45258bcf3 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:06.195712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e036c-5ffa-4334-89ec-13f45258bcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:06.195986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e036c-5ffa-4334-89ec-13f45258bcf3 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:06.196668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e036c-5ffa-4334-89ec-13f45258bcf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:06.196976 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e036c-5ffa-4334-89ec-13f45258bcf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:06.198362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e036c-5ffa-4334-89ec-13f45258bcf3 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:06.211396 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 220/465] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:06.212243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e036c-5ffa-4334-89ec-13f45258bcf3 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:06.258000 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:06.265104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70ded9-ee26-4437-88fe-0b82b3d7b8d6 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:06.303638 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cb69a-a690-4570-9b6b-99e7a8d6c928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:06.304282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cb69a-a690-4570-9b6b-99e7a8d6c928 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:06.304569 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cb69a-a690-4570-9b6b-99e7a8d6c928 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:06.304851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cb69a-a690-4570-9b6b-99e7a8d6c928 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:06.305519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9cb69a-a690-4570-9b6b-99e7a8d6c928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:06.306458 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9cb69a-a690-4570-9b6b-99e7a8d6c928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:06.308352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9cb69a-a690-4570-9b6b-99e7a8d6c928 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:06.323349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 246/466] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:06.324271 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e036c-5ffa-4334-89ec-13f45258bcf3 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:06.324777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4ea73-e66a-4676-9ea4-b9bd72054cd0 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:06.325061 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4ea73-e66a-4676-9ea4-b9bd72054cd0 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:06.325336 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4ea73-e66a-4676-9ea4-b9bd72054cd0 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:06.330995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 247/467] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:06.330995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4ea73-e66a-4676-9ea4-b9bd72054cd0 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:06.353091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:06.372536 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54779b3d-c147-4562-bb98-311550834ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:06.373233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54779b3d-c147-4562-bb98-311550834ac3 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:06.374199 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54779b3d-c147-4562-bb98-311550834ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:06.374515 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54779b3d-c147-4562-bb98-311550834ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:06.375475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54779b3d-c147-4562-bb98-311550834ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:06.375782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54779b3d-c147-4562-bb98-311550834ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:06.377202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54779b3d-c147-4562-bb98-311550834ac3 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:06.390958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 221/468] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:06.391880 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54779b3d-c147-4562-bb98-311550834ac3 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:06.450417 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4ea73-e66a-4676-9ea4-b9bd72054cd0 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:06.489416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd342c97-a44f-475d-80e8-a84a7ba37400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:06.490024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd342c97-a44f-475d-80e8-a84a7ba37400 None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:06.490314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd342c97-a44f-475d-80e8-a84a7ba37400 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:06.490589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd342c97-a44f-475d-80e8-a84a7ba37400 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:06.491240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd342c97-a44f-475d-80e8-a84a7ba37400 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:06.492743 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd342c97-a44f-475d-80e8-a84a7ba37400 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:06.497858 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54779b3d-c147-4562-bb98-311550834ac3 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:06.534848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce30c3-d455-4b4b-ac21-5e352ab7db68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:06.535580 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce30c3-d455-4b4b-ac21-5e352ab7db68 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:06.535873 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce30c3-d455-4b4b-ac21-5e352ab7db68 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:06.536138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce30c3-d455-4b4b-ac21-5e352ab7db68 None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:06.536826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce30c3-d455-4b4b-ac21-5e352ab7db68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:06.538265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce30c3-d455-4b4b-ac21-5e352ab7db68 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:06.591844 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 248/469] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:38:06 2022] POST /identity/v3/users => generated 246 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:38:06.593224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e396e-5fd6-4a52-8127-98afcf319071 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:06.593509 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e396e-5fd6-4a52-8127-98afcf319071 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:06.593885 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e396e-5fd6-4a52-8127-98afcf319071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:06.618368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-111e396e-5fd6-4a52-8127-98afcf319071 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:06.619641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-111e396e-5fd6-4a52-8127-98afcf319071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:06.629385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:06.645064 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 222/470] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:38:06 2022] POST /identity/v3/users => generated 248 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:38:06.647937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f5775-e156-4e04-a2e7-ca00f4a64162 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:06.648991 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f5775-e156-4e04-a2e7-ca00f4a64162 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:06.649240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f5775-e156-4e04-a2e7-ca00f4a64162 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:06.652158 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 223/471] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:06.653544 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f5775-e156-4e04-a2e7-ca00f4a64162 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:06.714548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:06.716548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 249/472] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:06.718671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77628f1e-d0e5-4e8a-a935-51940d55ec33 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:06.719225 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77628f1e-d0e5-4e8a-a935-51940d55ec33 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:06.719774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77628f1e-d0e5-4e8a-a935-51940d55ec33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:06.745188 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-77628f1e-d0e5-4e8a-a935-51940d55ec33 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:06.749384 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-77628f1e-d0e5-4e8a-a935-51940d55ec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:06.802882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f5775-e156-4e04-a2e7-ca00f4a64162 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:06.841161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 250/473] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:06.842483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33056ee9-3f56-4d5a-a272-47d7adca102e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:06.844141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33056ee9-3f56-4d5a-a272-47d7adca102e None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:06.844141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33056ee9-3f56-4d5a-a272-47d7adca102e None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:06.844141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33056ee9-3f56-4d5a-a272-47d7adca102e None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:06.844582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33056ee9-3f56-4d5a-a272-47d7adca102e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:06.846067 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33056ee9-3f56-4d5a-a272-47d7adca102e None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:06.962441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 224/474] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:38:06 2022] POST /identity/v3/users => generated 248 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:38:07.055952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77628f1e-d0e5-4e8a-a935-51940d55ec33 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:07.174998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:07.190579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33056ee9-3f56-4d5a-a272-47d7adca102e None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:07.211145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77628f1e-d0e5-4e8a-a935-51940d55ec33 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:07.257853 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233113a-f599-4e0c-b384-5acdaf62aac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:07.258517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233113a-f599-4e0c-b384-5acdaf62aac7 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:07.258801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233113a-f599-4e0c-b384-5acdaf62aac7 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:07.259071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233113a-f599-4e0c-b384-5acdaf62aac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:07.272242 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233113a-f599-4e0c-b384-5acdaf62aac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:07.273916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233113a-f599-4e0c-b384-5acdaf62aac7 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-2233113a-f599-4e0c-b384-5acdaf62aac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:07.294681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:07.296960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:07.297784 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:07.297784 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:07.297784 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:07.297784 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 251/475] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:07.305183 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233113a-f599-4e0c-b384-5acdaf62aac7 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:07.339859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:07.351197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33056ee9-3f56-4d5a-a272-47d7adca102e None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:07.400218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774448d-464c-4bf0-ad0e-1a700bafdc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:07.402101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774448d-464c-4bf0-ad0e-1a700bafdc05 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:07.402607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774448d-464c-4bf0-ad0e-1a700bafdc05 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:07.403094 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774448d-464c-4bf0-ad0e-1a700bafdc05 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:07.403980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774448d-464c-4bf0-ad0e-1a700bafdc05 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:07.406902 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774448d-464c-4bf0-ad0e-1a700bafdc05 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:07.444628 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233113a-f599-4e0c-b384-5acdaf62aac7 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:07.450375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.sql.core [None req-d774448d-464c-4bf0-ad0e-1a700bafdc05 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 22:38:07.450375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 22:38:07.450375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [parameters: {'id': '6df7ae6f01584f6c9435e9ce01779cf1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 22:38:07.450375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88553) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 22:38:07.471509 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:07.478268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-d774448d-464c-4bf0-ad0e-1a700bafdc05 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 22:38:07.478268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:07.478268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:38:07.478268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:38:07.478268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:38:07.478268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:38:07.478268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:38:07.478268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:38:07.478268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:38:07.478268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:38:07.478268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:38:07.478268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:38:07.478268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:38:07.478268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application result.read() Aug 29 22:38:07.478268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:38:07.486814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application yield resource Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise self.value Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application session.commit() Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 22:38:07.487704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self.session.flush() Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application compat.raise_( Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 22:38:07.488635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:38:07.489486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application result.read() Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:38:07.490301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [parameters: {'id': '6df7ae6f01584f6c9435e9ce01779cf1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:07.491344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 22:38:07.492134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:07.492979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202d7e4-ca05-42d1-892c-a3284700287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:07.492979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202d7e4-ca05-42d1-892c-a3284700287c None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:07.492979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202d7e4-ca05-42d1-892c-a3284700287c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:07.492979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202d7e4-ca05-42d1-892c-a3284700287c None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:07.493230 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 225/476] 10.222.0.72 () {60 vars in 1131 bytes} [Mon Aug 29 22:38:07 2022] POST /identity/v3/roles => generated 144 bytes in 296 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:07.493302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202d7e4-ca05-42d1-892c-a3284700287c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:07.493302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202d7e4-ca05-42d1-892c-a3284700287c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:07.493302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202d7e4-ca05-42d1-892c-a3284700287c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:07.494911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774448d-464c-4bf0-ad0e-1a700bafdc05 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:07.504282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 252/477] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:07.515772 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202d7e4-ca05-42d1-892c-a3284700287c None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:07.630791 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202d7e4-ca05-42d1-892c-a3284700287c None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:07.670147 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f022c-1545-4208-920d-7058939ce240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:07.671131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f022c-1545-4208-920d-7058939ce240 None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:07.671440 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f022c-1545-4208-920d-7058939ce240 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:07.671720 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f022c-1545-4208-920d-7058939ce240 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:07.672408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f022c-1545-4208-920d-7058939ce240 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:07.673988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f022c-1545-4208-920d-7058939ce240 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:07.730076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774448d-464c-4bf0-ad0e-1a700bafdc05 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:07.764018 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 253/478] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:38:07 2022] POST /identity/v3/users => generated 249 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:38:07.788015 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830e217-f992-4128-a2b7-dff53c1be1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:07.788803 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830e217-f992-4128-a2b7-dff53c1be1cd None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:07.789135 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830e217-f992-4128-a2b7-dff53c1be1cd None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:07.789416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830e217-f992-4128-a2b7-dff53c1be1cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:07.804790 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830e217-f992-4128-a2b7-dff53c1be1cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-e830e217-f992-4128-a2b7-dff53c1be1cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:07.810417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:07.814204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:07.815197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:07.815197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:07.815197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:07.815197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:07.815197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:07.815197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:07.815197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:07.815197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:07.815197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:07.815197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:07.815197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:38:07.815197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:07.815197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 226/479] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:38:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:07.821502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f022c-1545-4208-920d-7058939ce240 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:07.891693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:07.974568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f022c-1545-4208-920d-7058939ce240 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:08.012307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb3375-fdd8-490a-a068-4fe69cd6b24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:08.013302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb3375-fdd8-490a-a068-4fe69cd6b24e None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:08.013769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb3375-fdd8-490a-a068-4fe69cd6b24e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:08.014876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb3375-fdd8-490a-a068-4fe69cd6b24e None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:08.015999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb3375-fdd8-490a-a068-4fe69cd6b24e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:08.016486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb3375-fdd8-490a-a068-4fe69cd6b24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:08.018051 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb3375-fdd8-490a-a068-4fe69cd6b24e None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:08.027333 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 254/480] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:09.080090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e33af-c865-45a3-845b-00edd24413a6 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:09.080643 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e33af-c865-45a3-845b-00edd24413a6 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:09.080643 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e33af-c865-45a3-845b-00edd24413a6 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:09.082288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 227/481] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:09.087804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec741111-b16a-49eb-8bd6-8eaf5cf13a90 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:09.088250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec741111-b16a-49eb-8bd6-8eaf5cf13a90 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:09.088446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec741111-b16a-49eb-8bd6-8eaf5cf13a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:09.121259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-ec741111-b16a-49eb-8bd6-8eaf5cf13a90 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:09.122485 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ec741111-b16a-49eb-8bd6-8eaf5cf13a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:09.206779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ce7cb-b32f-48b7-a21b-0a38341451da None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:09.207122 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ce7cb-b32f-48b7-a21b-0a38341451da None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:09.207617 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ce7cb-b32f-48b7-a21b-0a38341451da None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:09.210296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 228/482] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:09.214687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408645-03e1-405a-96dd-677705f96d8f None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:09.215029 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408645-03e1-405a-96dd-677705f96d8f None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:09.215366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408645-03e1-405a-96dd-677705f96d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:09.219827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 255/483] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:09.257230 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-0f408645-03e1-405a-96dd-677705f96d8f None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:09.258572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0f408645-03e1-405a-96dd-677705f96d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:09.277877 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:09.370108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 229/484] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:38:09.507202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec741111-b16a-49eb-8bd6-8eaf5cf13a90 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:09.554011 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:09.657833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec741111-b16a-49eb-8bd6-8eaf5cf13a90 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:09.712420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fee8c-0aa0-455a-9a71-3da290c30dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:09.712786 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f408645-03e1-405a-96dd-677705f96d8f None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:09.713069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fee8c-0aa0-455a-9a71-3da290c30dd1 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:09.713354 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fee8c-0aa0-455a-9a71-3da290c30dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:09.713630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fee8c-0aa0-455a-9a71-3da290c30dd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:09.733251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fee8c-0aa0-455a-9a71-3da290c30dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-2c1fee8c-0aa0-455a-9a71-3da290c30dd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:09.739995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:09.741066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:09.742113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:09.742113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:09.742113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:09.742113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:09.742113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:09.742113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:09.742113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:09.742113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:09.742113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:09.742113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:09.742113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:09.742113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:09.742113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 256/485] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:09.747917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fee8c-0aa0-455a-9a71-3da290c30dd1 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:09.900747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f408645-03e1-405a-96dd-677705f96d8f None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:09.908459 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:09.917857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fee8c-0aa0-455a-9a71-3da290c30dd1 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:09.956021 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044d4e8-af53-48a1-9d55-d5bbf0399ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:09.957046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044d4e8-af53-48a1-9d55-d5bbf0399ddc None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:09.957484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044d4e8-af53-48a1-9d55-d5bbf0399ddc None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:09.957911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044d4e8-af53-48a1-9d55-d5bbf0399ddc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:09.968121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf88d-3de9-461b-8d80-2b8f8b3cb3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:09.968861 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf88d-3de9-461b-8d80-2b8f8b3cb3e7 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:09.969218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf88d-3de9-461b-8d80-2b8f8b3cb3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:09.969612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf88d-3de9-461b-8d80-2b8f8b3cb3e7 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:09.970375 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bf88d-3de9-461b-8d80-2b8f8b3cb3e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:09.970723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bf88d-3de9-461b-8d80-2b8f8b3cb3e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:09.971692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044d4e8-af53-48a1-9d55-d5bbf0399ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:09.972317 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bf88d-3de9-461b-8d80-2b8f8b3cb3e7 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-1044d4e8-af53-48a1-9d55-d5bbf0399ddc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:09.977516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:09.978416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:09.979198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:09.979198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:09.979198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:09.979198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:09.979198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:09.979198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:09.979198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:09.979198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:09.979198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:09.979198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:09.979198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:09.979198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:09.981777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 230/486] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:09.982004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 257/487] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:09.984464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8899042-2a2d-420f-a75b-bb15459ee381 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:09.984896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8899042-2a2d-420f-a75b-bb15459ee381 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:09.985860 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8899042-2a2d-420f-a75b-bb15459ee381 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:09.987647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 231/488] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:09.989676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8899042-2a2d-420f-a75b-bb15459ee381 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:09.990303 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf88d-3de9-461b-8d80-2b8f8b3cb3e7 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:10.000524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:10.122770 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8899042-2a2d-420f-a75b-bb15459ee381 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:10.132079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf88d-3de9-461b-8d80-2b8f8b3cb3e7 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:10.172845 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a573d-72f0-4c65-a625-5430a1f6fce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:10.173485 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a573d-72f0-4c65-a625-5430a1f6fce0 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:10.173832 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a573d-72f0-4c65-a625-5430a1f6fce0 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:10.174114 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a573d-72f0-4c65-a625-5430a1f6fce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.175523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11768a0a-7083-4a9d-897e-59fed7a504a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:10.176715 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11768a0a-7083-4a9d-897e-59fed7a504a4 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:10.177007 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11768a0a-7083-4a9d-897e-59fed7a504a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:10.177314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11768a0a-7083-4a9d-897e-59fed7a504a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.178000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11768a0a-7083-4a9d-897e-59fed7a504a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:10.178312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11768a0a-7083-4a9d-897e-59fed7a504a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:10.179868 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11768a0a-7083-4a9d-897e-59fed7a504a4 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:10.193120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a573d-72f0-4c65-a625-5430a1f6fce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:10.194907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a573d-72f0-4c65-a625-5430a1f6fce0 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:10.195313 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 232/489] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:10.196904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1ec22-4835-4f17-85e8-eb0d51eb1e84 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:10.197191 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1ec22-4835-4f17-85e8-eb0d51eb1e84 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:10.197466 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1ec22-4835-4f17-85e8-eb0d51eb1e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-011a573d-72f0-4c65-a625-5430a1f6fce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:10.215312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:10.216300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:10.217830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:10.217830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:10.217830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:10.219904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-87d1ec22-4835-4f17-85e8-eb0d51eb1e84 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:10.220427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 258/490] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:10.221411 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-87d1ec22-4835-4f17-85e8-eb0d51eb1e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:10.221758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a573d-72f0-4c65-a625-5430a1f6fce0 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:10.235460 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:10.292784 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:10.299836 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 233/491] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:10.309116 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1ec22-4835-4f17-85e8-eb0d51eb1e84 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:10.346310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a573d-72f0-4c65-a625-5430a1f6fce0 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:10.386528 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320669c-23b0-4efd-b26e-66bc2a8ba032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:10.387316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320669c-23b0-4efd-b26e-66bc2a8ba032 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:10.387702 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320669c-23b0-4efd-b26e-66bc2a8ba032 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:10.391100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320669c-23b0-4efd-b26e-66bc2a8ba032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.406020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320669c-23b0-4efd-b26e-66bc2a8ba032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:10.407668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320669c-23b0-4efd-b26e-66bc2a8ba032 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-3320669c-23b0-4efd-b26e-66bc2a8ba032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:10.428365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:10.429409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:10.430427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:10.430427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:10.430427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:10.430427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 259/492] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:10.430427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce49dc-ea76-4500-abae-ac531f64530d None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:10.430427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce49dc-ea76-4500-abae-ac531f64530d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:10.430427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce49dc-ea76-4500-abae-ac531f64530d None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.436497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 260/493] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:10.436497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce49dc-ea76-4500-abae-ac531f64530d None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:10.445062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1ec22-4835-4f17-85e8-eb0d51eb1e84 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:10.485071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab85c5e-918e-43e6-ba0a-d1a42cdb9075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:10.485974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab85c5e-918e-43e6-ba0a-d1a42cdb9075 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:10.486445 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab85c5e-918e-43e6-ba0a-d1a42cdb9075 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:10.486897 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab85c5e-918e-43e6-ba0a-d1a42cdb9075 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.487733 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab85c5e-918e-43e6-ba0a-d1a42cdb9075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:10.488251 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab85c5e-918e-43e6-ba0a-d1a42cdb9075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:10.489851 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab85c5e-918e-43e6-ba0a-d1a42cdb9075 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:10.503897 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 234/494] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:10.505512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff196f2-343c-44c2-81f2-7bb1a91a4d9d None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:10.505974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff196f2-343c-44c2-81f2-7bb1a91a4d9d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:10.506424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff196f2-343c-44c2-81f2-7bb1a91a4d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.508078 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:10.526671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-1ff196f2-343c-44c2-81f2-7bb1a91a4d9d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:10.528178 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1ff196f2-343c-44c2-81f2-7bb1a91a4d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:10.558960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce49dc-ea76-4500-abae-ac531f64530d None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:10.589236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:10.602368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ada2de-e960-4897-a361-573abbdfbd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:10.603031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ada2de-e960-4897-a361-573abbdfbd36 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:10.612446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ada2de-e960-4897-a361-573abbdfbd36 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:10.612613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 235/495] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:10.612704 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ada2de-e960-4897-a361-573abbdfbd36 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.612704 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ada2de-e960-4897-a361-573abbdfbd36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:10.612869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff196f2-343c-44c2-81f2-7bb1a91a4d9d None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:10.612952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ada2de-e960-4897-a361-573abbdfbd36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:10.612952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ada2de-e960-4897-a361-573abbdfbd36 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:10.635422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 261/496] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:10.636364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ada2de-e960-4897-a361-573abbdfbd36 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:10.751121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff196f2-343c-44c2-81f2-7bb1a91a4d9d None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:10.756331 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ada2de-e960-4897-a361-573abbdfbd36 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:10.776425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:10.791962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000dcb9b-0a69-4be4-b1da-64c7d073a07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:10.792696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dcb9b-0a69-4be4-b1da-64c7d073a07b None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:10.792975 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dcb9b-0a69-4be4-b1da-64c7d073a07b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:10.793254 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dcb9b-0a69-4be4-b1da-64c7d073a07b None admin] PATH_INFO: `/v3/users/glance` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.799198 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a3ee5-7969-45de-9343-c4aacdad4b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:10.799848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a3ee5-7969-45de-9343-c4aacdad4b07 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:10.800126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a3ee5-7969-45de-9343-c4aacdad4b07 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:10.800511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a3ee5-7969-45de-9343-c4aacdad4b07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.803328 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000dcb9b-0a69-4be4-b1da-64c7d073a07b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:10.805003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000dcb9b-0a69-4be4-b1da-64c7d073a07b None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:10.812048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a3ee5-7969-45de-9343-c4aacdad4b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-cf1a3ee5-7969-45de-9343-c4aacdad4b07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:10.817008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:10.818066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:10.821285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:10.821285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:10.821285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:10.821285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:10.821285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:10.821285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:10.821285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:10.821285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:10.821285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:10.821285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:10.821285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:10.821285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:10.821285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 262/497] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:10.821285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98732eb7-10f5-48e7-9025-f11558f65bdf None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:10.821988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98732eb7-10f5-48e7-9025-f11558f65bdf None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:10.821988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98732eb7-10f5-48e7-9025-f11558f65bdf None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.822718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 263/498] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:10.825205 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98732eb7-10f5-48e7-9025-f11558f65bdf None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-000dcb9b-0a69-4be4-b1da-64c7d073a07b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:10.827274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:10.828405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:10.829309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:10.829309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:10.829309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:10.829309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:10.829309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:10.829309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:10.829309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:10.829309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:10.829309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:38:10.829309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:10.829309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 236/499] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:38:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:10.830524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000dcb9b-0a69-4be4-b1da-64c7d073a07b None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:10.887991 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:10.943144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000dcb9b-0a69-4be4-b1da-64c7d073a07b None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:10.947591 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98732eb7-10f5-48e7-9025-f11558f65bdf None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:10.978498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e7dd7-9983-4d78-b4a9-ef31a5a18cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:10.979111 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e7dd7-9983-4d78-b4a9-ef31a5a18cb6 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:10.979401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e7dd7-9983-4d78-b4a9-ef31a5a18cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:10.979671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e7dd7-9983-4d78-b4a9-ef31a5a18cb6 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.980374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e7dd7-9983-4d78-b4a9-ef31a5a18cb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:10.980680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e7dd7-9983-4d78-b4a9-ef31a5a18cb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:10.982096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e7dd7-9983-4d78-b4a9-ef31a5a18cb6 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:10.983771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc8eeb-1b60-4fa2-a2c1-869a263b60ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:10.984469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc8eeb-1b60-4fa2-a2c1-869a263b60ea None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:10.984747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc8eeb-1b60-4fa2-a2c1-869a263b60ea None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:10.985017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc8eeb-1b60-4fa2-a2c1-869a263b60ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.991316 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 237/500] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:10.992559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70b292-e364-4d4e-8198-c40d6323b32a None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:10.992847 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70b292-e364-4d4e-8198-c40d6323b32a None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:10.993122 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70b292-e364-4d4e-8198-c40d6323b32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.997116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc8eeb-1b60-4fa2-a2c1-869a263b60ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:10.998645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc8eeb-1b60-4fa2-a2c1-869a263b60ea None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:11.012251 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-da70b292-e364-4d4e-8198-c40d6323b32a None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-50fc8eeb-1b60-4fa2-a2c1-869a263b60ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:11.012413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:11.013369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:11.014299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:11.014299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:11.014299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:11.014299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:11.014299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:11.014299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:11.014299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:11.014299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:11.014299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:38:11.014299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:11.015277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-da70b292-e364-4d4e-8198-c40d6323b32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:11.015348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 264/501] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Aug 29 22:38:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:11.015348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc8eeb-1b60-4fa2-a2c1-869a263b60ea None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:11.062065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:11.087406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 238/502] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:11.088280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70b292-e364-4d4e-8198-c40d6323b32a None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:11.129708 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc8eeb-1b60-4fa2-a2c1-869a263b60ea None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:11.134037 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:11.168857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058255b1-4f8f-4f22-ba1c-62192d4a419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:11.169580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058255b1-4f8f-4f22-ba1c-62192d4a419d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:11.169746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058255b1-4f8f-4f22-ba1c-62192d4a419d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:11.170038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058255b1-4f8f-4f22-ba1c-62192d4a419d None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:11.170781 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058255b1-4f8f-4f22-ba1c-62192d4a419d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:11.171090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058255b1-4f8f-4f22-ba1c-62192d4a419d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:11.172594 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058255b1-4f8f-4f22-ba1c-62192d4a419d None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:11.203480 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70b292-e364-4d4e-8198-c40d6323b32a None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:11.215110 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 265/503] 10.222.0.72 () {56 vars in 1137 bytes} [Mon Aug 29 22:38:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:11.215955 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058255b1-4f8f-4f22-ba1c-62192d4a419d None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:11.243953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f99df4-0dd7-42f8-96b7-66393bd71a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:11.245059 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f99df4-0dd7-42f8-96b7-66393bd71a73 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:11.245341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f99df4-0dd7-42f8-96b7-66393bd71a73 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:11.245767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f99df4-0dd7-42f8-96b7-66393bd71a73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:11.256637 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f99df4-0dd7-42f8-96b7-66393bd71a73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-80f99df4-0dd7-42f8-96b7-66393bd71a73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:11.261624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:11.262564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:11.264977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:11.264977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:11.264977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:11.264977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:11.264977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:11.264977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:11.264977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:11.264977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:11.264977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:11.264977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:11.264977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:11.264977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:11.264977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 239/504] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:11.264977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f99df4-0dd7-42f8-96b7-66393bd71a73 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:11.333070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:11.339666 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058255b1-4f8f-4f22-ba1c-62192d4a419d None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:11.374077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:11.376885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f99df4-0dd7-42f8-96b7-66393bd71a73 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:11.378547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304735b4-2fe2-496a-b939-f82c034624ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:11.379181 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304735b4-2fe2-496a-b939-f82c034624ad None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:11.379455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304735b4-2fe2-496a-b939-f82c034624ad None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:11.379725 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304735b4-2fe2-496a-b939-f82c034624ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:11.390831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304735b4-2fe2-496a-b939-f82c034624ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:11.392341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304735b4-2fe2-496a-b939-f82c034624ad None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-304735b4-2fe2-496a-b939-f82c034624ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:11.408536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:11.409669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:11.410695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:11.410695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:11.410695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:11.410695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 266/505] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:11.410695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304735b4-2fe2-496a-b939-f82c034624ad None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:11.417018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54d320-1494-4474-bfe4-11788443053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:11.417636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54d320-1494-4474-bfe4-11788443053c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:11.418023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54d320-1494-4474-bfe4-11788443053c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:11.418195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54d320-1494-4474-bfe4-11788443053c None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:11.418924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54d320-1494-4474-bfe4-11788443053c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:11.419315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54d320-1494-4474-bfe4-11788443053c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:11.421750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54d320-1494-4474-bfe4-11788443053c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:11.466641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 240/506] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Aug 29 22:38:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:11.469108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54d320-1494-4474-bfe4-11788443053c None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:11.534467 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304735b4-2fe2-496a-b939-f82c034624ad None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:11.569594 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b563c-cd77-407a-b535-1e36b68a8a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:11.570200 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b563c-cd77-407a-b535-1e36b68a8a57 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:11.570473 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b563c-cd77-407a-b535-1e36b68a8a57 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:11.570740 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b563c-cd77-407a-b535-1e36b68a8a57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:11.586311 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54d320-1494-4474-bfe4-11788443053c None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:11.596109 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:11.621258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ec6fc-f157-4336-b627-74b48b8c8a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:11.621873 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ec6fc-f157-4336-b627-74b48b8c8a76 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:11.622157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ec6fc-f157-4336-b627-74b48b8c8a76 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:11.622432 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ec6fc-f157-4336-b627-74b48b8c8a76 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:11.623640 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ec6fc-f157-4336-b627-74b48b8c8a76 None admin] RBAC: Adding query filter params (name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:11.624159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ec6fc-f157-4336-b627-74b48b8c8a76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:11.625651 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ec6fc-f157-4336-b627-74b48b8c8a76 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:11.633845 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 241/507] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:11.634646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ec6fc-f157-4336-b627-74b48b8c8a76 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:11.655513 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b563c-cd77-407a-b535-1e36b68a8a57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:11.657073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b563c-cd77-407a-b535-1e36b68a8a57 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:11.658104 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:11.740615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ec6fc-f157-4336-b627-74b48b8c8a76 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:11.761016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 267/508] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:11.761669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b563c-cd77-407a-b535-1e36b68a8a57 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:11.778382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52f5c9-2433-4908-8c21-f91a8718c9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:11.779010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52f5c9-2433-4908-8c21-f91a8718c9f5 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:11.779290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52f5c9-2433-4908-8c21-f91a8718c9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:11.779659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52f5c9-2433-4908-8c21-f91a8718c9f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:11.792696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52f5c9-2433-4908-8c21-f91a8718c9f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:11.794179 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52f5c9-2433-4908-8c21-f91a8718c9f5 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-ae52f5c9-2433-4908-8c21-f91a8718c9f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:11.809883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:11.811779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:11.812671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:11.812671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:11.812671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:11.813768 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 242/509] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:11.814387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52f5c9-2433-4908-8c21-f91a8718c9f5 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:11.816525 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:11.871997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b563c-cd77-407a-b535-1e36b68a8a57 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:11.892630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:11.908501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57254a-5f88-498f-8786-9bcfd5564708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:11.909117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57254a-5f88-498f-8786-9bcfd5564708 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:11.909391 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57254a-5f88-498f-8786-9bcfd5564708 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:11.909661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57254a-5f88-498f-8786-9bcfd5564708 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:11.910370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57254a-5f88-498f-8786-9bcfd5564708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:11.910674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57254a-5f88-498f-8786-9bcfd5564708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:11.912040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57254a-5f88-498f-8786-9bcfd5564708 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:11.924614 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 268/510] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:11.925479 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57254a-5f88-498f-8786-9bcfd5564708 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:11.929558 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52f5c9-2433-4908-8c21-f91a8718c9f5 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:11.965076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63725440-c45e-4557-b7ea-451be8f0f2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:11.965683 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63725440-c45e-4557-b7ea-451be8f0f2db None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:11.965966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63725440-c45e-4557-b7ea-451be8f0f2db None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:11.966242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63725440-c45e-4557-b7ea-451be8f0f2db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:12.034237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57254a-5f88-498f-8786-9bcfd5564708 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:12.041832 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63725440-c45e-4557-b7ea-451be8f0f2db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:12.043376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63725440-c45e-4557-b7ea-451be8f0f2db None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:12.043501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:12.068846 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddfedd-3c77-456d-97ef-f3473bcca2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:12.069574 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddfedd-3c77-456d-97ef-f3473bcca2f5 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:12.069849 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddfedd-3c77-456d-97ef-f3473bcca2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:12.070122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddfedd-3c77-456d-97ef-f3473bcca2f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:12.081358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddfedd-3c77-456d-97ef-f3473bcca2f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:12.082836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddfedd-3c77-456d-97ef-f3473bcca2f5 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-27ddfedd-3c77-456d-97ef-f3473bcca2f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:12.099472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:12.100457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:12.106572 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:12.106572 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:12.106572 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:12.106572 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 269/511] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:12.106572 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddfedd-3c77-456d-97ef-f3473bcca2f5 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:12.116165 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:12.150310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 243/512] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:12.151269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63725440-c45e-4557-b7ea-451be8f0f2db None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:12.210732 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddfedd-3c77-456d-97ef-f3473bcca2f5 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:12.247504 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1119c6-3502-4853-a000-d45478fd030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:12.248338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1119c6-3502-4853-a000-d45478fd030f None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:12.248640 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1119c6-3502-4853-a000-d45478fd030f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:12.249100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1119c6-3502-4853-a000-d45478fd030f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:12.255532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63725440-c45e-4557-b7ea-451be8f0f2db None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:12.260320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1119c6-3502-4853-a000-d45478fd030f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:12.261807 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1119c6-3502-4853-a000-d45478fd030f None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-6c1119c6-3502-4853-a000-d45478fd030f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:12.276657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:12.277589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:12.278461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:12.278461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:12.278461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:12.278461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 270/513] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:12.278895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1119c6-3502-4853-a000-d45478fd030f None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:12.293095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17463a48-06c8-4d6f-8941-f30c5dc3dd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:12.293774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17463a48-06c8-4d6f-8941-f30c5dc3dd20 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:12.294000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17463a48-06c8-4d6f-8941-f30c5dc3dd20 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:12.294278 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17463a48-06c8-4d6f-8941-f30c5dc3dd20 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:12.294933 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17463a48-06c8-4d6f-8941-f30c5dc3dd20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:12.295815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17463a48-06c8-4d6f-8941-f30c5dc3dd20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:12.297264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17463a48-06c8-4d6f-8941-f30c5dc3dd20 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:12.299232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:12.308804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 244/514] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:12.309670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17463a48-06c8-4d6f-8941-f30c5dc3dd20 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:12.345501 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:12.389623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1119c6-3502-4853-a000-d45478fd030f None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:12.419047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17463a48-06c8-4d6f-8941-f30c5dc3dd20 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:12.429314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b019192-8e25-49e9-94be-ca7b73b4f26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:12.429957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b019192-8e25-49e9-94be-ca7b73b4f26d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:12.430237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b019192-8e25-49e9-94be-ca7b73b4f26d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:12.430534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b019192-8e25-49e9-94be-ca7b73b4f26d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:12.439119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b019192-8e25-49e9-94be-ca7b73b4f26d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:12.440532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b019192-8e25-49e9-94be-ca7b73b4f26d None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-5b019192-8e25-49e9-94be-ca7b73b4f26d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:12.452745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:12.453719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:12.454603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:12.454603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:12.454603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:12.454603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:12.454603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:12.454603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:12.454603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:12.454603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:12.454603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:38:12.454603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:12.454603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 271/515] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:38:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:12.454603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b019192-8e25-49e9-94be-ca7b73b4f26d None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:12.459582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c9e06-718e-4da1-975c-23f3cb047ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:12.460229 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c9e06-718e-4da1-975c-23f3cb047ca3 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:12.460504 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c9e06-718e-4da1-975c-23f3cb047ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:12.460781 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c9e06-718e-4da1-975c-23f3cb047ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:12.461430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c9e06-718e-4da1-975c-23f3cb047ca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:12.461807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c9e06-718e-4da1-975c-23f3cb047ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:12.463126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c9e06-718e-4da1-975c-23f3cb047ca3 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:12.476994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 245/516] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:12.477818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c9e06-718e-4da1-975c-23f3cb047ca3 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:12.525807 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:12.556420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b019192-8e25-49e9-94be-ca7b73b4f26d None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:12.572779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:12.583402 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c9e06-718e-4da1-975c-23f3cb047ca3 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:12.593750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3f450-3c7d-4cd7-b9ca-bc63a8b3763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:12.594392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3f450-3c7d-4cd7-b9ca-bc63a8b3763b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:12.594671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3f450-3c7d-4cd7-b9ca-bc63a8b3763b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:12.594946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3f450-3c7d-4cd7-b9ca-bc63a8b3763b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:12.605952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3f450-3c7d-4cd7-b9ca-bc63a8b3763b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:12.607505 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3f450-3c7d-4cd7-b9ca-bc63a8b3763b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:12.622556 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362a078-f106-4e0a-82f9-d1d1a94a114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-bff3f450-3c7d-4cd7-b9ca-bc63a8b3763b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:12.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:12.624551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:12.625393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:12.625393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:12.625393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:12.625552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362a078-f106-4e0a-82f9-d1d1a94a114c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:12.625552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362a078-f106-4e0a-82f9-d1d1a94a114c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:12.625552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362a078-f106-4e0a-82f9-d1d1a94a114c None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:12.625717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 272/517] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:12.625788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362a078-f106-4e0a-82f9-d1d1a94a114c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:12.625788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362a078-f106-4e0a-82f9-d1d1a94a114c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:12.625902 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3f450-3c7d-4cd7-b9ca-bc63a8b3763b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:12.626259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362a078-f106-4e0a-82f9-d1d1a94a114c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:12.638102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 246/518] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:12.639479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362a078-f106-4e0a-82f9-d1d1a94a114c None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:12.734052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3f450-3c7d-4cd7-b9ca-bc63a8b3763b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:12.746682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362a078-f106-4e0a-82f9-d1d1a94a114c None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:12.760112 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:12.773145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3f12d-a02a-44b3-91c6-2f2616ece1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:12.773778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3f12d-a02a-44b3-91c6-2f2616ece1d3 None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:12.774062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3f12d-a02a-44b3-91c6-2f2616ece1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:12.774338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3f12d-a02a-44b3-91c6-2f2616ece1d3 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:12.775099 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3f12d-a02a-44b3-91c6-2f2616ece1d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:12.776549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3f12d-a02a-44b3-91c6-2f2616ece1d3 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:12.783861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a5663-90f2-4878-9f3f-32a49f56bcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:12.784525 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a5663-90f2-4878-9f3f-32a49f56bcbd None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:12.784811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a5663-90f2-4878-9f3f-32a49f56bcbd None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:12.785088 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a5663-90f2-4878-9f3f-32a49f56bcbd None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:12.785841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a5663-90f2-4878-9f3f-32a49f56bcbd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:12.786153 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a5663-90f2-4878-9f3f-32a49f56bcbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:12.787615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a5663-90f2-4878-9f3f-32a49f56bcbd None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:12.806168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 247/519] 10.222.0.72 () {56 vars in 1137 bytes} [Mon Aug 29 22:38:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:12.807048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a5663-90f2-4878-9f3f-32a49f56bcbd None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:12.819160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:12.870472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 273/520] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:38:12 2022] POST /identity/v3/users => generated 247 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:38:12.871527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3f12d-a02a-44b3-91c6-2f2616ece1d3 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:12.929145 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a5663-90f2-4878-9f3f-32a49f56bcbd None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:12.969861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8039a7c-0832-4564-bf4c-eb831474839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:12.970314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8039a7c-0832-4564-bf4c-eb831474839a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:12.970651 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8039a7c-0832-4564-bf4c-eb831474839a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:12.970937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8039a7c-0832-4564-bf4c-eb831474839a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:12.982566 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8039a7c-0832-4564-bf4c-eb831474839a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:12.984848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8039a7c-0832-4564-bf4c-eb831474839a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-f8039a7c-0832-4564-bf4c-eb831474839a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:12.997793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:12.999040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:13.000115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:13.000115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:13.000115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:13.000115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:13.000115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:13.000115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:13.000115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:13.000115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:13.000115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:38:13.000115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:13.000115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 248/521] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:13.000115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8039a7c-0832-4564-bf4c-eb831474839a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:13.015518 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3f12d-a02a-44b3-91c6-2f2616ece1d3 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:13.058833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72edc4-2245-4fe9-907b-173ee8a1cb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:13.060424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72edc4-2245-4fe9-907b-173ee8a1cb59 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:13.060424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72edc4-2245-4fe9-907b-173ee8a1cb59 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:13.060424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72edc4-2245-4fe9-907b-173ee8a1cb59 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:13.061288 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72edc4-2245-4fe9-907b-173ee8a1cb59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:13.061509 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72edc4-2245-4fe9-907b-173ee8a1cb59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:13.062911 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72edc4-2245-4fe9-907b-173ee8a1cb59 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:13.075759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 274/522] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:13.077247 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72edc4-2245-4fe9-907b-173ee8a1cb59 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:13.090042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:13.124630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:13.127758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8039a7c-0832-4564-bf4c-eb831474839a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:13.171415 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f25a-258b-4e77-882e-7cd98e968ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:13.172091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f25a-258b-4e77-882e-7cd98e968ee7 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:13.172401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f25a-258b-4e77-882e-7cd98e968ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:13.172639 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f25a-258b-4e77-882e-7cd98e968ee7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:13.180072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019f25a-258b-4e77-882e-7cd98e968ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:13.181597 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019f25a-258b-4e77-882e-7cd98e968ee7 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:13.193483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72edc4-2245-4fe9-907b-173ee8a1cb59 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:13.196530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-f019f25a-258b-4e77-882e-7cd98e968ee7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:13.196530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:13.196530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:13.196530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:13.196530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:13.196530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:13.196530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:13.196530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:13.196530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:13.196530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:13.196530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:13.196530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:13.196530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:13.196530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:13.196530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:13.197447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:13.198284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:13.198284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:13.198284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:13.198284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:13.198284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:13.198284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:13.198284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:13.198284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:13.198284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 249/523] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:13.198284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f25a-258b-4e77-882e-7cd98e968ee7 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:13.249514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0dc72-6cb9-45eb-acc0-143357d6ed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:13.250233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0dc72-6cb9-45eb-acc0-143357d6ed33 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:13.250451 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0dc72-6cb9-45eb-acc0-143357d6ed33 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:13.250724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0dc72-6cb9-45eb-acc0-143357d6ed33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:13.332633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0dc72-6cb9-45eb-acc0-143357d6ed33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:13.334240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0dc72-6cb9-45eb-acc0-143357d6ed33 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:13.345220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f25a-258b-4e77-882e-7cd98e968ee7 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:13.378732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:13.386782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:13.393092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e17de8-d763-42c5-b063-0c0d7e688e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:13.396046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17de8-d763-42c5-b063-0c0d7e688e3f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:13.396046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17de8-d763-42c5-b063-0c0d7e688e3f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:13.396046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17de8-d763-42c5-b063-0c0d7e688e3f None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:13.396046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e17de8-d763-42c5-b063-0c0d7e688e3f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:13.396046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e17de8-d763-42c5-b063-0c0d7e688e3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:13.396934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e17de8-d763-42c5-b063-0c0d7e688e3f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:13.419186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 250/524] 10.222.0.72 () {56 vars in 1139 bytes} [Mon Aug 29 22:38:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:13.420756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e17de8-d763-42c5-b063-0c0d7e688e3f None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:13.470303 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 275/525] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:13.470303 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0dc72-6cb9-45eb-acc0-143357d6ed33 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:13.553114 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e17de8-d763-42c5-b063-0c0d7e688e3f None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:13.582886 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0dc72-6cb9-45eb-acc0-143357d6ed33 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:13.595627 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe2249-0f18-404d-8c1d-2066dda82dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:13.596447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe2249-0f18-404d-8c1d-2066dda82dfe None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:13.596656 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe2249-0f18-404d-8c1d-2066dda82dfe None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:13.596885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe2249-0f18-404d-8c1d-2066dda82dfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:13.605685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe2249-0f18-404d-8c1d-2066dda82dfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:13.607175 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe2249-0f18-404d-8c1d-2066dda82dfe None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:13.620059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108736e7-dbb2-470f-81ca-9a104419a672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:13.620703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108736e7-dbb2-470f-81ca-9a104419a672 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:13.620984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108736e7-dbb2-470f-81ca-9a104419a672 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:13.621258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108736e7-dbb2-470f-81ca-9a104419a672 None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:13.621959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108736e7-dbb2-470f-81ca-9a104419a672 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:13.622053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-5bfe2249-0f18-404d-8c1d-2066dda82dfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:13.622053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:13.622053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:13.622053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:13.622053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:13.622053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:13.622053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:13.622053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:13.622053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:13.622053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:13.622053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:13.622053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:13.622053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:13.622053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:13.622053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:13.622814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:13.624776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:13.624776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:13.624776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:13.624776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:13.624776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:13.624776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:13.624776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:13.624776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:13.625202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108736e7-dbb2-470f-81ca-9a104419a672 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:13.625270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 251/526] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:13.625270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe2249-0f18-404d-8c1d-2066dda82dfe None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:13.629234 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108736e7-dbb2-470f-81ca-9a104419a672 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:13.644220 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:13.649278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 276/527] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:13.653579 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108736e7-dbb2-470f-81ca-9a104419a672 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:13.684857 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:13.751997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe2249-0f18-404d-8c1d-2066dda82dfe None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:13.761632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108736e7-dbb2-470f-81ca-9a104419a672 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:13.792500 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeec596-a5d6-4052-9d83-fada0e89806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:13.793114 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeec596-a5d6-4052-9d83-fada0e89806c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:13.793393 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeec596-a5d6-4052-9d83-fada0e89806c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:13.793664 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeec596-a5d6-4052-9d83-fada0e89806c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:13.801370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b825074-dec0-4e45-9cf6-b8f1c1e7eb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:13.802004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b825074-dec0-4e45-9cf6-b8f1c1e7eb15 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:13.802286 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b825074-dec0-4e45-9cf6-b8f1c1e7eb15 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:13.802585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b825074-dec0-4e45-9cf6-b8f1c1e7eb15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:13.813788 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b825074-dec0-4e45-9cf6-b8f1c1e7eb15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:13.815276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b825074-dec0-4e45-9cf6-b8f1c1e7eb15 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-2b825074-dec0-4e45-9cf6-b8f1c1e7eb15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:13.834090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:13.835322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:13.836476 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:13.836476 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:13.836476 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:13.836476 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 277/528] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:13.836476 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b825074-dec0-4e45-9cf6-b8f1c1e7eb15 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:13.879383 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeec596-a5d6-4052-9d83-fada0e89806c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:13.880892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeec596-a5d6-4052-9d83-fada0e89806c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:13.912394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:13.946224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:13.968331 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b825074-dec0-4e45-9cf6-b8f1c1e7eb15 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:14.003864 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 252/529] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:14.004723 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeec596-a5d6-4052-9d83-fada0e89806c None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:14.010262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b78480-e961-469c-82b4-3efff90d95d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:14.010847 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b78480-e961-469c-82b4-3efff90d95d7 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:14.011123 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b78480-e961-469c-82b4-3efff90d95d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:14.011394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b78480-e961-469c-82b4-3efff90d95d7 None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:14.012100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b78480-e961-469c-82b4-3efff90d95d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:14.012438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b78480-e961-469c-82b4-3efff90d95d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:14.014914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b78480-e961-469c-82b4-3efff90d95d7 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:14.034334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 278/530] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:14.034334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b78480-e961-469c-82b4-3efff90d95d7 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:14.124163 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeec596-a5d6-4052-9d83-fada0e89806c None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:14.148567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b78480-e961-469c-82b4-3efff90d95d7 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:14.162862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:14.164054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092d3fb-ef51-447c-bbb7-e5d34a34ca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:14.164714 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092d3fb-ef51-447c-bbb7-e5d34a34ca53 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:14.165064 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092d3fb-ef51-447c-bbb7-e5d34a34ca53 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:14.165399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092d3fb-ef51-447c-bbb7-e5d34a34ca53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:14.166203 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092d3fb-ef51-447c-bbb7-e5d34a34ca53 None admin] RBAC: Adding query filter params (role.id=14efd2033a754e9b9143349f4994e356, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=c7e72cc048a0418cac062d68b8df402f) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:14.166577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092d3fb-ef51-447c-bbb7-e5d34a34ca53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:14.168085 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092d3fb-ef51-447c-bbb7-e5d34a34ca53 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:14.180230 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 253/531] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:14 2022] GET /identity/v3/role_assignments?user.id=c7e72cc048a0418cac062d68b8df402f&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=14efd2033a754e9b9143349f4994e356 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:14.180230 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092d3fb-ef51-447c-bbb7-e5d34a34ca53 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:14.201852 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9436483-ae8f-4dee-9439-588582784130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:14.202898 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9436483-ae8f-4dee-9439-588582784130 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:14.203245 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9436483-ae8f-4dee-9439-588582784130 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:14.203585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9436483-ae8f-4dee-9439-588582784130 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:14.204648 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:14.205156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9436483-ae8f-4dee-9439-588582784130 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:14.205541 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9436483-ae8f-4dee-9439-588582784130 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:14.207081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9436483-ae8f-4dee-9439-588582784130 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:14.222284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 279/532] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:14.223253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9436483-ae8f-4dee-9439-588582784130 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:14.325103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092d3fb-ef51-447c-bbb7-e5d34a34ca53 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:14.356352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9436483-ae8f-4dee-9439-588582784130 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:14.365535 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a60fa7-4d4b-470f-a3b6-df515a2a72b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:14.366549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a60fa7-4d4b-470f-a3b6-df515a2a72b7 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:14.367030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a60fa7-4d4b-470f-a3b6-df515a2a72b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:14.367496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a60fa7-4d4b-470f-a3b6-df515a2a72b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:14.380379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a60fa7-4d4b-470f-a3b6-df515a2a72b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:14.382146 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a60fa7-4d4b-470f-a3b6-df515a2a72b7 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-94a60fa7-4d4b-470f-a3b6-df515a2a72b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:14.405577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:14.406498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:14.407989 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:14.407989 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:14.407989 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:14.407989 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 254/533] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:14.407989 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a60fa7-4d4b-470f-a3b6-df515a2a72b7 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:14.411141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3798cd-076c-4c0f-bf14-bf8837cfdba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:14.411141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3798cd-076c-4c0f-bf14-bf8837cfdba6 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:14.411141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3798cd-076c-4c0f-bf14-bf8837cfdba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:14.411141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3798cd-076c-4c0f-bf14-bf8837cfdba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:14.411505 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3798cd-076c-4c0f-bf14-bf8837cfdba6 None admin] RBAC: Adding query filter params (role.id=14efd2033a754e9b9143349f4994e356, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=0be09bd9ba7443aaa31879f56ca4aad1) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:14.411505 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3798cd-076c-4c0f-bf14-bf8837cfdba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:14.413158 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3798cd-076c-4c0f-bf14-bf8837cfdba6 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:14.427969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 280/534] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:14 2022] GET /identity/v3/role_assignments?user.id=0be09bd9ba7443aaa31879f56ca4aad1&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=14efd2033a754e9b9143349f4994e356 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:14.429097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3798cd-076c-4c0f-bf14-bf8837cfdba6 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:14.505044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:14.566297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:14.635038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a60fa7-4d4b-470f-a3b6-df515a2a72b7 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:14.660966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3798cd-076c-4c0f-bf14-bf8837cfdba6 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:14.678235 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e0a44-49e2-437e-a0b3-d1e9fa7d7354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:14.679376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e0a44-49e2-437e-a0b3-d1e9fa7d7354 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:14.680667 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e0a44-49e2-437e-a0b3-d1e9fa7d7354 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:14.681357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e0a44-49e2-437e-a0b3-d1e9fa7d7354 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:14.693600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e0a44-49e2-437e-a0b3-d1e9fa7d7354 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:14.695453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e0a44-49e2-437e-a0b3-d1e9fa7d7354 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:14.712739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-e53e0a44-49e2-437e-a0b3-d1e9fa7d7354 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:14.712739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:14.712739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:14.712739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:14.712739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:14.712739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:14.712739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:14.712739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:14.712739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:14.712739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:14.712739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:14.712739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:14.712739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:14.712739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:14.712739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:14.713718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:14.714540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:14.714540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:14.714540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:14.714540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:14.714540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:14.714540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:14.714540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:14.714540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:14.722673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 255/535] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:14.729484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e0a44-49e2-437e-a0b3-d1e9fa7d7354 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:14.730694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2e228-d79c-477e-864b-75a84646141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:14.731822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2e228-d79c-477e-864b-75a84646141e None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:14.734747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2e228-d79c-477e-864b-75a84646141e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:14.735218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2e228-d79c-477e-864b-75a84646141e None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:14.736866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2e228-d79c-477e-864b-75a84646141e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:14.737315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2e228-d79c-477e-864b-75a84646141e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:14.742116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2e228-d79c-477e-864b-75a84646141e None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:14.766455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 281/536] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:14.770814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2e228-d79c-477e-864b-75a84646141e None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:14.934726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:14.953000 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2e228-d79c-477e-864b-75a84646141e None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:14.970216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e0a44-49e2-437e-a0b3-d1e9fa7d7354 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:15.002246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:15.007397 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c2810-4853-4368-ae7f-64e574f84054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:15.008030 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c2810-4853-4368-ae7f-64e574f84054 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:15.008354 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c2810-4853-4368-ae7f-64e574f84054 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:15.008716 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c2810-4853-4368-ae7f-64e574f84054 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:15.018163 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c2810-4853-4368-ae7f-64e574f84054 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:15.019666 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c2810-4853-4368-ae7f-64e574f84054 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:15.020121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8a240-0c1a-456c-b12b-1b30dbbe6f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:15.021053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8a240-0c1a-456c-b12b-1b30dbbe6f4d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:15.021878 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8a240-0c1a-456c-b12b-1b30dbbe6f4d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:15.022299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8a240-0c1a-456c-b12b-1b30dbbe6f4d None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:15.023675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8a240-0c1a-456c-b12b-1b30dbbe6f4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:15.024146 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8a240-0c1a-456c-b12b-1b30dbbe6f4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:15.025776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8a240-0c1a-456c-b12b-1b30dbbe6f4d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:15.035916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-284c2810-4853-4368-ae7f-64e574f84054 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:15.035916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:15.035916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:15.035916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:15.035916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:15.035916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:15.035916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:15.035916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:15.035916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:15.035916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:15.035916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:15.035916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:15.035916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:15.035916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:15.035916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:15.037060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:15.038068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:15.038068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:15.038068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:15.038068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:15.038068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:15.038068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:15.038068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:15.038068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:15.038068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 282/537] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:15.038580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3128e-34d5-4c45-a577-ed3db36c910b None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:15.038861 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3128e-34d5-4c45-a577-ed3db36c910b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:15.039129 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3128e-34d5-4c45-a577-ed3db36c910b None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:15.044501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 283/538] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:15.045542 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3128e-34d5-4c45-a577-ed3db36c910b None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:15.053037 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 256/539] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:15.054620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162278ac-649c-49ad-9176-a5460c21b19f None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:15.055737 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162278ac-649c-49ad-9176-a5460c21b19f None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:15.056313 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162278ac-649c-49ad-9176-a5460c21b19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:15.082546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-162278ac-649c-49ad-9176-a5460c21b19f None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:15.084810 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-162278ac-649c-49ad-9176-a5460c21b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:15.172614 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 257/540] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:15.173597 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162278ac-649c-49ad-9176-a5460c21b19f None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:15.179773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3128e-34d5-4c45-a577-ed3db36c910b None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:15.281890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d187e-49b6-4d02-ae26-5501ba0abb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:15.282505 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d187e-49b6-4d02-ae26-5501ba0abb7b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:15.282766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d187e-49b6-4d02-ae26-5501ba0abb7b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:15.283041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d187e-49b6-4d02-ae26-5501ba0abb7b None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:15.283747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d187e-49b6-4d02-ae26-5501ba0abb7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:15.284052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d187e-49b6-4d02-ae26-5501ba0abb7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:15.285756 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d187e-49b6-4d02-ae26-5501ba0abb7b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:15.314418 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 284/541] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:15.320528 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d187e-49b6-4d02-ae26-5501ba0abb7b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:15.333229 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162278ac-649c-49ad-9176-a5460c21b19f None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:15.342873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:15.356833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:15.401962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848005c-9d54-4db7-b2ca-0b3a9dd69002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:15.402584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848005c-9d54-4db7-b2ca-0b3a9dd69002 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:15.402883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848005c-9d54-4db7-b2ca-0b3a9dd69002 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:15.403364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848005c-9d54-4db7-b2ca-0b3a9dd69002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:15.404779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848005c-9d54-4db7-b2ca-0b3a9dd69002 None admin] RBAC: Adding query filter params (role.id=14efd2033a754e9b9143349f4994e356, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=e187bd54667a46c4a234d4aff23e1777) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:15.406756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848005c-9d54-4db7-b2ca-0b3a9dd69002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:15.409231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848005c-9d54-4db7-b2ca-0b3a9dd69002 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:15.423658 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 258/542] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:15 2022] GET /identity/v3/role_assignments?user.id=e187bd54667a46c4a234d4aff23e1777&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=14efd2033a754e9b9143349f4994e356 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:15.467223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d187e-49b6-4d02-ae26-5501ba0abb7b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:15.514727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa24d5d-70f6-4ae9-92b2-1b76103e9435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:15.515351 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa24d5d-70f6-4ae9-92b2-1b76103e9435 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:15.515693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa24d5d-70f6-4ae9-92b2-1b76103e9435 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:15.516030 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa24d5d-70f6-4ae9-92b2-1b76103e9435 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:15.516849 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa24d5d-70f6-4ae9-92b2-1b76103e9435 None admin] RBAC: Adding query filter params (role.id=14efd2033a754e9b9143349f4994e356, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=380c6683b4ab4d08a6cf377e620439e8) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:15.517162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa24d5d-70f6-4ae9-92b2-1b76103e9435 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:15.518598 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa24d5d-70f6-4ae9-92b2-1b76103e9435 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:15.525650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 285/543] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:15 2022] GET /identity/v3/role_assignments?user.id=380c6683b4ab4d08a6cf377e620439e8&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=14efd2033a754e9b9143349f4994e356 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:15.551604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848005c-9d54-4db7-b2ca-0b3a9dd69002 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:15.703427 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848005c-9d54-4db7-b2ca-0b3a9dd69002 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:15.748415 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6e57f-da2f-43fc-bc28-aa63358984e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:15.749088 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6e57f-da2f-43fc-bc28-aa63358984e4 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:15.749367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6e57f-da2f-43fc-bc28-aa63358984e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:15.749640 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6e57f-da2f-43fc-bc28-aa63358984e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:15.766832 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6e57f-da2f-43fc-bc28-aa63358984e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-1ac6e57f-da2f-43fc-bc28-aa63358984e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:15.772264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:15.773141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:15.774026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:15.774026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:15.774026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:15.774026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:15.774026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:15.774026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:15.774026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:15.774026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:15.774026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:15.774026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:15.774026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:15.774026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:15.774026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 259/544] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:15.780424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa24d5d-70f6-4ae9-92b2-1b76103e9435 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:15.891746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:15.921873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa24d5d-70f6-4ae9-92b2-1b76103e9435 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:15.975842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bcfdc-4e96-457a-b846-e07435cab1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:15.976485 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bcfdc-4e96-457a-b846-e07435cab1e8 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:15.976763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bcfdc-4e96-457a-b846-e07435cab1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:15.977033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bcfdc-4e96-457a-b846-e07435cab1e8 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:15.977771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bcfdc-4e96-457a-b846-e07435cab1e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:15.978072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bcfdc-4e96-457a-b846-e07435cab1e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:15.979450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bcfdc-4e96-457a-b846-e07435cab1e8 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:15.991954 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 286/545] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:15.997639 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6e57f-da2f-43fc-bc28-aa63358984e4 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:16.080346 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:16.182212 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6e57f-da2f-43fc-bc28-aa63358984e4 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:16.234027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec05706-d158-4b17-b1f7-4dd634e95bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:16.234664 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec05706-d158-4b17-b1f7-4dd634e95bae None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:16.234993 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec05706-d158-4b17-b1f7-4dd634e95bae None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:16.235274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec05706-d158-4b17-b1f7-4dd634e95bae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:16.250605 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec05706-d158-4b17-b1f7-4dd634e95bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:16.252144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec05706-d158-4b17-b1f7-4dd634e95bae None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-2ec05706-d158-4b17-b1f7-4dd634e95bae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:16.267812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:16.270048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:16.272069 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:16.272069 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:16.272069 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:16.280216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 260/546] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:16.280593 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bcfdc-4e96-457a-b846-e07435cab1e8 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:16.436911 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bcfdc-4e96-457a-b846-e07435cab1e8 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:16.499334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b363d6-99bf-48c6-bf28-7019070d1965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:16.500817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b363d6-99bf-48c6-bf28-7019070d1965 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:16.501299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b363d6-99bf-48c6-bf28-7019070d1965 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:16.501770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b363d6-99bf-48c6-bf28-7019070d1965 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:16.502689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b363d6-99bf-48c6-bf28-7019070d1965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:16.503189 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b363d6-99bf-48c6-bf28-7019070d1965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:16.504832 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b363d6-99bf-48c6-bf28-7019070d1965 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:16.530219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 287/547] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:16.537691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec05706-d158-4b17-b1f7-4dd634e95bae None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:16.583261 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdf2aa-3416-4d34-823c-61c9b728cc91 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:16.583968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdf2aa-3416-4d34-823c-61c9b728cc91 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:16.584465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdf2aa-3416-4d34-823c-61c9b728cc91 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:16.586077 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 288/548] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:38:16.592273 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeff114-fdb0-4ed1-bb3e-2a2fe30bf5c4 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:16.592596 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeff114-fdb0-4ed1-bb3e-2a2fe30bf5c4 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:16.592824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeff114-fdb0-4ed1-bb3e-2a2fe30bf5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:16.600934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:16.615330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-ebeff114-fdb0-4ed1-bb3e-2a2fe30bf5c4 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:16.619007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ebeff114-fdb0-4ed1-bb3e-2a2fe30bf5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:16.736804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 289/549] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:38:16.738200 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:16.754945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec05706-d158-4b17-b1f7-4dd634e95bae None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:16.778759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b85cd6-ed4c-46ec-ae8a-517c2e651a99 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:16.779940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b85cd6-ed4c-46ec-ae8a-517c2e651a99 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:16.780449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b85cd6-ed4c-46ec-ae8a-517c2e651a99 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:16.782251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 290/550] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:38:16.787832 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5222-76be-4bfb-b561-00ea76e23ffe None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:16.788417 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5222-76be-4bfb-b561-00ea76e23ffe None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:16.788918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5222-76be-4bfb-b561-00ea76e23ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:16.813691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab732b5f-b55c-4718-bda1-cf1bdbe69315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:16.816666 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab732b5f-b55c-4718-bda1-cf1bdbe69315 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:16.817172 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab732b5f-b55c-4718-bda1-cf1bdbe69315 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:16.817658 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab732b5f-b55c-4718-bda1-cf1bdbe69315 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:16.822967 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-3a9a5222-76be-4bfb-b561-00ea76e23ffe None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:16.825858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-3a9a5222-76be-4bfb-b561-00ea76e23ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:16.834986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab732b5f-b55c-4718-bda1-cf1bdbe69315 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:16.837647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab732b5f-b55c-4718-bda1-cf1bdbe69315 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-ab732b5f-b55c-4718-bda1-cf1bdbe69315 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:16.866626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:16.867653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:16.868721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:16.868721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:16.868721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:16.868721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:16.868721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:16.868721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:16.868721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:16.868721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:16.868721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:38:16.868721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:16.872172 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 261/551] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:38:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:16.879894 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab732b5f-b55c-4718-bda1-cf1bdbe69315 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:16.973665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 291/552] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:38:17.048830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab732b5f-b55c-4718-bda1-cf1bdbe69315 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:17.087521 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5396c68-e5d3-4aad-8d6a-0607fbeb3a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:17.088132 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5396c68-e5d3-4aad-8d6a-0607fbeb3a75 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:17.088449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5396c68-e5d3-4aad-8d6a-0607fbeb3a75 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:17.088719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5396c68-e5d3-4aad-8d6a-0607fbeb3a75 None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:17.089449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5396c68-e5d3-4aad-8d6a-0607fbeb3a75 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:17.089753 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5396c68-e5d3-4aad-8d6a-0607fbeb3a75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:17.091180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5396c68-e5d3-4aad-8d6a-0607fbeb3a75 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:17.111677 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 262/553] 10.222.0.72 () {56 vars in 1135 bytes} [Mon Aug 29 22:38:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:17.114845 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5222-76be-4bfb-b561-00ea76e23ffe None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:17.118173 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5396c68-e5d3-4aad-8d6a-0607fbeb3a75 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:17.144652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:17.184757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:17.226939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5222-76be-4bfb-b561-00ea76e23ffe None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:17.254318 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5396c68-e5d3-4aad-8d6a-0607fbeb3a75 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:17.272325 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cad920-aebe-438c-aedf-7eb0ad264bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:17.274805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cad920-aebe-438c-aedf-7eb0ad264bab None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:17.276104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cad920-aebe-438c-aedf-7eb0ad264bab None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:17.276609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cad920-aebe-438c-aedf-7eb0ad264bab None admin] PATH_INFO: `/v3/roles/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:17.309437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cad920-aebe-438c-aedf-7eb0ad264bab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:17.314573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740398e-829d-4df0-a0d9-2f6291ceca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:17.315535 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740398e-829d-4df0-a0d9-2f6291ceca6b None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:17.316066 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740398e-829d-4df0-a0d9-2f6291ceca6b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:17.316564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740398e-829d-4df0-a0d9-2f6291ceca6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-e1cad920-aebe-438c-aedf-7eb0ad264bab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:17.320424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:17.321469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:17.322295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:17.322295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:17.322295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:17.322295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:17.322295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:17.322295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:17.322295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:17.322295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:17.322295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:17.322295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:17.322295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:17.322295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:17.333998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 292/554] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:17.350339 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cad920-aebe-438c-aedf-7eb0ad264bab None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:17.446757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740398e-829d-4df0-a0d9-2f6291ceca6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:17.448555 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740398e-829d-4df0-a0d9-2f6291ceca6b None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:17.467302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:17.487457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cad920-aebe-438c-aedf-7eb0ad264bab None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:17.521234 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:17.539803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e43769-ee65-4ce6-883f-92c4433f3843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:17.540721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e43769-ee65-4ce6-883f-92c4433f3843 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:17.541116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e43769-ee65-4ce6-883f-92c4433f3843 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:17.541504 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e43769-ee65-4ce6-883f-92c4433f3843 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:17.542290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e43769-ee65-4ce6-883f-92c4433f3843 None admin] RBAC: Adding query filter params (name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:17.542693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e43769-ee65-4ce6-883f-92c4433f3843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:17.544232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e43769-ee65-4ce6-883f-92c4433f3843 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:17.560903 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 293/555] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:17.562296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e43769-ee65-4ce6-883f-92c4433f3843 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:17.586761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 263/556] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 22:38:17.588233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740398e-829d-4df0-a0d9-2f6291ceca6b None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:17.688615 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e43769-ee65-4ce6-883f-92c4433f3843 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:17.727583 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478314a-f83f-4101-bfce-a1e2fcfbef46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:17.728551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478314a-f83f-4101-bfce-a1e2fcfbef46 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:17.728993 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478314a-f83f-4101-bfce-a1e2fcfbef46 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:17.729409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478314a-f83f-4101-bfce-a1e2fcfbef46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:17.737434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740398e-829d-4df0-a0d9-2f6291ceca6b None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:17.741581 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478314a-f83f-4101-bfce-a1e2fcfbef46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-e478314a-f83f-4101-bfce-a1e2fcfbef46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:17.748221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:17.749278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:17.750083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:17.750083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:17.750083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:17.750083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:17.750083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:17.750083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:17.750083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:17.750083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:17.750083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:17.750083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:17.750083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:17.750083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:17.750703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:17.757527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 294/557] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:17.764263 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478314a-f83f-4101-bfce-a1e2fcfbef46 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:17.782966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d8c34-f47d-41c8-8fbc-fc13a2cbbf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:17.783620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d8c34-f47d-41c8-8fbc-fc13a2cbbf92 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:17.783900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d8c34-f47d-41c8-8fbc-fc13a2cbbf92 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:17.784594 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d8c34-f47d-41c8-8fbc-fc13a2cbbf92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:17.799520 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d8c34-f47d-41c8-8fbc-fc13a2cbbf92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:17.801489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d8c34-f47d-41c8-8fbc-fc13a2cbbf92 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:17.818449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-bf2d8c34-f47d-41c8-8fbc-fc13a2cbbf92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:17.819247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:17.820169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:17.821240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:17.821240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:17.821240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:17.823459 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 264/558] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:17.824553 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d8c34-f47d-41c8-8fbc-fc13a2cbbf92 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:17.890112 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478314a-f83f-4101-bfce-a1e2fcfbef46 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:17.931032 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08d2e3-4736-4361-b0cc-49388070c147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:17.931681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08d2e3-4736-4361-b0cc-49388070c147 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:17.932086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08d2e3-4736-4361-b0cc-49388070c147 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:17.932393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08d2e3-4736-4361-b0cc-49388070c147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:17.944855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08d2e3-4736-4361-b0cc-49388070c147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:17.946679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08d2e3-4736-4361-b0cc-49388070c147 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:17.953290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d8c34-f47d-41c8-8fbc-fc13a2cbbf92 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-0c08d2e3-4736-4361-b0cc-49388070c147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:17.963120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:17.964157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:17.965168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:17.965168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:17.965168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:17.965168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 295/559] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:17.965390 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08d2e3-4736-4361-b0cc-49388070c147 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:17.993973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99608776-b110-459a-bbf7-4809eca3179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:17.994583 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99608776-b110-459a-bbf7-4809eca3179d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:17.994866 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99608776-b110-459a-bbf7-4809eca3179d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:17.995145 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99608776-b110-459a-bbf7-4809eca3179d None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:17.995812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99608776-b110-459a-bbf7-4809eca3179d None admin] RBAC: Adding query filter params (name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:17.996115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99608776-b110-459a-bbf7-4809eca3179d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:17.997533 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99608776-b110-459a-bbf7-4809eca3179d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:18.007301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 265/560] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:18.008314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a6fec-9290-4c25-9a82-1591901af767 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:18.008604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a6fec-9290-4c25-9a82-1591901af767 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:18.008908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a6fec-9290-4c25-9a82-1591901af767 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:18.010101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 266/561] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:18.010795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a6fec-9290-4c25-9a82-1591901af767 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:18.037385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:18.070173 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:18.076270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08d2e3-4736-4361-b0cc-49388070c147 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:18.113019 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee99c8-8308-48c8-bb8d-0716f8bd735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:18.113624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee99c8-8308-48c8-bb8d-0716f8bd735a None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:18.113903 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee99c8-8308-48c8-bb8d-0716f8bd735a None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:18.114182 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee99c8-8308-48c8-bb8d-0716f8bd735a None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:18.114823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee99c8-8308-48c8-bb8d-0716f8bd735a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:18.115121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee99c8-8308-48c8-bb8d-0716f8bd735a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:18.116528 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee99c8-8308-48c8-bb8d-0716f8bd735a None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:18.118263 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a6fec-9290-4c25-9a82-1591901af767 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:18.129302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 296/562] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:18.130575 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c43c5-1f34-471f-a5dd-0de0ca3aa6a7 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:18.130861 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c43c5-1f34-471f-a5dd-0de0ca3aa6a7 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:18.131129 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c43c5-1f34-471f-a5dd-0de0ca3aa6a7 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:18.132385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 297/563] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:18.136947 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c43c5-1f34-471f-a5dd-0de0ca3aa6a7 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:18.155195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f07f5-2618-48b3-8b02-cf3b1045840e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:18.155812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f07f5-2618-48b3-8b02-cf3b1045840e None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:18.156090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f07f5-2618-48b3-8b02-cf3b1045840e None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:18.156391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f07f5-2618-48b3-8b02-cf3b1045840e None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:18.157039 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f07f5-2618-48b3-8b02-cf3b1045840e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:18.157339 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f07f5-2618-48b3-8b02-cf3b1045840e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:18.158734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f07f5-2618-48b3-8b02-cf3b1045840e None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:18.171469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 267/564] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:18.173010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213e899-6890-45a0-a003-90a54f105537 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:18.173298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213e899-6890-45a0-a003-90a54f105537 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:18.173572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213e899-6890-45a0-a003-90a54f105537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:18.192356 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-6213e899-6890-45a0-a003-90a54f105537 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:18.193578 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-6213e899-6890-45a0-a003-90a54f105537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:18.267536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c43c5-1f34-471f-a5dd-0de0ca3aa6a7 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:18.288222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 268/565] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:18.288222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213e899-6890-45a0-a003-90a54f105537 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:18.312268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f18f18-1ba0-4c7b-9439-7c29cc6ae268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:18.312918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f18f18-1ba0-4c7b-9439-7c29cc6ae268 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:18.320282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f18f18-1ba0-4c7b-9439-7c29cc6ae268 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:18.320282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f18f18-1ba0-4c7b-9439-7c29cc6ae268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:18.320494 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:18.324586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f18f18-1ba0-4c7b-9439-7c29cc6ae268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:18.332639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f18f18-1ba0-4c7b-9439-7c29cc6ae268 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-36f18f18-1ba0-4c7b-9439-7c29cc6ae268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:18.343465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:18.344641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:18.345548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:18.345548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:18.345548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:18.345548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 298/566] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:18.356262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa04eb8-474f-4246-83c3-4bf0665bdb4b None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:18.356262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa04eb8-474f-4246-83c3-4bf0665bdb4b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:18.356262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa04eb8-474f-4246-83c3-4bf0665bdb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:18.373274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-2fa04eb8-474f-4246-83c3-4bf0665bdb4b None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:18.374628 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-2fa04eb8-474f-4246-83c3-4bf0665bdb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:18.377348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:18.415237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213e899-6890-45a0-a003-90a54f105537 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:18.459410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 299/567] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:18.461071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa04eb8-474f-4246-83c3-4bf0665bdb4b None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:18.474469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdf3d8-88f8-4f70-acf9-a6b8dd1f2e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:18.475232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdf3d8-88f8-4f70-acf9-a6b8dd1f2e98 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:18.475515 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdf3d8-88f8-4f70-acf9-a6b8dd1f2e98 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:18.476488 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdf3d8-88f8-4f70-acf9-a6b8dd1f2e98 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:18.492307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdf3d8-88f8-4f70-acf9-a6b8dd1f2e98 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:18.494220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdf3d8-88f8-4f70-acf9-a6b8dd1f2e98 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-1bbdf3d8-88f8-4f70-acf9-a6b8dd1f2e98 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:18.511324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:18.512473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:18.513540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:18.513540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:18.513540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:18.513540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:18.513540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:18.513540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:18.513540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:18.513540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:18.513540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:38:18.513540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:18.517582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 269/568] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:38:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:18.518469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdf3d8-88f8-4f70-acf9-a6b8dd1f2e98 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:18.621848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:18.634225 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa04eb8-474f-4246-83c3-4bf0665bdb4b None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:18.669837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdf3d8-88f8-4f70-acf9-a6b8dd1f2e98 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:18.681955 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b1f40-3f27-4bbc-8f78-e3554bcc4e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:18.682512 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b1f40-3f27-4bbc-8f78-e3554bcc4e1d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:18.682786 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b1f40-3f27-4bbc-8f78-e3554bcc4e1d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:18.683057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b1f40-3f27-4bbc-8f78-e3554bcc4e1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:18.692963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b1f40-3f27-4bbc-8f78-e3554bcc4e1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:18.695024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b1f40-3f27-4bbc-8f78-e3554bcc4e1d None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:18.709375 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:18.715964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-681b1f40-3f27-4bbc-8f78-e3554bcc4e1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:18.715964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:18.715964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:18.715964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:18.715964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:18.715964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:18.715964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:18.715964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:18.715964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:18.715964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:18.715964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:18.715964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:18.715964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:18.715964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:18.715964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:18.717739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:18.718692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:18.718692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:18.718692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:18.718692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:18.718692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:18.718692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:18.718692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:18.718692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:18.722840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 300/569] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:18.724225 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b1f40-3f27-4bbc-8f78-e3554bcc4e1d None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:18.726149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccea8a-45e3-4d33-a2f3-0dd28ab7114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:18.726773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccea8a-45e3-4d33-a2f3-0dd28ab7114e None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:18.727057 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccea8a-45e3-4d33-a2f3-0dd28ab7114e None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:18.727377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccea8a-45e3-4d33-a2f3-0dd28ab7114e None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:18.728037 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccea8a-45e3-4d33-a2f3-0dd28ab7114e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:18.728375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccea8a-45e3-4d33-a2f3-0dd28ab7114e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:18.729819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccea8a-45e3-4d33-a2f3-0dd28ab7114e None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:18.748321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 270/570] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:18.748321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccea8a-45e3-4d33-a2f3-0dd28ab7114e None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:18.842723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b1f40-3f27-4bbc-8f78-e3554bcc4e1d None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:18.861254 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccea8a-45e3-4d33-a2f3-0dd28ab7114e None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:18.888289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e46873-b8ae-414d-82d7-bed8181cf60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:18.889102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e46873-b8ae-414d-82d7-bed8181cf60b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:18.889386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e46873-b8ae-414d-82d7-bed8181cf60b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:18.889662 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e46873-b8ae-414d-82d7-bed8181cf60b None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:18.890489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e46873-b8ae-414d-82d7-bed8181cf60b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:18.890780 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e46873-b8ae-414d-82d7-bed8181cf60b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:18.891901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:18.892451 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e46873-b8ae-414d-82d7-bed8181cf60b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:18.899141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc972a56-780c-4daa-beee-18ee10d92979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:18.900271 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc972a56-780c-4daa-beee-18ee10d92979 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:18.900771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc972a56-780c-4daa-beee-18ee10d92979 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:18.901268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc972a56-780c-4daa-beee-18ee10d92979 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:18.912427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 301/571] 10.222.0.72 () {56 vars in 1137 bytes} [Mon Aug 29 22:38:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:18.915074 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e46873-b8ae-414d-82d7-bed8181cf60b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:18.915235 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc972a56-780c-4daa-beee-18ee10d92979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-dc972a56-780c-4daa-beee-18ee10d92979 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:18.921450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:18.922924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:18.924382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:18.924382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:18.924382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:18.924382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:18.924382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:18.924382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:18.924382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:18.924382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:18.924382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:18.924382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:18.924382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:18.924382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:18.924382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 271/572] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:18.924382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc972a56-780c-4daa-beee-18ee10d92979 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:18.987654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:19.034013 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e46873-b8ae-414d-82d7-bed8181cf60b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:19.036446 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc972a56-780c-4daa-beee-18ee10d92979 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:19.069059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39ad87-8949-4a2f-a7a9-69bf4edd56eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:19.069639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39ad87-8949-4a2f-a7a9-69bf4edd56eb None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:19.069919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39ad87-8949-4a2f-a7a9-69bf4edd56eb None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:19.070195 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39ad87-8949-4a2f-a7a9-69bf4edd56eb None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:19.070895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39ad87-8949-4a2f-a7a9-69bf4edd56eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:19.071196 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39ad87-8949-4a2f-a7a9-69bf4edd56eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:19.071446 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1e32d-020d-467e-930e-b116558c7cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:19.072082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1e32d-020d-467e-930e-b116558c7cce None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:19.072397 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1e32d-020d-467e-930e-b116558c7cce None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:19.072672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39ad87-8949-4a2f-a7a9-69bf4edd56eb None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:19.072774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1e32d-020d-467e-930e-b116558c7cce None admin] PATH_INFO: `/v3/users/nova` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:19.080120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1e32d-020d-467e-930e-b116558c7cce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:19.081624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1e32d-020d-467e-930e-b116558c7cce None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:19.084629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 302/573] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:19.085459 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39ad87-8949-4a2f-a7a9-69bf4edd56eb None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-23d1e32d-020d-467e-930e-b116558c7cce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:19.094439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:19.095612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:19.096804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:19.096804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:19.096804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:19.096804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:19.096804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:19.096804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:19.096804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:19.096804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:19.096804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:38:19.096804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:19.096804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 272/574] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Aug 29 22:38:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:19.096804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1e32d-020d-467e-930e-b116558c7cce None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:19.150106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:19.190828 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39ad87-8949-4a2f-a7a9-69bf4edd56eb None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:19.199923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1e32d-020d-467e-930e-b116558c7cce None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:19.207496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:19.226798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4487402-8cf4-4bf1-a0f5-e45ade017933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:19.227469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4487402-8cf4-4bf1-a0f5-e45ade017933 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:19.227764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4487402-8cf4-4bf1-a0f5-e45ade017933 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:19.228038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4487402-8cf4-4bf1-a0f5-e45ade017933 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:19.235431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b62ea-eb21-425b-b816-bc41d5e80167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:19.236137 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b62ea-eb21-425b-b816-bc41d5e80167 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:19.236445 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b62ea-eb21-425b-b816-bc41d5e80167 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:19.236715 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b62ea-eb21-425b-b816-bc41d5e80167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:19.240314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4487402-8cf4-4bf1-a0f5-e45ade017933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-a4487402-8cf4-4bf1-a0f5-e45ade017933 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:19.245674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:19.246586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:19.247421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:19.247421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:19.247421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:19.247421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:19.247421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:19.247421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:19.247421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:19.247421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:19.247421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:19.247421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:19.247421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:19.247421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:19.247421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 303/575] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:19.248501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4487402-8cf4-4bf1-a0f5-e45ade017933 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:19.248570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b62ea-eb21-425b-b816-bc41d5e80167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:19.250060 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b62ea-eb21-425b-b816-bc41d5e80167 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-086b62ea-eb21-425b-b816-bc41d5e80167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:19.265482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:19.266562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:19.267471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:19.267471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:19.267471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:19.267471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 273/576] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:19.267471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b62ea-eb21-425b-b816-bc41d5e80167 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:19.358187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4487402-8cf4-4bf1-a0f5-e45ade017933 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:19.373232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b62ea-eb21-425b-b816-bc41d5e80167 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:19.375604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:19.395941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137568de-ea6d-4b0b-aa75-2f14243da9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:19.397016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137568de-ea6d-4b0b-aa75-2f14243da9d4 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:19.397514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137568de-ea6d-4b0b-aa75-2f14243da9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:19.398016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137568de-ea6d-4b0b-aa75-2f14243da9d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:19.399204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137568de-ea6d-4b0b-aa75-2f14243da9d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:19.399746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137568de-ea6d-4b0b-aa75-2f14243da9d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:19.402424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137568de-ea6d-4b0b-aa75-2f14243da9d4 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:19.411909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335a8ba-1093-4fcb-9a02-ba3893fff30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:19.412552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335a8ba-1093-4fcb-9a02-ba3893fff30e None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:19.413180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335a8ba-1093-4fcb-9a02-ba3893fff30e None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:19.413319 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335a8ba-1093-4fcb-9a02-ba3893fff30e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:19.413943 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335a8ba-1093-4fcb-9a02-ba3893fff30e None admin] RBAC: Adding query filter params (role.id=14efd2033a754e9b9143349f4994e356, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=94511ad9ee7a4ab0b70d8d5098079886) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:19.414257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335a8ba-1093-4fcb-9a02-ba3893fff30e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:19.415681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335a8ba-1093-4fcb-9a02-ba3893fff30e None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:19.422915 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 304/577] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:19.422915 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137568de-ea6d-4b0b-aa75-2f14243da9d4 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:19.426721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 274/578] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:19 2022] GET /identity/v3/role_assignments?user.id=94511ad9ee7a4ab0b70d8d5098079886&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=14efd2033a754e9b9143349f4994e356 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:19.427552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335a8ba-1093-4fcb-9a02-ba3893fff30e None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:19.486455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:19.556183 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137568de-ea6d-4b0b-aa75-2f14243da9d4 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:19.556417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335a8ba-1093-4fcb-9a02-ba3893fff30e None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:19.594262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47927d4e-67e3-4849-a1f7-771b6837b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:19.594723 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e299d1-aab7-4f31-a64b-cecfe4ce5719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:19.594918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47927d4e-67e3-4849-a1f7-771b6837b987 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:19.595178 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47927d4e-67e3-4849-a1f7-771b6837b987 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:19.595349 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e299d1-aab7-4f31-a64b-cecfe4ce5719 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:19.595475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47927d4e-67e3-4849-a1f7-771b6837b987 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:19.595720 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e299d1-aab7-4f31-a64b-cecfe4ce5719 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:19.595934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e299d1-aab7-4f31-a64b-cecfe4ce5719 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:19.596244 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47927d4e-67e3-4849-a1f7-771b6837b987 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:19.596548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47927d4e-67e3-4849-a1f7-771b6837b987 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:19.596697 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e299d1-aab7-4f31-a64b-cecfe4ce5719 None admin] RBAC: Adding query filter params (name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:19.596937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e299d1-aab7-4f31-a64b-cecfe4ce5719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:19.598017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47927d4e-67e3-4849-a1f7-771b6837b987 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:19.598302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e299d1-aab7-4f31-a64b-cecfe4ce5719 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:19.612434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 275/579] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:19.617441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e299d1-aab7-4f31-a64b-cecfe4ce5719 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:19.627539 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 305/580] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Aug 29 22:38:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:19.628307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47927d4e-67e3-4849-a1f7-771b6837b987 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:19.654361 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:19.737100 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e299d1-aab7-4f31-a64b-cecfe4ce5719 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:19.742017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:19.754301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47927d4e-67e3-4849-a1f7-771b6837b987 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:19.780823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c389070-562a-46f4-8ac7-23fb48eb11e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:19.781439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c389070-562a-46f4-8ac7-23fb48eb11e0 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:19.781724 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c389070-562a-46f4-8ac7-23fb48eb11e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:19.782006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c389070-562a-46f4-8ac7-23fb48eb11e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:19.782652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c389070-562a-46f4-8ac7-23fb48eb11e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:19.782956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c389070-562a-46f4-8ac7-23fb48eb11e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:19.784398 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c389070-562a-46f4-8ac7-23fb48eb11e0 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:19.795241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8beb4-5477-4495-9ba9-e11fc7593a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:19.796235 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8beb4-5477-4495-9ba9-e11fc7593a96 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:19.796523 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8beb4-5477-4495-9ba9-e11fc7593a96 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:19.796803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8beb4-5477-4495-9ba9-e11fc7593a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:19.807813 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8beb4-5477-4495-9ba9-e11fc7593a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:19.809324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8beb4-5477-4495-9ba9-e11fc7593a96 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:19.812604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 276/581] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:19.813973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c389070-562a-46f4-8ac7-23fb48eb11e0 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-e0a8beb4-5477-4495-9ba9-e11fc7593a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:19.831698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:19.832734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:19.833585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:19.833585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:19.833585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:19.833761 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 306/582] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:19.835026 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8beb4-5477-4495-9ba9-e11fc7593a96 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:19.929263 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:19.941177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c389070-562a-46f4-8ac7-23fb48eb11e0 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:19.967037 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8beb4-5477-4495-9ba9-e11fc7593a96 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:19.981339 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506155e-8f3b-4f46-86a1-8d58b548645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:19.982028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506155e-8f3b-4f46-86a1-8d58b548645e None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:19.982967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506155e-8f3b-4f46-86a1-8d58b548645e None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:19.983257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506155e-8f3b-4f46-86a1-8d58b548645e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:19.995995 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506155e-8f3b-4f46-86a1-8d58b548645e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:19.998245 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506155e-8f3b-4f46-86a1-8d58b548645e None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:20.006386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eda25c-21bb-4db4-99b2-2a77a3e0acd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:20.007030 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eda25c-21bb-4db4-99b2-2a77a3e0acd1 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:20.007312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eda25c-21bb-4db4-99b2-2a77a3e0acd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:20.007585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eda25c-21bb-4db4-99b2-2a77a3e0acd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-a506155e-8f3b-4f46-86a1-8d58b548645e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:20.017629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:20.018581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:20.019552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:20.019552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:20.019552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:20.019729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eda25c-21bb-4db4-99b2-2a77a3e0acd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:20.019801 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 277/583] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:20.019875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506155e-8f3b-4f46-86a1-8d58b548645e None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:20.020334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eda25c-21bb-4db4-99b2-2a77a3e0acd1 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:20.031956 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-b2eda25c-21bb-4db4-99b2-2a77a3e0acd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:20.039035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:20.040132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:20.041772 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:20.041772 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:20.041772 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:20.041772 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 307/584] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:20.041772 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eda25c-21bb-4db4-99b2-2a77a3e0acd1 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:20.135252 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506155e-8f3b-4f46-86a1-8d58b548645e None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:20.171549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d7d3b-90b1-467b-90e2-907a9846f229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:20.172184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d7d3b-90b1-467b-90e2-907a9846f229 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:20.172488 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d7d3b-90b1-467b-90e2-907a9846f229 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:20.172763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d7d3b-90b1-467b-90e2-907a9846f229 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:20.177935 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eda25c-21bb-4db4-99b2-2a77a3e0acd1 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:20.180286 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d7d3b-90b1-467b-90e2-907a9846f229 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:20.181671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d7d3b-90b1-467b-90e2-907a9846f229 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:20.194246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-1c9d7d3b-90b1-467b-90e2-907a9846f229 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:20.194246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:20.194246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:20.194246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:20.194246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:20.194246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:20.194246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:20.194246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:20.194246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:20.194246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:20.194246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:20.194246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:20.194246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:20.194246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:20.194246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:20.195161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:20.196023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:20.196023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:20.196023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:20.196023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:20.196023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:20.196023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:20.196023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:20.196023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:20.196023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 278/585] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:20.197074 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d7d3b-90b1-467b-90e2-907a9846f229 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:20.201310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:20.221999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99552f83-b218-43d2-a850-35d35d23e316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:20.227700 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99552f83-b218-43d2-a850-35d35d23e316 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:20.227700 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99552f83-b218-43d2-a850-35d35d23e316 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:20.227700 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99552f83-b218-43d2-a850-35d35d23e316 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:20.227700 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99552f83-b218-43d2-a850-35d35d23e316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:20.227700 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99552f83-b218-43d2-a850-35d35d23e316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:20.227700 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99552f83-b218-43d2-a850-35d35d23e316 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:20.240162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 308/586] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:20.241420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99552f83-b218-43d2-a850-35d35d23e316 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:20.314333 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:20.320684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d7d3b-90b1-467b-90e2-907a9846f229 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:20.359714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99552f83-b218-43d2-a850-35d35d23e316 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:20.361462 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03b983-50fc-4258-ae79-0e04e25fb72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:20.362916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03b983-50fc-4258-ae79-0e04e25fb72e None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:20.363210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03b983-50fc-4258-ae79-0e04e25fb72e None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:20.363493 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03b983-50fc-4258-ae79-0e04e25fb72e None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:20.364145 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03b983-50fc-4258-ae79-0e04e25fb72e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:20.364498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03b983-50fc-4258-ae79-0e04e25fb72e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:20.365864 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03b983-50fc-4258-ae79-0e04e25fb72e None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:20.386038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 279/587] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:20.386038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03b983-50fc-4258-ae79-0e04e25fb72e None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:20.402737 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91f41d-297e-43de-b9ce-c01b4c8c9e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:20.403417 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91f41d-297e-43de-b9ce-c01b4c8c9e79 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:20.403740 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91f41d-297e-43de-b9ce-c01b4c8c9e79 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:20.404632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91f41d-297e-43de-b9ce-c01b4c8c9e79 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:20.405609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91f41d-297e-43de-b9ce-c01b4c8c9e79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:20.405931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91f41d-297e-43de-b9ce-c01b4c8c9e79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:20.407350 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91f41d-297e-43de-b9ce-c01b4c8c9e79 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:20.420921 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 309/588] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:20.420921 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91f41d-297e-43de-b9ce-c01b4c8c9e79 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:20.476033 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:20.524908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03b983-50fc-4258-ae79-0e04e25fb72e None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:20.571662 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91f41d-297e-43de-b9ce-c01b4c8c9e79 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:20.572180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337c533-4a7c-4ef1-97c5-2e20055c83c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:20.573037 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337c533-4a7c-4ef1-97c5-2e20055c83c7 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:20.573479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337c533-4a7c-4ef1-97c5-2e20055c83c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:20.573912 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337c533-4a7c-4ef1-97c5-2e20055c83c7 None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:20.574769 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337c533-4a7c-4ef1-97c5-2e20055c83c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:20.575085 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337c533-4a7c-4ef1-97c5-2e20055c83c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:20.577417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337c533-4a7c-4ef1-97c5-2e20055c83c7 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:20.594407 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 280/589] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:20.595223 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337c533-4a7c-4ef1-97c5-2e20055c83c7 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:20.602828 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:20.619785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a3617-60b1-4755-9d40-1cee81c42112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:20.620463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a3617-60b1-4755-9d40-1cee81c42112 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:20.620743 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a3617-60b1-4755-9d40-1cee81c42112 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:20.621017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a3617-60b1-4755-9d40-1cee81c42112 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:20.632010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a3617-60b1-4755-9d40-1cee81c42112 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:20.633544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a3617-60b1-4755-9d40-1cee81c42112 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-7c4a3617-60b1-4755-9d40-1cee81c42112 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:20.648072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:20.649122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:20.650044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:20.650044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:20.650044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:20.650044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:20.650044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:20.650044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:20.650044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:20.650044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:20.650044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:38:20.650044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:20.650044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 310/590] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:38:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:20.650044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a3617-60b1-4755-9d40-1cee81c42112 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:20.726198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337c533-4a7c-4ef1-97c5-2e20055c83c7 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:20.756055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:20.769974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ae76e-88ab-45aa-8028-ecded205cfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:20.770613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ae76e-88ab-45aa-8028-ecded205cfa6 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:20.770893 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ae76e-88ab-45aa-8028-ecded205cfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:20.771165 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ae76e-88ab-45aa-8028-ecded205cfa6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:20.776587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a3617-60b1-4755-9d40-1cee81c42112 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:20.779722 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ae76e-88ab-45aa-8028-ecded205cfa6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:20.781231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ae76e-88ab-45aa-8028-ecded205cfa6 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-d80ae76e-88ab-45aa-8028-ecded205cfa6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:20.795904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:20.797071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:20.797988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:20.797988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:20.797988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:20.797988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:20.797988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:20.797988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:20.797988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:20.797988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:20.797988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:38:20.797988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:20.797988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 281/591] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:20.797988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ae76e-88ab-45aa-8028-ecded205cfa6 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:20.832011 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37de981-9f44-41f8-b431-1f572b71d43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:20.832678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37de981-9f44-41f8-b431-1f572b71d43d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:20.832966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37de981-9f44-41f8-b431-1f572b71d43d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:20.833235 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37de981-9f44-41f8-b431-1f572b71d43d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:20.840664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37de981-9f44-41f8-b431-1f572b71d43d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:20.842165 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37de981-9f44-41f8-b431-1f572b71d43d None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:20.854621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-f37de981-9f44-41f8-b431-1f572b71d43d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:20.854621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:20.854621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:20.854621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:20.854621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:20.854621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:20.854621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:20.854621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:20.854621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:20.854621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:20.854621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:20.854621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:20.854621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:20.854621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:20.854621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:20.855544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:20.857387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:20.857387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:20.857387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:20.857387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:20.857387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:20.857387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:20.857387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:20.857387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:20.857387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 311/592] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:20.857999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37de981-9f44-41f8-b431-1f572b71d43d None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:20.909212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:20.926914 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ae76e-88ab-45aa-8028-ecded205cfa6 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:20.968115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b211d1-2499-4e30-80e1-8132b2872149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:20.969115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b211d1-2499-4e30-80e1-8132b2872149 None admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:20.969395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b211d1-2499-4e30-80e1-8132b2872149 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:20.969660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b211d1-2499-4e30-80e1-8132b2872149 None admin] PATH_INFO: `/v3/projects/7abc4d6c6e004b15abff7738164175db/users/c7e72cc048a0418cac062d68b8df402f/roles/14efd2033a754e9b9143349f4994e356` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:20.984399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37de981-9f44-41f8-b431-1f572b71d43d None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:20.986541 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b211d1-2499-4e30-80e1-8132b2872149 None admin] RBAC: Authorizing `identity:create_grant(project_id=7abc4d6c6e004b15abff7738164175db, user_id=c7e72cc048a0418cac062d68b8df402f, role_id=14efd2033a754e9b9143349f4994e356)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:20.987985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b211d1-2499-4e30-80e1-8132b2872149 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:21.023731 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432fc74-26c4-466c-82b7-8a7c2f42caaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:21.024395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432fc74-26c4-466c-82b7-8a7c2f42caaa None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:21.024736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432fc74-26c4-466c-82b7-8a7c2f42caaa None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:21.024979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432fc74-26c4-466c-82b7-8a7c2f42caaa None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:21.025684 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432fc74-26c4-466c-82b7-8a7c2f42caaa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:21.025987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432fc74-26c4-466c-82b7-8a7c2f42caaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:21.027423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432fc74-26c4-466c-82b7-8a7c2f42caaa None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:21.047168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 312/593] 10.222.0.72 () {56 vars in 1137 bytes} [Mon Aug 29 22:38:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:21.047830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432fc74-26c4-466c-82b7-8a7c2f42caaa None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:21.056560 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 282/594] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:38:20 2022] PUT /identity/v3/projects/7abc4d6c6e004b15abff7738164175db/users/c7e72cc048a0418cac062d68b8df402f/roles/14efd2033a754e9b9143349f4994e356 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:38:21.057724 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b211d1-2499-4e30-80e1-8132b2872149 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:21.100235 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:21.179188 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:21.184160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432fc74-26c4-466c-82b7-8a7c2f42caaa None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:21.198876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b211d1-2499-4e30-80e1-8132b2872149 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:21.234068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37584e0-ad73-4d36-a664-36a737da4ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:21.234948 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37584e0-ad73-4d36-a664-36a737da4ef5 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:21.235717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37584e0-ad73-4d36-a664-36a737da4ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:21.235950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37584e0-ad73-4d36-a664-36a737da4ef5 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:21.237679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37584e0-ad73-4d36-a664-36a737da4ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:21.237990 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37584e0-ad73-4d36-a664-36a737da4ef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:21.240378 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37584e0-ad73-4d36-a664-36a737da4ef5 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:21.259968 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af82015-1fda-4c0c-be52-55e8438c3fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:21.260975 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af82015-1fda-4c0c-be52-55e8438c3fca None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:21.261477 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af82015-1fda-4c0c-be52-55e8438c3fca None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:21.261969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af82015-1fda-4c0c-be52-55e8438c3fca None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:21.262874 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af82015-1fda-4c0c-be52-55e8438c3fca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:21.263464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af82015-1fda-4c0c-be52-55e8438c3fca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:21.265214 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af82015-1fda-4c0c-be52-55e8438c3fca None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:21.268284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 313/595] 10.222.0.72 () {56 vars in 1139 bytes} [Mon Aug 29 22:38:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:21.268284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37584e0-ad73-4d36-a664-36a737da4ef5 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:21.283994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 283/596] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:21.284979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af82015-1fda-4c0c-be52-55e8438c3fca None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:21.401165 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:21.409161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37584e0-ad73-4d36-a664-36a737da4ef5 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:21.413713 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af82015-1fda-4c0c-be52-55e8438c3fca None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:21.450388 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11d1b6-48f7-410d-bddd-8de1b2f6bc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:21.451707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11d1b6-48f7-410d-bddd-8de1b2f6bc16 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:21.451988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11d1b6-48f7-410d-bddd-8de1b2f6bc16 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:21.452115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541df22-e9d4-4d8f-949a-c3e506d5739d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:21.452288 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11d1b6-48f7-410d-bddd-8de1b2f6bc16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:21.452689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541df22-e9d4-4d8f-949a-c3e506d5739d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:21.452985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541df22-e9d4-4d8f-949a-c3e506d5739d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:21.453262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541df22-e9d4-4d8f-949a-c3e506d5739d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:21.463975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11d1b6-48f7-410d-bddd-8de1b2f6bc16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:21.465115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541df22-e9d4-4d8f-949a-c3e506d5739d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:21.466039 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11d1b6-48f7-410d-bddd-8de1b2f6bc16 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:21.467197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541df22-e9d4-4d8f-949a-c3e506d5739d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-0541df22-e9d4-4d8f-949a-c3e506d5739d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:21.484568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:21.485682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:21.486629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:21.486629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:21.486629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-ea11d1b6-48f7-410d-bddd-8de1b2f6bc16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:21.486796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:21.487597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:21.488453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:21.488453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:21.488453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:21.488453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 314/597] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:21.488453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11d1b6-48f7-410d-bddd-8de1b2f6bc16 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:21.492398 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 284/598] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:21.495127 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523a376-4b45-4fb7-bd29-113ae932bc0e None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:21.495824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523a376-4b45-4fb7-bd29-113ae932bc0e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:21.496331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523a376-4b45-4fb7-bd29-113ae932bc0e None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:21.498330 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 285/599] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:21.500457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:21.501620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523a376-4b45-4fb7-bd29-113ae932bc0e None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:21.602952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11d1b6-48f7-410d-bddd-8de1b2f6bc16 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:21.618393 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523a376-4b45-4fb7-bd29-113ae932bc0e None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:21.642747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb9404-6fd0-42e2-8fbb-14375ac0cd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:21.643418 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb9404-6fd0-42e2-8fbb-14375ac0cd49 None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:21.643701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb9404-6fd0-42e2-8fbb-14375ac0cd49 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:21.643978 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb9404-6fd0-42e2-8fbb-14375ac0cd49 None admin] PATH_INFO: `/v3/projects/7abc4d6c6e004b15abff7738164175db/users/0be09bd9ba7443aaa31879f56ca4aad1/roles/14efd2033a754e9b9143349f4994e356` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:21.656843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017aa01b-9ff2-493f-b5a1-a92cd620e868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:21.657727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017aa01b-9ff2-493f-b5a1-a92cd620e868 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:21.658009 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017aa01b-9ff2-493f-b5a1-a92cd620e868 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:21.658430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017aa01b-9ff2-493f-b5a1-a92cd620e868 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:21.659079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017aa01b-9ff2-493f-b5a1-a92cd620e868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:21.659381 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017aa01b-9ff2-493f-b5a1-a92cd620e868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:21.660788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017aa01b-9ff2-493f-b5a1-a92cd620e868 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:21.661512 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb9404-6fd0-42e2-8fbb-14375ac0cd49 None admin] RBAC: Authorizing `identity:create_grant(project_id=7abc4d6c6e004b15abff7738164175db, user_id=0be09bd9ba7443aaa31879f56ca4aad1, role_id=14efd2033a754e9b9143349f4994e356)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:21.663412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb9404-6fd0-42e2-8fbb-14375ac0cd49 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:21.676278 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 286/600] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:21.677636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017aa01b-9ff2-493f-b5a1-a92cd620e868 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:21.683106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:21.776833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 315/601] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:38:21 2022] PUT /identity/v3/projects/7abc4d6c6e004b15abff7738164175db/users/0be09bd9ba7443aaa31879f56ca4aad1/roles/14efd2033a754e9b9143349f4994e356 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:38:21.780608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a088315-6a61-42b3-aeca-1d72355c6160 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:21.780997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a088315-6a61-42b3-aeca-1d72355c6160 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:21.781395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a088315-6a61-42b3-aeca-1d72355c6160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:21.807277 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-8a088315-6a61-42b3-aeca-1d72355c6160 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:21.808979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8a088315-6a61-42b3-aeca-1d72355c6160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:21.827261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017aa01b-9ff2-493f-b5a1-a92cd620e868 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:21.887757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0397c8-5070-4508-865f-490c3d4daf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:21.889876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0397c8-5070-4508-865f-490c3d4daf8e None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:21.891406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0397c8-5070-4508-865f-490c3d4daf8e None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:21.892721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0397c8-5070-4508-865f-490c3d4daf8e None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:21.893898 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0397c8-5070-4508-865f-490c3d4daf8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:21.894767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0397c8-5070-4508-865f-490c3d4daf8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:21.897119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0397c8-5070-4508-865f-490c3d4daf8e None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:21.900241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:21.916274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 287/602] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:21.921012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0397c8-5070-4508-865f-490c3d4daf8e None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:21.942404 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 316/603] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:21.942404 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a088315-6a61-42b3-aeca-1d72355c6160 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:22.009117 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:22.053985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0397c8-5070-4508-865f-490c3d4daf8e None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:22.082624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a088315-6a61-42b3-aeca-1d72355c6160 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:22.105946 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30802111-e6b8-48a0-b1c0-b735abc31581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:22.106598 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30802111-e6b8-48a0-b1c0-b735abc31581 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:22.106943 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30802111-e6b8-48a0-b1c0-b735abc31581 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:22.107218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30802111-e6b8-48a0-b1c0-b735abc31581 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:22.125323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30802111-e6b8-48a0-b1c0-b735abc31581 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:22.127098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30802111-e6b8-48a0-b1c0-b735abc31581 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:22.151587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-30802111-e6b8-48a0-b1c0-b735abc31581 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:22.151587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:22.151587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:22.151587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:22.151587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:22.151587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:22.151587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:22.151587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:22.151587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:22.151587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:22.151587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:22.151587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:22.151587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:22.151587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:22.151587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:22.152577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:22.153499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:22.153499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:22.153499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:22.153499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:22.153499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:22.153499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:22.153499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:22.153499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:22.154576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 288/604] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:22.159232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30802111-e6b8-48a0-b1c0-b735abc31581 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:22.170720 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e0b31-71b6-4c5b-b933-b4ea88a6b8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:22.171430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e0b31-71b6-4c5b-b933-b4ea88a6b8fd None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:22.171716 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e0b31-71b6-4c5b-b933-b4ea88a6b8fd None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:22.171991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e0b31-71b6-4c5b-b933-b4ea88a6b8fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:22.184661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e0b31-71b6-4c5b-b933-b4ea88a6b8fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:22.186735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e0b31-71b6-4c5b-b933-b4ea88a6b8fd None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:22.210287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-f11e0b31-71b6-4c5b-b933-b4ea88a6b8fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:22.210287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:22.210287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:22.210287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:22.210287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:22.210287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:22.210287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:22.210287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:22.210287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:22.210287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:22.210287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:22.210287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:22.210287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:22.210287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:22.210287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:22.212394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:22.214520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:22.214520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:22.214520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:22.214520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:22.214520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:22.214520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:22.214520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:22.214520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:22.214520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 317/605] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:22.218394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e0b31-71b6-4c5b-b933-b4ea88a6b8fd None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:22.307396 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30802111-e6b8-48a0-b1c0-b735abc31581 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:22.314937 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:22.340157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:22.355028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c69d8-6757-4a0e-9294-c007245bfce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:22.356246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c69d8-6757-4a0e-9294-c007245bfce3 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:22.356667 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c69d8-6757-4a0e-9294-c007245bfce3 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:22.357048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c69d8-6757-4a0e-9294-c007245bfce3 None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:22.358140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c69d8-6757-4a0e-9294-c007245bfce3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:22.358521 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c69d8-6757-4a0e-9294-c007245bfce3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:22.360016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c69d8-6757-4a0e-9294-c007245bfce3 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:22.374202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e0b31-71b6-4c5b-b933-b4ea88a6b8fd None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:22.382657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 289/606] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:22.383847 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c69d8-6757-4a0e-9294-c007245bfce3 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:22.415069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c7ea8-b4e4-4a28-befa-35d6bd90fbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:22.415696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c7ea8-b4e4-4a28-befa-35d6bd90fbbc None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:22.420093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c7ea8-b4e4-4a28-befa-35d6bd90fbbc None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:22.420093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c7ea8-b4e4-4a28-befa-35d6bd90fbbc None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:22.420093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c7ea8-b4e4-4a28-befa-35d6bd90fbbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:22.420093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c7ea8-b4e4-4a28-befa-35d6bd90fbbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:22.420093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c7ea8-b4e4-4a28-befa-35d6bd90fbbc None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:22.440616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 318/607] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:22.441856 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c7ea8-b4e4-4a28-befa-35d6bd90fbbc None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:22.518420 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c69d8-6757-4a0e-9294-c007245bfce3 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:22.564139 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3534ee-9cd6-4a97-ba5d-7513d0cd646a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:22.565107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3534ee-9cd6-4a97-ba5d-7513d0cd646a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:22.565490 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3534ee-9cd6-4a97-ba5d-7513d0cd646a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:22.565869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3534ee-9cd6-4a97-ba5d-7513d0cd646a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:22.578315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3534ee-9cd6-4a97-ba5d-7513d0cd646a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:22.578510 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c7ea8-b4e4-4a28-befa-35d6bd90fbbc None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-9a3534ee-9cd6-4a97-ba5d-7513d0cd646a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:22.583896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:22.585237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:22.586359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:22.586359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:22.586359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:22.586359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:22.586359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:22.586359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:22.586359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:22.586359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:22.586359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:22.586359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:22.586359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:22.586359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:22.589268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:22.593926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 290/608] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:22.594960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3534ee-9cd6-4a97-ba5d-7513d0cd646a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:22.622472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911d5c0-1052-410c-b196-ca1f4ce2bdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:22.624747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911d5c0-1052-410c-b196-ca1f4ce2bdc1 None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:22.625174 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911d5c0-1052-410c-b196-ca1f4ce2bdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:22.625766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911d5c0-1052-410c-b196-ca1f4ce2bdc1 None admin] PATH_INFO: `/v3/projects/7abc4d6c6e004b15abff7738164175db/users/380c6683b4ab4d08a6cf377e620439e8/roles/14efd2033a754e9b9143349f4994e356` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:22.645468 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911d5c0-1052-410c-b196-ca1f4ce2bdc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7abc4d6c6e004b15abff7738164175db, user_id=380c6683b4ab4d08a6cf377e620439e8, role_id=14efd2033a754e9b9143349f4994e356)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:22.647330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911d5c0-1052-410c-b196-ca1f4ce2bdc1 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:22.660750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:22.725373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3534ee-9cd6-4a97-ba5d-7513d0cd646a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:22.740504 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 319/609] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:38:22 2022] PUT /identity/v3/projects/7abc4d6c6e004b15abff7738164175db/users/380c6683b4ab4d08a6cf377e620439e8/roles/14efd2033a754e9b9143349f4994e356 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:38:22.742612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911d5c0-1052-410c-b196-ca1f4ce2bdc1 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:22.811407 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d531-f5b3-4643-8eee-3ae6f01a882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:22.812275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d531-f5b3-4643-8eee-3ae6f01a882a None admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:22.812535 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d531-f5b3-4643-8eee-3ae6f01a882a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:22.812814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d531-f5b3-4643-8eee-3ae6f01a882a None admin] PATH_INFO: `/v3/projects/7abc4d6c6e004b15abff7738164175db/users/e187bd54667a46c4a234d4aff23e1777/roles/14efd2033a754e9b9143349f4994e356` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:22.839185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682d531-f5b3-4643-8eee-3ae6f01a882a None admin] RBAC: Authorizing `identity:create_grant(project_id=7abc4d6c6e004b15abff7738164175db, user_id=e187bd54667a46c4a234d4aff23e1777, role_id=14efd2033a754e9b9143349f4994e356)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:22.840677 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682d531-f5b3-4643-8eee-3ae6f01a882a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:22.909017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 291/610] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:38:22 2022] PUT /identity/v3/projects/7abc4d6c6e004b15abff7738164175db/users/e187bd54667a46c4a234d4aff23e1777/roles/14efd2033a754e9b9143349f4994e356 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:38:22.936162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911d5c0-1052-410c-b196-ca1f4ce2bdc1 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:22.978731 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f35243-8a45-4642-994b-492c007c19ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:22.979774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f35243-8a45-4642-994b-492c007c19ad None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:22.980290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f35243-8a45-4642-994b-492c007c19ad None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:22.980782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f35243-8a45-4642-994b-492c007c19ad None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:22.981723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f35243-8a45-4642-994b-492c007c19ad None admin] RBAC: Adding query filter params (name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:22.982795 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f35243-8a45-4642-994b-492c007c19ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:22.984466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f35243-8a45-4642-994b-492c007c19ad None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:22.997168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 320/611] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:23.003489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d531-f5b3-4643-8eee-3ae6f01a882a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:23.118782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:23.128206 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d531-f5b3-4643-8eee-3ae6f01a882a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:23.168992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831f812-2514-4bdd-b57a-c53b5013ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:23.169699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831f812-2514-4bdd-b57a-c53b5013ef6c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:23.170014 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831f812-2514-4bdd-b57a-c53b5013ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:23.170422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831f812-2514-4bdd-b57a-c53b5013ef6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:23.183575 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831f812-2514-4bdd-b57a-c53b5013ef6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:23.185220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831f812-2514-4bdd-b57a-c53b5013ef6c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-a831f812-2514-4bdd-b57a-c53b5013ef6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:23.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:23.203704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:23.204648 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:23.204648 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:23.204648 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:23.204648 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 292/612] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:23.210148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f35243-8a45-4642-994b-492c007c19ad None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:23.239097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:23.276603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1c163-8187-4c01-8682-d2ab8027710f None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:23.276935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1c163-8187-4c01-8682-d2ab8027710f None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:23.277163 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1c163-8187-4c01-8682-d2ab8027710f None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:23.279056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 293/613] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:38:23.288406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfcbbb-d944-4b4d-9c46-6c66b66498bd None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:23.288406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfcbbb-d944-4b4d-9c46-6c66b66498bd None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:23.288406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfcbbb-d944-4b4d-9c46-6c66b66498bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:23.306089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-52cfcbbb-d944-4b4d-9c46-6c66b66498bd None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:23.307318 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-52cfcbbb-d944-4b4d-9c46-6c66b66498bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:23.353340 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f35243-8a45-4642-994b-492c007c19ad None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:23.384573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 294/614] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:38:23.413955 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea66c5-625a-46cb-8d91-cd2a323319b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:23.414582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea66c5-625a-46cb-8d91-cd2a323319b5 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:23.424634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea66c5-625a-46cb-8d91-cd2a323319b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:23.424634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea66c5-625a-46cb-8d91-cd2a323319b5 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:23.424634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea66c5-625a-46cb-8d91-cd2a323319b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:23.424634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea66c5-625a-46cb-8d91-cd2a323319b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:23.424634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea66c5-625a-46cb-8d91-cd2a323319b5 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:23.439711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 321/615] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:23.445243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfcbbb-d944-4b4d-9c46-6c66b66498bd None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:23.547287 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:23.576652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfcbbb-d944-4b4d-9c46-6c66b66498bd None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:23.619755 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6bd3b-002e-47c5-8792-a6a0dee8f123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:23.620440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6bd3b-002e-47c5-8792-a6a0dee8f123 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:23.620726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6bd3b-002e-47c5-8792-a6a0dee8f123 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:23.621002 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6bd3b-002e-47c5-8792-a6a0dee8f123 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:23.629705 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6bd3b-002e-47c5-8792-a6a0dee8f123 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:23.631161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6bd3b-002e-47c5-8792-a6a0dee8f123 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-bfb6bd3b-002e-47c5-8792-a6a0dee8f123 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:23.644965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:23.645916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:23.646823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:23.646823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:23.646823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:23.646823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:23.646823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:23.646823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:23.646823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:23.646823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:23.646823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:38:23.646823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:23.650857 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 295/616] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:38:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:23.652328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea66c5-625a-46cb-8d91-cd2a323319b5 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:23.718507 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6bd3b-002e-47c5-8792-a6a0dee8f123 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:23.803775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:23.846254 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6bd3b-002e-47c5-8792-a6a0dee8f123 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:23.887818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea66c5-625a-46cb-8d91-cd2a323319b5 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:23.891040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6f894-5adb-4ae8-8369-05b9a3b99c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:23.891696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6f894-5adb-4ae8-8369-05b9a3b99c46 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:23.891977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6f894-5adb-4ae8-8369-05b9a3b99c46 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:23.892276 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6f894-5adb-4ae8-8369-05b9a3b99c46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:23.896513 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:23.914987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6f894-5adb-4ae8-8369-05b9a3b99c46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-c5c6f894-5adb-4ae8-8369-05b9a3b99c46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:23.925216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:23.926224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:23.927031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:23.927031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:23.927031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:23.927031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:23.927031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:23.927031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:23.927031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:23.927031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:23.927031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:23.927031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:23.927031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:23.927031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:23.927825 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 296/617] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:23.937082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6f894-5adb-4ae8-8369-05b9a3b99c46 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:23.955335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d41f5-03a3-468c-a034-704ed789ca90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:23.956760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d41f5-03a3-468c-a034-704ed789ca90 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:23.957248 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d41f5-03a3-468c-a034-704ed789ca90 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:23.957819 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d41f5-03a3-468c-a034-704ed789ca90 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:23.958752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d41f5-03a3-468c-a034-704ed789ca90 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:23.959254 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d41f5-03a3-468c-a034-704ed789ca90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:23.960922 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d41f5-03a3-468c-a034-704ed789ca90 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:23.980385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 322/618] 10.222.0.72 () {56 vars in 1135 bytes} [Mon Aug 29 22:38:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:23.986959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d41f5-03a3-468c-a034-704ed789ca90 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:24.095182 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d41f5-03a3-468c-a034-704ed789ca90 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:24.132259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78973b79-b01f-4c48-9c26-a8fa2010c540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:24.133059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78973b79-b01f-4c48-9c26-a8fa2010c540 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:24.133440 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78973b79-b01f-4c48-9c26-a8fa2010c540 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:24.133852 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78973b79-b01f-4c48-9c26-a8fa2010c540 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:24.141833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:24.146162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78973b79-b01f-4c48-9c26-a8fa2010c540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:24.155620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78973b79-b01f-4c48-9c26-a8fa2010c540 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-78973b79-b01f-4c48-9c26-a8fa2010c540 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:24.165434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:24.166674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:24.167650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:24.167650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:24.167650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:24.167650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 323/619] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:24.175749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78973b79-b01f-4c48-9c26-a8fa2010c540 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:24.222331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6f894-5adb-4ae8-8369-05b9a3b99c46 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:24.298322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78973b79-b01f-4c48-9c26-a8fa2010c540 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:24.334506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff9156-7c2e-422d-8e9c-f40cbfc53901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:24.335238 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9156-7c2e-422d-8e9c-f40cbfc53901 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:24.335524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9156-7c2e-422d-8e9c-f40cbfc53901 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:24.335890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9156-7c2e-422d-8e9c-f40cbfc53901 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:24.336699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff9156-7c2e-422d-8e9c-f40cbfc53901 None admin] RBAC: Adding query filter params (name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:24.337001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff9156-7c2e-422d-8e9c-f40cbfc53901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:24.338185 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2676b8-aad5-40de-9f4c-858d30012fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:24.338489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff9156-7c2e-422d-8e9c-f40cbfc53901 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:24.338804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2676b8-aad5-40de-9f4c-858d30012fa6 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:24.339081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2676b8-aad5-40de-9f4c-858d30012fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:24.339352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2676b8-aad5-40de-9f4c-858d30012fa6 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:24.340128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2676b8-aad5-40de-9f4c-858d30012fa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:24.340469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2676b8-aad5-40de-9f4c-858d30012fa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:24.343097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2676b8-aad5-40de-9f4c-858d30012fa6 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:24.355936 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 297/620] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:24.358157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 324/621] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:24.366397 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff9156-7c2e-422d-8e9c-f40cbfc53901 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:24.372258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2676b8-aad5-40de-9f4c-858d30012fa6 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:24.437257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:24.485779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:24.499454 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2676b8-aad5-40de-9f4c-858d30012fa6 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:24.549625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72148856-ac01-45ed-a459-e85e79a6714d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:24.550687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148856-ac01-45ed-a459-e85e79a6714d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:24.551172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148856-ac01-45ed-a459-e85e79a6714d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:24.551669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148856-ac01-45ed-a459-e85e79a6714d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:24.552386 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff9156-7c2e-422d-8e9c-f40cbfc53901 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:24.566301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72148856-ac01-45ed-a459-e85e79a6714d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:24.568863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72148856-ac01-45ed-a459-e85e79a6714d None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-72148856-ac01-45ed-a459-e85e79a6714d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:24.591729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:24.592774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:24.593642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:24.593642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:24.593642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:24.595797 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 325/622] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:24.597387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d42b53-1d2a-4cad-badd-6317b581c02a None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:24.597881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d42b53-1d2a-4cad-badd-6317b581c02a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:24.598371 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d42b53-1d2a-4cad-badd-6317b581c02a None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:24.603945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31feb227-b12b-402f-85d4-3acd29ca8d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:24.603945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31feb227-b12b-402f-85d4-3acd29ca8d94 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:24.603945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31feb227-b12b-402f-85d4-3acd29ca8d94 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:24.603945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31feb227-b12b-402f-85d4-3acd29ca8d94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:24.604758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 326/623] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:24.606169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d42b53-1d2a-4cad-badd-6317b581c02a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:24.612626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31feb227-b12b-402f-85d4-3acd29ca8d94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:24.614157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31feb227-b12b-402f-85d4-3acd29ca8d94 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:24.627935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-31feb227-b12b-402f-85d4-3acd29ca8d94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:24.627935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:24.627935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:24.627935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:24.627935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:24.627935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:24.627935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:24.627935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:24.627935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:24.627935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:24.627935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:24.627935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:24.627935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:24.627935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:24.627935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:24.628938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:24.629833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:24.629833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:24.629833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:24.629833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:24.629833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:24.629833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:24.629833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:24.629833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:24.634309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 298/624] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:24.635817 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f17b7-206e-4d93-b302-b25793d77e52 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:24.636086 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f17b7-206e-4d93-b302-b25793d77e52 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:24.636390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f17b7-206e-4d93-b302-b25793d77e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:24.657589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-996f17b7-206e-4d93-b302-b25793d77e52 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:24.658905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-996f17b7-206e-4d93-b302-b25793d77e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:24.736827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d42b53-1d2a-4cad-badd-6317b581c02a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:24.738519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:24.759193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 299/625] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:24.759193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f17b7-206e-4d93-b302-b25793d77e52 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:24.800668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377baabf-5fe3-4b43-b092-418339054ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:24.801341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377baabf-5fe3-4b43-b092-418339054ac9 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:24.801625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377baabf-5fe3-4b43-b092-418339054ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:24.801901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377baabf-5fe3-4b43-b092-418339054ac9 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:24.802594 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377baabf-5fe3-4b43-b092-418339054ac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:24.802902 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377baabf-5fe3-4b43-b092-418339054ac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:24.804481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377baabf-5fe3-4b43-b092-418339054ac9 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:24.817935 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 327/626] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:24.823643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377baabf-5fe3-4b43-b092-418339054ac9 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:24.876797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:24.994138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f17b7-206e-4d93-b302-b25793d77e52 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:25.008039 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377baabf-5fe3-4b43-b092-418339054ac9 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:25.065518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646adcf-e1aa-46e3-86ad-d641ff18d4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:25.066156 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646adcf-e1aa-46e3-86ad-d641ff18d4ac None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:25.066542 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646adcf-e1aa-46e3-86ad-d641ff18d4ac None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:25.066918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646adcf-e1aa-46e3-86ad-d641ff18d4ac None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:25.067634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646adcf-e1aa-46e3-86ad-d641ff18d4ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:25.067748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983bada-499a-4529-952e-24c38e073434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:25.067938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646adcf-e1aa-46e3-86ad-d641ff18d4ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:25.068553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983bada-499a-4529-952e-24c38e073434 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:25.068853 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983bada-499a-4529-952e-24c38e073434 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:25.069201 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983bada-499a-4529-952e-24c38e073434 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:25.069725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646adcf-e1aa-46e3-86ad-d641ff18d4ac None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:25.083035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983bada-499a-4529-952e-24c38e073434 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:25.084634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983bada-499a-4529-952e-24c38e073434 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:25.096310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 300/627] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-a983bada-499a-4529-952e-24c38e073434 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:25.102096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:25.103071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:25.104089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:25.104089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:25.104089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:25.104089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:25.104089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:25.104089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:25.104089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:25.104089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:25.104089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:38:25.104089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:25.104654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646adcf-e1aa-46e3-86ad-d641ff18d4ac None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:25.108861 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 328/628] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:38:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:25.115323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983bada-499a-4529-952e-24c38e073434 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:25.144035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:25.217792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646adcf-e1aa-46e3-86ad-d641ff18d4ac None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:25.228338 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:25.229612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983bada-499a-4529-952e-24c38e073434 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:25.257521 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820d284-743a-4a27-b000-0cc2240de0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:25.258160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820d284-743a-4a27-b000-0cc2240de0a3 None admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:25.258437 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820d284-743a-4a27-b000-0cc2240de0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:25.258711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820d284-743a-4a27-b000-0cc2240de0a3 None admin] PATH_INFO: `/v3/projects/7abc4d6c6e004b15abff7738164175db/users/94511ad9ee7a4ab0b70d8d5098079886/roles/14efd2033a754e9b9143349f4994e356` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:25.267464 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fbd20-41f3-464f-92f5-c48ee9049c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:25.268442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fbd20-41f3-464f-92f5-c48ee9049c14 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:25.268926 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fbd20-41f3-464f-92f5-c48ee9049c14 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:25.269395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fbd20-41f3-464f-92f5-c48ee9049c14 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:25.270350 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fbd20-41f3-464f-92f5-c48ee9049c14 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:25.270856 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fbd20-41f3-464f-92f5-c48ee9049c14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:25.272554 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fbd20-41f3-464f-92f5-c48ee9049c14 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:25.276111 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820d284-743a-4a27-b000-0cc2240de0a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7abc4d6c6e004b15abff7738164175db, user_id=94511ad9ee7a4ab0b70d8d5098079886, role_id=14efd2033a754e9b9143349f4994e356)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:25.277342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820d284-743a-4a27-b000-0cc2240de0a3 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:25.292483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 329/629] 10.222.0.72 () {56 vars in 1137 bytes} [Mon Aug 29 22:38:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:25.293154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fbd20-41f3-464f-92f5-c48ee9049c14 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:25.347385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 301/630] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:38:25 2022] PUT /identity/v3/projects/7abc4d6c6e004b15abff7738164175db/users/94511ad9ee7a4ab0b70d8d5098079886/roles/14efd2033a754e9b9143349f4994e356 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:38:25.348345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820d284-743a-4a27-b000-0cc2240de0a3 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:25.441201 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:25.467048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fbd20-41f3-464f-92f5-c48ee9049c14 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:25.496709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820d284-743a-4a27-b000-0cc2240de0a3 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:25.511117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2916bb-91e0-44ca-8a24-68c17017dd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:25.511782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2916bb-91e0-44ca-8a24-68c17017dd2a None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:25.512132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2916bb-91e0-44ca-8a24-68c17017dd2a None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:25.512530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2916bb-91e0-44ca-8a24-68c17017dd2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:25.526605 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2916bb-91e0-44ca-8a24-68c17017dd2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-db2916bb-91e0-44ca-8a24-68c17017dd2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:25.532804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:25.533815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:25.534651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:25.534651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:25.534651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:25.534651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:25.534651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:25.534651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:25.534651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:25.534651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:25.534651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:25.534651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:25.534651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:25.534651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:25.534651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 330/631] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:25.535841 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fd0d5-7eb2-4837-a864-bd63e6daf399 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:25.535942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fd0d5-7eb2-4837-a864-bd63e6daf399 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:25.536221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fd0d5-7eb2-4837-a864-bd63e6daf399 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:25.540262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 331/632] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:25.540262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467bd60-8f60-4a99-ac61-26f5eeb3e425 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:25.540262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467bd60-8f60-4a99-ac61-26f5eeb3e425 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:25.540262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467bd60-8f60-4a99-ac61-26f5eeb3e425 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:25.541268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 332/633] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:25.542742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467bd60-8f60-4a99-ac61-26f5eeb3e425 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:25.544630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403c269-67d3-4abb-910b-b37520c9d18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:25.545480 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403c269-67d3-4abb-910b-b37520c9d18a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:25.545871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403c269-67d3-4abb-910b-b37520c9d18a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:25.546157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403c269-67d3-4abb-910b-b37520c9d18a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:25.583983 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:25.631380 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403c269-67d3-4abb-910b-b37520c9d18a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:25.632999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403c269-67d3-4abb-910b-b37520c9d18a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:25.673965 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467bd60-8f60-4a99-ac61-26f5eeb3e425 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:25.713229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288692d-ab10-44a9-aee9-665e42b187cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:25.714682 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288692d-ab10-44a9-aee9-665e42b187cd None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:25.715165 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288692d-ab10-44a9-aee9-665e42b187cd None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:25.715726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288692d-ab10-44a9-aee9-665e42b187cd None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:25.717181 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288692d-ab10-44a9-aee9-665e42b187cd None admin] RBAC: Adding query filter params (name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:25.717503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288692d-ab10-44a9-aee9-665e42b187cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:25.718908 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288692d-ab10-44a9-aee9-665e42b187cd None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:25.728335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 333/634] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:25.730320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f566bd3-23b2-4359-ae1e-94761803a842 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:25.730815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f566bd3-23b2-4359-ae1e-94761803a842 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:25.731649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f566bd3-23b2-4359-ae1e-94761803a842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:25.739389 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:25.749512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 302/635] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:25.749512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f42bc5-74f9-4d84-9f02-d5fbba6b091d None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:25.749512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f42bc5-74f9-4d84-9f02-d5fbba6b091d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:25.749512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f42bc5-74f9-4d84-9f02-d5fbba6b091d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:25.756212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-3f566bd3-23b2-4359-ae1e-94761803a842 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:25.757498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-3f566bd3-23b2-4359-ae1e-94761803a842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:25.768396 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-f2f42bc5-74f9-4d84-9f02-d5fbba6b091d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:25.769544 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f2f42bc5-74f9-4d84-9f02-d5fbba6b091d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:25.829676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:25.844219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 334/636] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:25.844219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f566bd3-23b2-4359-ae1e-94761803a842 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:25.860943 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 303/637] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:25.861886 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f42bc5-74f9-4d84-9f02-d5fbba6b091d None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:26.033835 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f566bd3-23b2-4359-ae1e-94761803a842 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:26.050272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f42bc5-74f9-4d84-9f02-d5fbba6b091d None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:26.100147 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b86e20-8977-43bc-8b18-9c0949e2dcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:26.100823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b86e20-8977-43bc-8b18-9c0949e2dcf5 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:26.101514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b86e20-8977-43bc-8b18-9c0949e2dcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:26.101881 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b86e20-8977-43bc-8b18-9c0949e2dcf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:26.113321 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:26.113622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b86e20-8977-43bc-8b18-9c0949e2dcf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:26.115575 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b86e20-8977-43bc-8b18-9c0949e2dcf5 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:26.127483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b681665-3d60-4ae3-96c1-e1fb2d39011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:26.128148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b681665-3d60-4ae3-96c1-e1fb2d39011a None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:26.128461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b681665-3d60-4ae3-96c1-e1fb2d39011a None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:26.128747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b681665-3d60-4ae3-96c1-e1fb2d39011a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-a4b86e20-8977-43bc-8b18-9c0949e2dcf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:26.133464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:26.134401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:26.135281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:26.135281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:26.135281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:26.135281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 304/638] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:26.139393 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b86e20-8977-43bc-8b18-9c0949e2dcf5 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:26.150833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b681665-3d60-4ae3-96c1-e1fb2d39011a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:26.153108 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b681665-3d60-4ae3-96c1-e1fb2d39011a None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-6b681665-3d60-4ae3-96c1-e1fb2d39011a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:26.170442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:26.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:26.172318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:26.172318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:26.172318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:26.177682 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 335/639] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:26.177682 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b681665-3d60-4ae3-96c1-e1fb2d39011a None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:26.186775 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:26.258193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b86e20-8977-43bc-8b18-9c0949e2dcf5 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:26.289653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b681665-3d60-4ae3-96c1-e1fb2d39011a None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:26.296802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52291a-889b-403d-b5e1-78578f2f4eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:26.297482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52291a-889b-403d-b5e1-78578f2f4eb4 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:26.297766 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52291a-889b-403d-b5e1-78578f2f4eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:26.298040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52291a-889b-403d-b5e1-78578f2f4eb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:26.309507 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52291a-889b-403d-b5e1-78578f2f4eb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-4a52291a-889b-403d-b5e1-78578f2f4eb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:26.316304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:26.317272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:26.318120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:26.318120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:26.318120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:26.318120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:26.318120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:26.318120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:26.318120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:26.318120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:26.318120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:26.318120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:26.318120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:26.318120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:26.318120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 305/640] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:26.318807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52291a-889b-403d-b5e1-78578f2f4eb4 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:26.336054 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f36b9-3312-432e-a2ff-01e02dbc5e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:26.336795 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f36b9-3312-432e-a2ff-01e02dbc5e48 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:26.337035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f36b9-3312-432e-a2ff-01e02dbc5e48 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:26.337238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f36b9-3312-432e-a2ff-01e02dbc5e48 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:26.337897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f36b9-3312-432e-a2ff-01e02dbc5e48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:26.338187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f36b9-3312-432e-a2ff-01e02dbc5e48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:26.339560 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f36b9-3312-432e-a2ff-01e02dbc5e48 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:26.359420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 336/641] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:26.359420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f36b9-3312-432e-a2ff-01e02dbc5e48 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:26.410690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:26.446818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:26.450215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52291a-889b-403d-b5e1-78578f2f4eb4 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:26.481501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f36b9-3312-432e-a2ff-01e02dbc5e48 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:26.489398 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d9e73-53d1-4507-aef6-84c9022cb465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:26.490048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d9e73-53d1-4507-aef6-84c9022cb465 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:26.490460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d9e73-53d1-4507-aef6-84c9022cb465 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:26.490778 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d9e73-53d1-4507-aef6-84c9022cb465 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:26.504023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d9e73-53d1-4507-aef6-84c9022cb465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-711d9e73-53d1-4507-aef6-84c9022cb465 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:26.509589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:26.511470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:26.513236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:26.513236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:26.513236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:26.513236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:26.513236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:26.513236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:26.513236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:26.513236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:26.513236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:26.513236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:26.513236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:26.513236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:26.517512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 306/642] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:26.518382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d9e73-53d1-4507-aef6-84c9022cb465 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:26.525940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d4a8f-9d5b-4f10-89a2-bd37b27c8916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:26.526571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d4a8f-9d5b-4f10-89a2-bd37b27c8916 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:26.526850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d4a8f-9d5b-4f10-89a2-bd37b27c8916 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:26.527126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d4a8f-9d5b-4f10-89a2-bd37b27c8916 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:26.527851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d4a8f-9d5b-4f10-89a2-bd37b27c8916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:26.528160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d4a8f-9d5b-4f10-89a2-bd37b27c8916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:26.530176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d4a8f-9d5b-4f10-89a2-bd37b27c8916 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:26.547429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 337/643] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:26.547429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d4a8f-9d5b-4f10-89a2-bd37b27c8916 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:26.659167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d9e73-53d1-4507-aef6-84c9022cb465 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:26.670897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d4a8f-9d5b-4f10-89a2-bd37b27c8916 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:26.674083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:26.702022 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62bfbe-0cc9-4429-8945-b9fe4ef6966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:26.702740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62bfbe-0cc9-4429-8945-b9fe4ef6966a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:26.703094 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62bfbe-0cc9-4429-8945-b9fe4ef6966a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:26.703446 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62bfbe-0cc9-4429-8945-b9fe4ef6966a None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:26.704251 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62bfbe-0cc9-4429-8945-b9fe4ef6966a None admin] RBAC: Adding query filter params (name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:26.704560 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62bfbe-0cc9-4429-8945-b9fe4ef6966a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:26.705993 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62bfbe-0cc9-4429-8945-b9fe4ef6966a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:26.714727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 307/644] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:26.716379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62bfbe-0cc9-4429-8945-b9fe4ef6966a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:26.721547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238611b-5cc1-43f3-995c-9e2aaf04f38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:26.721547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238611b-5cc1-43f3-995c-9e2aaf04f38b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:26.721787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238611b-5cc1-43f3-995c-9e2aaf04f38b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:26.721913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238611b-5cc1-43f3-995c-9e2aaf04f38b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:26.729466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238611b-5cc1-43f3-995c-9e2aaf04f38b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:26.730914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238611b-5cc1-43f3-995c-9e2aaf04f38b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:26.743470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-6238611b-5cc1-43f3-995c-9e2aaf04f38b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:26.743470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:26.743470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:26.743470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:26.743470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:26.743470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:26.743470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:26.743470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:26.743470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:26.743470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:26.743470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:26.743470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:26.743470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:26.743470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:26.743470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:26.744437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:26.745671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:26.745671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:26.745671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:26.745671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:26.745671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:26.745671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:26.745671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:26.745671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:26.745671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 338/645] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:26.745671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238611b-5cc1-43f3-995c-9e2aaf04f38b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:26.752121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:26.838825 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62bfbe-0cc9-4429-8945-b9fe4ef6966a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:26.863475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238611b-5cc1-43f3-995c-9e2aaf04f38b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:26.883749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f834a-b703-4c1c-8d65-9b34b95e32cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:26.884926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f834a-b703-4c1c-8d65-9b34b95e32cb None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:26.885312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f834a-b703-4c1c-8d65-9b34b95e32cb None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:26.885817 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f834a-b703-4c1c-8d65-9b34b95e32cb None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:26.886468 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f834a-b703-4c1c-8d65-9b34b95e32cb None admin] RBAC: Adding query filter params (name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:26.886901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f834a-b703-4c1c-8d65-9b34b95e32cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:26.889874 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f834a-b703-4c1c-8d65-9b34b95e32cb None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:26.899682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 308/646] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:26.900774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f834a-b703-4c1c-8d65-9b34b95e32cb None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:26.912020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e662c-985f-4cd0-a099-fa4791802572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:26.912699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e662c-985f-4cd0-a099-fa4791802572 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:26.913001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e662c-985f-4cd0-a099-fa4791802572 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:26.913297 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e662c-985f-4cd0-a099-fa4791802572 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:26.925321 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e662c-985f-4cd0-a099-fa4791802572 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:26.926792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e662c-985f-4cd0-a099-fa4791802572 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-8a3e662c-985f-4cd0-a099-fa4791802572 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:26.939789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:26.940823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:26.941752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:26.941752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:26.941752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:26.941752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:26.941752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:26.941752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:26.941752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:26.941752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:26.941752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:38:26.941752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:26.941752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 339/647] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Aug 29 22:38:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:26.941752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e662c-985f-4cd0-a099-fa4791802572 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:26.974035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:27.015540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:27.035647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f834a-b703-4c1c-8d65-9b34b95e32cb None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:27.067295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e662c-985f-4cd0-a099-fa4791802572 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:27.079834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9c5dc-a62c-406b-808a-9a7e6144587c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:27.080678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9c5dc-a62c-406b-808a-9a7e6144587c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:27.080962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9c5dc-a62c-406b-808a-9a7e6144587c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:27.081234 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9c5dc-a62c-406b-808a-9a7e6144587c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:27.095309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9c5dc-a62c-406b-808a-9a7e6144587c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:27.096730 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9c5dc-a62c-406b-808a-9a7e6144587c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:27.109743 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe885238-e298-41dd-9465-2d0ca609e66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:27.110711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe885238-e298-41dd-9465-2d0ca609e66b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:27.111223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe885238-e298-41dd-9465-2d0ca609e66b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:27.111701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe885238-e298-41dd-9465-2d0ca609e66b None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-7aa9c5dc-a62c-406b-808a-9a7e6144587c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:27.112105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:27.113051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:27.113909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:27.113909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:27.113909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:27.113909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 309/648] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:27.114139 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9c5dc-a62c-406b-808a-9a7e6144587c None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:27.115221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe885238-e298-41dd-9465-2d0ca609e66b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:27.115610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe885238-e298-41dd-9465-2d0ca609e66b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:27.117196 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe885238-e298-41dd-9465-2d0ca609e66b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:27.135297 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 340/649] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:27.136263 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe885238-e298-41dd-9465-2d0ca609e66b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:27.234186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:27.246745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9c5dc-a62c-406b-808a-9a7e6144587c None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:27.253763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe885238-e298-41dd-9465-2d0ca609e66b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:27.296158 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94192486-b18c-45e1-b9d2-f73c20f41dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:27.297015 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94192486-b18c-45e1-b9d2-f73c20f41dcb None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:27.297296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94192486-b18c-45e1-b9d2-f73c20f41dcb None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:27.297572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94192486-b18c-45e1-b9d2-f73c20f41dcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:27.300980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:27.303296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce65c1e-28e3-4ce9-a8ab-bd2ce5ed0719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:27.304259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce65c1e-28e3-4ce9-a8ab-bd2ce5ed0719 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:27.304719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce65c1e-28e3-4ce9-a8ab-bd2ce5ed0719 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:27.305268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce65c1e-28e3-4ce9-a8ab-bd2ce5ed0719 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:27.306237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce65c1e-28e3-4ce9-a8ab-bd2ce5ed0719 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:27.309687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce65c1e-28e3-4ce9-a8ab-bd2ce5ed0719 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:27.309687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce65c1e-28e3-4ce9-a8ab-bd2ce5ed0719 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:27.312151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94192486-b18c-45e1-b9d2-f73c20f41dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:27.313411 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94192486-b18c-45e1-b9d2-f73c20f41dcb None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-94192486-b18c-45e1-b9d2-f73c20f41dcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:27.330591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:27.331813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:27.332908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:27.332908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:27.332908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:27.334758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 310/650] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:27.335932 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94192486-b18c-45e1-b9d2-f73c20f41dcb None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:27.347923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 341/651] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Aug 29 22:38:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:27.347923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce65c1e-28e3-4ce9-a8ab-bd2ce5ed0719 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:27.472926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94192486-b18c-45e1-b9d2-f73c20f41dcb None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:27.483574 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce65c1e-28e3-4ce9-a8ab-bd2ce5ed0719 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:27.508746 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7396b-e8ec-42cf-a14e-b4e2735a3ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:27.509353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7396b-e8ec-42cf-a14e-b4e2735a3ad7 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:27.509634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7396b-e8ec-42cf-a14e-b4e2735a3ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:27.509899 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7396b-e8ec-42cf-a14e-b4e2735a3ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:27.510537 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7396b-e8ec-42cf-a14e-b4e2735a3ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:27.510836 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7396b-e8ec-42cf-a14e-b4e2735a3ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:27.512181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7396b-e8ec-42cf-a14e-b4e2735a3ad7 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:27.519511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9230f51-94d1-4357-83a6-b88796e4bad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:27.520153 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9230f51-94d1-4357-83a6-b88796e4bad9 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:27.520473 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9230f51-94d1-4357-83a6-b88796e4bad9 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:27.520744 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9230f51-94d1-4357-83a6-b88796e4bad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:27.521482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9230f51-94d1-4357-83a6-b88796e4bad9 None admin] RBAC: Adding query filter params (role.id=14efd2033a754e9b9143349f4994e356, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=c7e72cc048a0418cac062d68b8df402f) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:27.521820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9230f51-94d1-4357-83a6-b88796e4bad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:27.523389 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9230f51-94d1-4357-83a6-b88796e4bad9 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:27.524599 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 311/652] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:27.525429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7396b-e8ec-42cf-a14e-b4e2735a3ad7 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:27.534787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 342/653] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:27 2022] GET /identity/v3/role_assignments?user.id=c7e72cc048a0418cac062d68b8df402f&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=14efd2033a754e9b9143349f4994e356 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:27.535621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9230f51-94d1-4357-83a6-b88796e4bad9 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:27.546375 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:27.588812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:27.652054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7396b-e8ec-42cf-a14e-b4e2735a3ad7 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:27.660528 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9230f51-94d1-4357-83a6-b88796e4bad9 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:27.691265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418e662-9d93-4901-adce-659e9afb43a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:27.691979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418e662-9d93-4901-adce-659e9afb43a9 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:27.692297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418e662-9d93-4901-adce-659e9afb43a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:27.692580 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418e662-9d93-4901-adce-659e9afb43a9 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:27.693220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418e662-9d93-4901-adce-659e9afb43a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:27.693580 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418e662-9d93-4901-adce-659e9afb43a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:27.695048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418e662-9d93-4901-adce-659e9afb43a9 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:27.705482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28320f82-d9ac-4233-ac42-711864a1ab51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:27.706168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28320f82-d9ac-4233-ac42-711864a1ab51 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:27.706452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28320f82-d9ac-4233-ac42-711864a1ab51 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:27.706732 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28320f82-d9ac-4233-ac42-711864a1ab51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:27.709106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 312/654] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:27.710734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea7ff9-b4f4-4551-970a-166615ff3587 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:27.711018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea7ff9-b4f4-4551-970a-166615ff3587 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:27.711290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea7ff9-b4f4-4551-970a-166615ff3587 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:27.712544 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 313/655] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:27.713235 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea7ff9-b4f4-4551-970a-166615ff3587 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:27.796744 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28320f82-d9ac-4233-ac42-711864a1ab51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:27.798262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28320f82-d9ac-4233-ac42-711864a1ab51 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:27.808392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:27.845545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea7ff9-b4f4-4551-970a-166615ff3587 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:27.857368 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:27.883439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750fe70-bdf0-401d-b8c3-2cc859ec6adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:27.884079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750fe70-bdf0-401d-b8c3-2cc859ec6adb None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:27.884387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750fe70-bdf0-401d-b8c3-2cc859ec6adb None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:27.884661 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750fe70-bdf0-401d-b8c3-2cc859ec6adb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:27.895162 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750fe70-bdf0-401d-b8c3-2cc859ec6adb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:27.896855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750fe70-bdf0-401d-b8c3-2cc859ec6adb None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-8750fe70-bdf0-401d-b8c3-2cc859ec6adb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:27.910028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:27.911028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:27.911941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:27.911941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:27.911941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:27.911941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:27.911941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:27.911941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:27.911941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:27.911941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:27.911941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:38:27.911941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:27.911941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 314/656] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:38:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:27.911941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750fe70-bdf0-401d-b8c3-2cc859ec6adb None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:27.930189 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 343/657] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:27.930189 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912362ee-3dea-4796-bc1e-6471101975df None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:27.930189 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912362ee-3dea-4796-bc1e-6471101975df None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:27.930189 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912362ee-3dea-4796-bc1e-6471101975df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:27.947653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-912362ee-3dea-4796-bc1e-6471101975df None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:27.948959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-912362ee-3dea-4796-bc1e-6471101975df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:28.024347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 344/658] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:28.025222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912362ee-3dea-4796-bc1e-6471101975df None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:28.038758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750fe70-bdf0-401d-b8c3-2cc859ec6adb None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:28.070831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:28.091448 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df01ecc-47d3-401d-94a3-05831ceff4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:28.092784 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df01ecc-47d3-401d-94a3-05831ceff4d0 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:28.093244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df01ecc-47d3-401d-94a3-05831ceff4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:28.093694 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df01ecc-47d3-401d-94a3-05831ceff4d0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:28.105087 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df01ecc-47d3-401d-94a3-05831ceff4d0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:28.107084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df01ecc-47d3-401d-94a3-05831ceff4d0 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-5df01ecc-47d3-401d-94a3-05831ceff4d0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:28.123159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:28.124391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:28.125308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:28.125308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:28.125308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:28.125308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:28.125308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:28.125308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:28.125308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:28.125308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:28.125308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:38:28.125308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:28.127973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 315/659] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:28.129055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df01ecc-47d3-401d-94a3-05831ceff4d0 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:28.158312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912362ee-3dea-4796-bc1e-6471101975df None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:28.167734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:28.217194 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f2d35-9b16-42f5-9a6c-4a5688e1eb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:28.217848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f2d35-9b16-42f5-9a6c-4a5688e1eb2e None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:28.218125 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f2d35-9b16-42f5-9a6c-4a5688e1eb2e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:28.218444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f2d35-9b16-42f5-9a6c-4a5688e1eb2e None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:28.219261 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f2d35-9b16-42f5-9a6c-4a5688e1eb2e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:28.219565 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f2d35-9b16-42f5-9a6c-4a5688e1eb2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:28.221394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f2d35-9b16-42f5-9a6c-4a5688e1eb2e None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:28.249616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 345/660] 10.222.0.72 () {56 vars in 1137 bytes} [Mon Aug 29 22:38:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:28.250818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f2d35-9b16-42f5-9a6c-4a5688e1eb2e None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:28.266759 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df01ecc-47d3-401d-94a3-05831ceff4d0 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:28.305503 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d383-9a7d-46b8-b127-34bf02b6202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:28.306137 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d383-9a7d-46b8-b127-34bf02b6202d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:28.306443 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d383-9a7d-46b8-b127-34bf02b6202d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:28.306716 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d383-9a7d-46b8-b127-34bf02b6202d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:28.318870 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d383-9a7d-46b8-b127-34bf02b6202d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:28.320361 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d383-9a7d-46b8-b127-34bf02b6202d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-9e66d383-9a7d-46b8-b127-34bf02b6202d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:28.335856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:28.336916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:28.337780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:28.337780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:28.337780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:28.337780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 316/661] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:28.338582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d383-9a7d-46b8-b127-34bf02b6202d None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:28.376107 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:28.382845 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f2d35-9b16-42f5-9a6c-4a5688e1eb2e None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:28.427191 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eaad9-e6fd-4817-9971-79ce11c513eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:28.428790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eaad9-e6fd-4817-9971-79ce11c513eb None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:28.429073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eaad9-e6fd-4817-9971-79ce11c513eb None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:28.429451 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eaad9-e6fd-4817-9971-79ce11c513eb None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:28.430116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eaad9-e6fd-4817-9971-79ce11c513eb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:28.430429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eaad9-e6fd-4817-9971-79ce11c513eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:28.431873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eaad9-e6fd-4817-9971-79ce11c513eb None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:28.439258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:28.456966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 346/662] 10.222.0.72 () {56 vars in 1139 bytes} [Mon Aug 29 22:38:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:28.456966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eaad9-e6fd-4817-9971-79ce11c513eb None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:28.469891 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d383-9a7d-46b8-b127-34bf02b6202d None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:28.514813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619e82b-acc4-4b65-ab38-93ca3eb654a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:28.515428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619e82b-acc4-4b65-ab38-93ca3eb654a7 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:28.515713 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619e82b-acc4-4b65-ab38-93ca3eb654a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:28.515988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619e82b-acc4-4b65-ab38-93ca3eb654a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:28.562054 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eaad9-e6fd-4817-9971-79ce11c513eb None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:28.594038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619e82b-acc4-4b65-ab38-93ca3eb654a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:28.595539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619e82b-acc4-4b65-ab38-93ca3eb654a7 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:28.601546 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d0bd4-e55c-47df-9474-6a5fbf9aaf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:28.602379 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d0bd4-e55c-47df-9474-6a5fbf9aaf2b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:28.602811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d0bd4-e55c-47df-9474-6a5fbf9aaf2b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:28.603405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d0bd4-e55c-47df-9474-6a5fbf9aaf2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:28.616791 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d0bd4-e55c-47df-9474-6a5fbf9aaf2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-688d0bd4-e55c-47df-9474-6a5fbf9aaf2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:28.621936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:28.623623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:28.624660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:28.624660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:28.624660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:28.624660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:28.624660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:28.624660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:28.624660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:28.624660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:28.624660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:28.624660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:28.624660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:28.624660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:28.624660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 347/663] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:28.624660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d0bd4-e55c-47df-9474-6a5fbf9aaf2b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:28.646611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:28.694689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:28.716481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 317/664] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:28.717566 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619e82b-acc4-4b65-ab38-93ca3eb654a7 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:28.755209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d0bd4-e55c-47df-9474-6a5fbf9aaf2b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:28.793646 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a52952-666e-45ec-9e66-041cc10fabe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:28.794410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a52952-666e-45ec-9e66-041cc10fabe7 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:28.794805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a52952-666e-45ec-9e66-041cc10fabe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:28.795218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a52952-666e-45ec-9e66-041cc10fabe7 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:28.795908 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a52952-666e-45ec-9e66-041cc10fabe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:28.796291 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a52952-666e-45ec-9e66-041cc10fabe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:28.797748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a52952-666e-45ec-9e66-041cc10fabe7 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:28.816555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 348/665] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:28.816555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a52952-666e-45ec-9e66-041cc10fabe7 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:28.847321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619e82b-acc4-4b65-ab38-93ca3eb654a7 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:28.892306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74064b92-048b-4654-9ab3-45c73cdbb63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:28.892901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74064b92-048b-4654-9ab3-45c73cdbb63d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:28.893169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74064b92-048b-4654-9ab3-45c73cdbb63d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:28.893441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74064b92-048b-4654-9ab3-45c73cdbb63d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:28.912153 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:28.945977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a52952-666e-45ec-9e66-041cc10fabe7 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:28.956574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:28.982430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74064b92-048b-4654-9ab3-45c73cdbb63d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:28.983957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74064b92-048b-4654-9ab3-45c73cdbb63d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:28.984365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e199e-09f9-45de-b739-459a58c0844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:28.985046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e199e-09f9-45de-b739-459a58c0844c None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:28.985324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e199e-09f9-45de-b739-459a58c0844c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:28.985599 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e199e-09f9-45de-b739-459a58c0844c None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:28.986324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e199e-09f9-45de-b739-459a58c0844c None admin] RBAC: Adding query filter params (name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:28.986557 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e199e-09f9-45de-b739-459a58c0844c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:28.987924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e199e-09f9-45de-b739-459a58c0844c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:28.996527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 349/666] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:28.997798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e199e-09f9-45de-b739-459a58c0844c None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:29.106339 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 318/667] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:29.111553 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74064b92-048b-4654-9ab3-45c73cdbb63d None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:29.114958 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e199e-09f9-45de-b739-459a58c0844c None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:29.152307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986648d-a375-40d4-9105-44d1faa91614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:29.152945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986648d-a375-40d4-9105-44d1faa91614 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:29.154041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986648d-a375-40d4-9105-44d1faa91614 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:29.154317 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986648d-a375-40d4-9105-44d1faa91614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:29.156517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:29.166297 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986648d-a375-40d4-9105-44d1faa91614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:29.167843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986648d-a375-40d4-9105-44d1faa91614 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-5986648d-a375-40d4-9105-44d1faa91614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:29.184231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:29.186207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:29.187113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:29.187113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:29.187113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:29.187113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 350/668] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:29.187932 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986648d-a375-40d4-9105-44d1faa91614 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:29.212844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:29.233624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74064b92-048b-4654-9ab3-45c73cdbb63d None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:29.273973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7031fc9-40ec-4c1c-b5ff-05b3c7ff0931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:29.275224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7031fc9-40ec-4c1c-b5ff-05b3c7ff0931 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:29.275507 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7031fc9-40ec-4c1c-b5ff-05b3c7ff0931 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:29.275779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7031fc9-40ec-4c1c-b5ff-05b3c7ff0931 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:29.284471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7031fc9-40ec-4c1c-b5ff-05b3c7ff0931 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:29.285941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7031fc9-40ec-4c1c-b5ff-05b3c7ff0931 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:29.299363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-d7031fc9-40ec-4c1c-b5ff-05b3c7ff0931 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:29.299363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:29.299363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:29.299363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:29.299363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:29.299363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:29.299363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:29.299363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:29.299363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:29.299363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:29.299363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:29.299363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:29.299363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:29.299363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:29.299363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:29.300485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:29.301496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:29.301496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:29.301496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:29.301496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:29.301496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:29.301496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:29.301496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:29.301496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:29.303313 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 319/669] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:29.304295 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7031fc9-40ec-4c1c-b5ff-05b3c7ff0931 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:29.311470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986648d-a375-40d4-9105-44d1faa91614 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:29.356668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71a342-385f-45ab-9294-bf9d69be0741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:29.357312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71a342-385f-45ab-9294-bf9d69be0741 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:29.357592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71a342-385f-45ab-9294-bf9d69be0741 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:29.357865 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71a342-385f-45ab-9294-bf9d69be0741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:29.379607 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71a342-385f-45ab-9294-bf9d69be0741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:29.381121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71a342-385f-45ab-9294-bf9d69be0741 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-7f71a342-385f-45ab-9294-bf9d69be0741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:29.400470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:29.401500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:29.402359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:29.402359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:29.402359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:29.402359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 351/670] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:29.403010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71a342-385f-45ab-9294-bf9d69be0741 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:29.458363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7031fc9-40ec-4c1c-b5ff-05b3c7ff0931 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:29.458969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:29.501602 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7c028-c333-4ff2-baa9-da524a853b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:29.503191 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7c028-c333-4ff2-baa9-da524a853b71 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:29.503466 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7c028-c333-4ff2-baa9-da524a853b71 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:29.503737 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7c028-c333-4ff2-baa9-da524a853b71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:29.514016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:29.516663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7c028-c333-4ff2-baa9-da524a853b71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:29.518269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7c028-c333-4ff2-baa9-da524a853b71 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:29.530627 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71a342-385f-45ab-9294-bf9d69be0741 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-ccb7c028-c333-4ff2-baa9-da524a853b71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:29.535042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:29.536077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:29.537166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:29.537166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:29.537166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:29.541026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 320/671] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:29.541782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7c028-c333-4ff2-baa9-da524a853b71 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:29.567317 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78046fe7-9e3f-47d2-b2b9-2c608e17d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:29.567934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78046fe7-9e3f-47d2-b2b9-2c608e17d81d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:29.568246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78046fe7-9e3f-47d2-b2b9-2c608e17d81d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:29.568528 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78046fe7-9e3f-47d2-b2b9-2c608e17d81d None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:29.569184 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78046fe7-9e3f-47d2-b2b9-2c608e17d81d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:29.569491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78046fe7-9e3f-47d2-b2b9-2c608e17d81d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:29.571020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78046fe7-9e3f-47d2-b2b9-2c608e17d81d None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:29.584527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 352/672] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:29.584527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78046fe7-9e3f-47d2-b2b9-2c608e17d81d None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:29.657321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7c028-c333-4ff2-baa9-da524a853b71 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:29.683946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:29.688624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78046fe7-9e3f-47d2-b2b9-2c608e17d81d None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:29.690864 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e02b61-9c29-42c6-a7fb-3042e5efe6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:29.694260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e02b61-9c29-42c6-a7fb-3042e5efe6bd None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:29.694260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e02b61-9c29-42c6-a7fb-3042e5efe6bd None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:29.694260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e02b61-9c29-42c6-a7fb-3042e5efe6bd None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:29.694260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e02b61-9c29-42c6-a7fb-3042e5efe6bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:29.694260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e02b61-9c29-42c6-a7fb-3042e5efe6bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:29.694825 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e02b61-9c29-42c6-a7fb-3042e5efe6bd None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:29.707980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 321/673] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:29.708855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e02b61-9c29-42c6-a7fb-3042e5efe6bd None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:29.728396 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836f39-3b50-46f1-a8f1-40003a3a6180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:29.729009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836f39-3b50-46f1-a8f1-40003a3a6180 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:29.729289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836f39-3b50-46f1-a8f1-40003a3a6180 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:29.729561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836f39-3b50-46f1-a8f1-40003a3a6180 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:29.730201 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf836f39-3b50-46f1-a8f1-40003a3a6180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:29.730508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf836f39-3b50-46f1-a8f1-40003a3a6180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:29.731956 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf836f39-3b50-46f1-a8f1-40003a3a6180 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:29.743704 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 353/674] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:29.744567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836f39-3b50-46f1-a8f1-40003a3a6180 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:29.766217 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:29.826330 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e02b61-9c29-42c6-a7fb-3042e5efe6bd None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:29.863356 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400166d-e76d-4c98-a635-f872b6caccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:29.864035 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400166d-e76d-4c98-a635-f872b6caccfe None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:29.864264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400166d-e76d-4c98-a635-f872b6caccfe None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:29.864598 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400166d-e76d-4c98-a635-f872b6caccfe None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:29.865195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400166d-e76d-4c98-a635-f872b6caccfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:29.865500 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400166d-e76d-4c98-a635-f872b6caccfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:29.865975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836f39-3b50-46f1-a8f1-40003a3a6180 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:29.866885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400166d-e76d-4c98-a635-f872b6caccfe None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:29.879494 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 322/675] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:29.880782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372384fe-e0cb-451b-8794-53004cf38330 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:29.881070 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372384fe-e0cb-451b-8794-53004cf38330 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:29.881345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372384fe-e0cb-451b-8794-53004cf38330 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:29.884251 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 323/676] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:29.884251 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372384fe-e0cb-451b-8794-53004cf38330 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:29.912417 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81fbbb-e89f-4937-9637-314606afa31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:29.913065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81fbbb-e89f-4937-9637-314606afa31d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:29.913347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81fbbb-e89f-4937-9637-314606afa31d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:29.913621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81fbbb-e89f-4937-9637-314606afa31d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:29.922252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81fbbb-e89f-4937-9637-314606afa31d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:29.923715 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81fbbb-e89f-4937-9637-314606afa31d None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:29.936793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-7d81fbbb-e89f-4937-9637-314606afa31d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:29.936793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:29.936793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:29.936793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:29.936793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:29.936793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:29.936793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:29.936793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:29.936793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:29.936793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:29.936793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:29.936793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:29.936793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:29.936793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:29.936793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:29.937750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:29.938603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:29.938603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:29.938603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:29.938603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:29.938603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:29.938603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:29.938603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:29.938603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:29.938603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 354/677] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:29.939074 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81fbbb-e89f-4937-9637-314606afa31d None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:29.962108 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:30.018608 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372384fe-e0cb-451b-8794-53004cf38330 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:30.032273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:30.056491 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba177b3-7fb5-4b61-bfde-fd906f0b0c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:30.057224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba177b3-7fb5-4b61-bfde-fd906f0b0c1b None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:30.057511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba177b3-7fb5-4b61-bfde-fd906f0b0c1b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:30.057790 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba177b3-7fb5-4b61-bfde-fd906f0b0c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:30.058534 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba177b3-7fb5-4b61-bfde-fd906f0b0c1b None admin] RBAC: Adding query filter params (role.id=14efd2033a754e9b9143349f4994e356, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=0be09bd9ba7443aaa31879f56ca4aad1) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:30.058846 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba177b3-7fb5-4b61-bfde-fd906f0b0c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:30.061271 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba177b3-7fb5-4b61-bfde-fd906f0b0c1b None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:30.068016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 324/678] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:29 2022] GET /identity/v3/role_assignments?user.id=0be09bd9ba7443aaa31879f56ca4aad1&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=14efd2033a754e9b9143349f4994e356 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:30.069004 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba177b3-7fb5-4b61-bfde-fd906f0b0c1b None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:30.074225 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81fbbb-e89f-4937-9637-314606afa31d None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:30.119223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af728613-d1e2-41ac-b11c-440905c520a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:30.120037 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af728613-d1e2-41ac-b11c-440905c520a5 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:30.120155 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af728613-d1e2-41ac-b11c-440905c520a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:30.120444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af728613-d1e2-41ac-b11c-440905c520a5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:30.131001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af728613-d1e2-41ac-b11c-440905c520a5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:30.132447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af728613-d1e2-41ac-b11c-440905c520a5 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-af728613-d1e2-41ac-b11c-440905c520a5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:30.146172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:30.147212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:30.148151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:30.148151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:30.148151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:30.148151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:30.148151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:30.148151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:30.148151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:30.148151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:30.148151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:38:30.148151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:30.148151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 355/679] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:38:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:30.148802 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03948cfd-e261-42eb-93a0-d795bf2f9cda None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:30.149423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03948cfd-e261-42eb-93a0-d795bf2f9cda None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:30.149423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03948cfd-e261-42eb-93a0-d795bf2f9cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:30.170674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-03948cfd-e261-42eb-93a0-d795bf2f9cda None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:30.171864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-03948cfd-e261-42eb-93a0-d795bf2f9cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:30.213997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba177b3-7fb5-4b61-bfde-fd906f0b0c1b None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:30.253882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6805be-66e1-4e46-ae4e-876ffb96ebb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:30.254653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6805be-66e1-4e46-ae4e-876ffb96ebb7 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:30.254928 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6805be-66e1-4e46-ae4e-876ffb96ebb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:30.255205 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6805be-66e1-4e46-ae4e-876ffb96ebb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:30.266396 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6805be-66e1-4e46-ae4e-876ffb96ebb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:30.268544 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6805be-66e1-4e46-ae4e-876ffb96ebb7 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:30.274750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 356/680] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:30.274750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03948cfd-e261-42eb-93a0-d795bf2f9cda None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:30.284211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-7b6805be-66e1-4e46-ae4e-876ffb96ebb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:30.284211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:30.284211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:30.284211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:30.284211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:30.284211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:30.284211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:30.284211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:30.284211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:30.284211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:30.284211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:30.284211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:30.284211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:30.284211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:30.284211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:30.285345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:30.286310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:30.286310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:30.286310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:30.286310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:30.286310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:30.286310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:30.286310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:30.286310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:30.286310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 325/681] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:30.286781 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6805be-66e1-4e46-ae4e-876ffb96ebb7 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:30.292259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:30.335454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:30.429109 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03948cfd-e261-42eb-93a0-d795bf2f9cda None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:30.454195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6805be-66e1-4e46-ae4e-876ffb96ebb7 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:30.477188 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa579dd-4d57-43d9-ba77-f61098b49433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:30.478237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa579dd-4d57-43d9-ba77-f61098b49433 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:30.478738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa579dd-4d57-43d9-ba77-f61098b49433 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:30.479350 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa579dd-4d57-43d9-ba77-f61098b49433 None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:30.480317 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa579dd-4d57-43d9-ba77-f61098b49433 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:30.480867 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa579dd-4d57-43d9-ba77-f61098b49433 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:30.483341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa579dd-4d57-43d9-ba77-f61098b49433 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:30.498918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe329f0-c049-4e23-8804-429fd67cc624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:30.499589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe329f0-c049-4e23-8804-429fd67cc624 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:30.499827 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe329f0-c049-4e23-8804-429fd67cc624 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:30.500248 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe329f0-c049-4e23-8804-429fd67cc624 None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:30.500462 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 357/682] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:30.501605 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa579dd-4d57-43d9-ba77-f61098b49433 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:30.505260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe329f0-c049-4e23-8804-429fd67cc624 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:30.505582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe329f0-c049-4e23-8804-429fd67cc624 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:30.507337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe329f0-c049-4e23-8804-429fd67cc624 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:30.532322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 326/683] 10.222.0.72 () {56 vars in 1135 bytes} [Mon Aug 29 22:38:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:30.533147 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe329f0-c049-4e23-8804-429fd67cc624 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:30.585446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:30.628356 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa579dd-4d57-43d9-ba77-f61098b49433 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:30.648358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:30.656296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe329f0-c049-4e23-8804-429fd67cc624 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:30.675107 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f934e-b8a1-45dd-aca5-cee3987644da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:30.675734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f934e-b8a1-45dd-aca5-cee3987644da None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:30.676013 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f934e-b8a1-45dd-aca5-cee3987644da None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:30.676316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f934e-b8a1-45dd-aca5-cee3987644da None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:30.677040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f934e-b8a1-45dd-aca5-cee3987644da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:30.677343 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f934e-b8a1-45dd-aca5-cee3987644da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:30.679757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f934e-b8a1-45dd-aca5-cee3987644da None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:30.694081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f36df-3297-4dcc-af4d-bd8913073ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:30.694746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 358/684] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:30.695419 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f934e-b8a1-45dd-aca5-cee3987644da None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:30.699528 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f36df-3297-4dcc-af4d-bd8913073ba6 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:30.699862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f36df-3297-4dcc-af4d-bd8913073ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:30.700834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f36df-3297-4dcc-af4d-bd8913073ba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:30.701915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f36df-3297-4dcc-af4d-bd8913073ba6 None admin] RBAC: Adding query filter params (role.id=14efd2033a754e9b9143349f4994e356, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=e187bd54667a46c4a234d4aff23e1777) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:30.702235 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f36df-3297-4dcc-af4d-bd8913073ba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:30.703689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f36df-3297-4dcc-af4d-bd8913073ba6 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:30.720226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 327/685] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:30 2022] GET /identity/v3/role_assignments?user.id=e187bd54667a46c4a234d4aff23e1777&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=14efd2033a754e9b9143349f4994e356 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:30.720226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f36df-3297-4dcc-af4d-bd8913073ba6 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:30.850707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f934e-b8a1-45dd-aca5-cee3987644da None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:30.862646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f36df-3297-4dcc-af4d-bd8913073ba6 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:30.893426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:30.903796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b222c-0d34-4256-87de-295b798329a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:30.905251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b222c-0d34-4256-87de-295b798329a2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:30.905612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b222c-0d34-4256-87de-295b798329a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:30.909564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b222c-0d34-4256-87de-295b798329a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:30.935047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489995c-a348-4b49-b95a-aa25498f6f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:30.935705 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489995c-a348-4b49-b95a-aa25498f6f73 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:30.935982 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489995c-a348-4b49-b95a-aa25498f6f73 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:30.936377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489995c-a348-4b49-b95a-aa25498f6f73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:30.949489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489995c-a348-4b49-b95a-aa25498f6f73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:30.951828 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489995c-a348-4b49-b95a-aa25498f6f73 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-0489995c-a348-4b49-b95a-aa25498f6f73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:30.971093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:30.972107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:30.973080 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:30.973080 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:30.973080 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:30.975389 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 328/686] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:30.976035 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489995c-a348-4b49-b95a-aa25498f6f73 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:30.994611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:31.022656 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b222c-0d34-4256-87de-295b798329a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:31.025067 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b222c-0d34-4256-87de-295b798329a2 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:31.123377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489995c-a348-4b49-b95a-aa25498f6f73 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:31.168616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 359/687] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:31.170045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b222c-0d34-4256-87de-295b798329a2 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:31.179564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a91215-458a-4590-92e2-27bb71bd9df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:31.180642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a91215-458a-4590-92e2-27bb71bd9df8 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:31.181102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a91215-458a-4590-92e2-27bb71bd9df8 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:31.181563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a91215-458a-4590-92e2-27bb71bd9df8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:31.182781 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a91215-458a-4590-92e2-27bb71bd9df8 None admin] RBAC: Adding query filter params (role.id=14efd2033a754e9b9143349f4994e356, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=380c6683b4ab4d08a6cf377e620439e8) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:31.183329 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a91215-458a-4590-92e2-27bb71bd9df8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:31.186422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a91215-458a-4590-92e2-27bb71bd9df8 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:31.194322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 329/688] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:30 2022] GET /identity/v3/role_assignments?user.id=380c6683b4ab4d08a6cf377e620439e8&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=14efd2033a754e9b9143349f4994e356 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:31.195181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a91215-458a-4590-92e2-27bb71bd9df8 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:31.212132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:31.368246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:31.368818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b222c-0d34-4256-87de-295b798329a2 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:31.414791 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a91215-458a-4590-92e2-27bb71bd9df8 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:31.422359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892715bd-8d6c-400a-8605-a834038b1404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:31.423796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892715bd-8d6c-400a-8605-a834038b1404 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:31.424453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892715bd-8d6c-400a-8605-a834038b1404 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:31.424949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892715bd-8d6c-400a-8605-a834038b1404 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:31.426056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892715bd-8d6c-400a-8605-a834038b1404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:31.426570 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892715bd-8d6c-400a-8605-a834038b1404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:31.429126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892715bd-8d6c-400a-8605-a834038b1404 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:31.443789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 360/689] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:31.451219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892715bd-8d6c-400a-8605-a834038b1404 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:31.482586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304593e-0884-4f42-a390-ea8580f37612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:31.483686 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304593e-0884-4f42-a390-ea8580f37612 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:31.484178 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304593e-0884-4f42-a390-ea8580f37612 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:31.484695 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304593e-0884-4f42-a390-ea8580f37612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:31.497658 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304593e-0884-4f42-a390-ea8580f37612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:31.499654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304593e-0884-4f42-a390-ea8580f37612 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-0304593e-0884-4f42-a390-ea8580f37612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:31.516687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:31.517706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:31.518614 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:31.518614 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:31.518614 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:31.520802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 330/690] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:31.526998 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304593e-0884-4f42-a390-ea8580f37612 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:31.609443 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:31.628534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892715bd-8d6c-400a-8605-a834038b1404 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:31.707412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d622e1-0770-4072-ae5c-5a781a023304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:31.708410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d622e1-0770-4072-ae5c-5a781a023304 None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:31.708919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d622e1-0770-4072-ae5c-5a781a023304 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:31.710330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d622e1-0770-4072-ae5c-5a781a023304 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:31.711210 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d622e1-0770-4072-ae5c-5a781a023304 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:31.714299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d622e1-0770-4072-ae5c-5a781a023304 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:31.738568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304593e-0884-4f42-a390-ea8580f37612 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:31.769191 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:31.780871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe91fa-41b0-451e-b3c3-0a81a746d369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:31.781864 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe91fa-41b0-451e-b3c3-0a81a746d369 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:31.782371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe91fa-41b0-451e-b3c3-0a81a746d369 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:31.782843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe91fa-41b0-451e-b3c3-0a81a746d369 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:31.783706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe91fa-41b0-451e-b3c3-0a81a746d369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:31.784314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe91fa-41b0-451e-b3c3-0a81a746d369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:31.786068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe91fa-41b0-451e-b3c3-0a81a746d369 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:31.801017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 331/691] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:31.807526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe91fa-41b0-451e-b3c3-0a81a746d369 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:31.823621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 361/692] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:38:31 2022] POST /identity/v3/users => generated 254 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:38:31.945425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe91fa-41b0-451e-b3c3-0a81a746d369 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:31.988005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc86266-96ad-4a17-9b9b-6f1d8d7b53f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:31.988699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc86266-96ad-4a17-9b9b-6f1d8d7b53f5 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:31.989003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc86266-96ad-4a17-9b9b-6f1d8d7b53f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:31.989325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc86266-96ad-4a17-9b9b-6f1d8d7b53f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:32.005611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc86266-96ad-4a17-9b9b-6f1d8d7b53f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:32.007107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc86266-96ad-4a17-9b9b-6f1d8d7b53f5 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:32.024239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-0bc86266-96ad-4a17-9b9b-6f1d8d7b53f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:32.024239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:32.024239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:32.024239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:32.024239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:32.024239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:32.024239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:32.024239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:32.024239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:32.024239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:32.024239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:32.024239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:32.024239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:32.024239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:32.024239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:32.025209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:32.026530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:32.026530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:32.026530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:32.026530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:32.026530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:32.026530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:32.026530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:32.026530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:32.026530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 332/693] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:32.034388 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d622e1-0770-4072-ae5c-5a781a023304 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:32.163114 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d622e1-0770-4072-ae5c-5a781a023304 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:32.200742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8daac-b820-4468-a0f2-038f5418d3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:32.201593 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8daac-b820-4468-a0f2-038f5418d3db None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:32.201756 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8daac-b820-4468-a0f2-038f5418d3db None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:32.201991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8daac-b820-4468-a0f2-038f5418d3db None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:32.202713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8daac-b820-4468-a0f2-038f5418d3db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:32.203017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8daac-b820-4468-a0f2-038f5418d3db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:32.204490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8daac-b820-4468-a0f2-038f5418d3db None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:32.218624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 362/694] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:32.225151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc86266-96ad-4a17-9b9b-6f1d8d7b53f5 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:32.293294 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:32.372006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc86266-96ad-4a17-9b9b-6f1d8d7b53f5 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:32.412775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977478e-ad31-46f9-a8a0-c29ea60d8544 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:32.413102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977478e-ad31-46f9-a8a0-c29ea60d8544 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:32.413328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977478e-ad31-46f9-a8a0-c29ea60d8544 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:32.414968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 363/695] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:32.423344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c4613-70b0-416e-9f13-01abc3b53937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:32.423597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915b7d-5de0-4344-be90-d658ef3f4ee4 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:32.423873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915b7d-5de0-4344-be90-d658ef3f4ee4 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:32.424065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915b7d-5de0-4344-be90-d658ef3f4ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:32.424900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c4613-70b0-416e-9f13-01abc3b53937 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:32.425736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c4613-70b0-416e-9f13-01abc3b53937 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:32.425736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c4613-70b0-416e-9f13-01abc3b53937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:32.426373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c4613-70b0-416e-9f13-01abc3b53937 None admin] RBAC: Adding query filter params (role.id=14efd2033a754e9b9143349f4994e356, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=94511ad9ee7a4ab0b70d8d5098079886) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:32.426686 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c4613-70b0-416e-9f13-01abc3b53937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:32.428217 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c4613-70b0-416e-9f13-01abc3b53937 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:32.440115 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:32.440357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 333/696] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:32 2022] GET /identity/v3/role_assignments?user.id=94511ad9ee7a4ab0b70d8d5098079886&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=14efd2033a754e9b9143349f4994e356 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:32.457969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f7915b7d-5de0-4344-be90-d658ef3f4ee4 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:32.459193 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f7915b7d-5de0-4344-be90-d658ef3f4ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:32.562478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 364/697] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:32.916808 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c4613-70b0-416e-9f13-01abc3b53937 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:33.046777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c4613-70b0-416e-9f13-01abc3b53937 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:33.058767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:33.089374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605cb45-4fd7-46cd-ad51-76ae172e37e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:33.090022 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605cb45-4fd7-46cd-ad51-76ae172e37e1 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:33.090308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605cb45-4fd7-46cd-ad51-76ae172e37e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:33.091241 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605cb45-4fd7-46cd-ad51-76ae172e37e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:33.108839 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605cb45-4fd7-46cd-ad51-76ae172e37e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-5605cb45-4fd7-46cd-ad51-76ae172e37e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:33.114224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:33.116540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:33.118804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:33.118804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:33.118804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:33.118804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:33.118804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:33.118804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:33.118804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:33.118804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:33.118804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:33.118804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:33.118804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:38:33.118804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:33.118804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 334/698] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:38:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:33.132257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605cb45-4fd7-46cd-ad51-76ae172e37e1 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:33.132550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9943c75-8873-43aa-b868-ba7c154fceb0 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:33.132550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9943c75-8873-43aa-b868-ba7c154fceb0 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:33.132550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9943c75-8873-43aa-b868-ba7c154fceb0 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:33.133075 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 365/699] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:33 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:33.139679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc0bab-4504-4b65-9d35-c131890c5102 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:33.140216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc0bab-4504-4b65-9d35-c131890c5102 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:33.140500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc0bab-4504-4b65-9d35-c131890c5102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:33.181276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-eadc0bab-4504-4b65-9d35-c131890c5102 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:33.187048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-eadc0bab-4504-4b65-9d35-c131890c5102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:33.308255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 366/700] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:38:33.367414 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605cb45-4fd7-46cd-ad51-76ae172e37e1 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:33.433243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20c3d4-faa9-43ba-927f-8843396de01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:33.433872 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20c3d4-faa9-43ba-927f-8843396de01e None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:33.434108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20c3d4-faa9-43ba-927f-8843396de01e None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:33.434379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20c3d4-faa9-43ba-927f-8843396de01e None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:33.435130 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20c3d4-faa9-43ba-927f-8843396de01e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:33.435440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20c3d4-faa9-43ba-927f-8843396de01e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:33.436884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20c3d4-faa9-43ba-927f-8843396de01e None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:33.447396 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 335/701] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:38:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:33.453602 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc0bab-4504-4b65-9d35-c131890c5102 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:33.561312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:33.616613 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc0bab-4504-4b65-9d35-c131890c5102 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:33.664957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef38fc8-884d-4a5d-82d2-789a76c5f527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:33.665975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef38fc8-884d-4a5d-82d2-789a76c5f527 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:33.666450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef38fc8-884d-4a5d-82d2-789a76c5f527 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:33.666912 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef38fc8-884d-4a5d-82d2-789a76c5f527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:33.681595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef38fc8-884d-4a5d-82d2-789a76c5f527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:33.683472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef38fc8-884d-4a5d-82d2-789a76c5f527 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-7ef38fc8-884d-4a5d-82d2-789a76c5f527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:33.705269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:33.706319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:33.707201 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:33.707201 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:33.707201 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:33.715244 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 367/702] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:33.717958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20c3d4-faa9-43ba-927f-8843396de01e None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:33.757943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef38fc8-884d-4a5d-82d2-789a76c5f527 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:33.774484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:33.899222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef38fc8-884d-4a5d-82d2-789a76c5f527 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:33.908078 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20c3d4-faa9-43ba-927f-8843396de01e None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:33.922959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:33.951374 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587826a-bd78-4031-8d69-477807aac221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:33.951853 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6728143-f22a-4131-9d7e-adc3949f4cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:33.952630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6728143-f22a-4131-9d7e-adc3949f4cf2 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:33.952934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6728143-f22a-4131-9d7e-adc3949f4cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:33.953255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587826a-bd78-4031-8d69-477807aac221 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:33.953359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6728143-f22a-4131-9d7e-adc3949f4cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:33.953806 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587826a-bd78-4031-8d69-477807aac221 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:33.954102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6728143-f22a-4131-9d7e-adc3949f4cf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:33.954436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587826a-bd78-4031-8d69-477807aac221 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:33.954537 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6728143-f22a-4131-9d7e-adc3949f4cf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:33.955326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587826a-bd78-4031-8d69-477807aac221 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:33.955974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6728143-f22a-4131-9d7e-adc3949f4cf2 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:33.957082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587826a-bd78-4031-8d69-477807aac221 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:33.975349 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 336/703] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:33.975349 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861575a1-7dcb-492e-af21-f1b1d52b5f8b None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:33.975349 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861575a1-7dcb-492e-af21-f1b1d52b5f8b None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:33.975349 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861575a1-7dcb-492e-af21-f1b1d52b5f8b None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:33.978340 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 337/704] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-9587826a-bd78-4031-8d69-477807aac221 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:33.978769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:33.979721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:33.980586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:33.980586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:33.980586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:33.980586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:33.980586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:33.980586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:33.980586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:33.980586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:33.980586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:33.980586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:33.980586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:38:33.980586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:33.980586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:38:33.980586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:33.981376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f70d65-7bc6-4b14-bf29-cf2ee00ed0da None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:33.981376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f70d65-7bc6-4b14-bf29-cf2ee00ed0da None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:33.981376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f70d65-7bc6-4b14-bf29-cf2ee00ed0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:33.984370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 368/705] 10.222.0.72 () {56 vars in 1129 bytes} [Mon Aug 29 22:38:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:33.985611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587826a-bd78-4031-8d69-477807aac221 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:34.000887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-41f70d65-7bc6-4b14-bf29-cf2ee00ed0da None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:34.002199 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-41f70d65-7bc6-4b14-bf29-cf2ee00ed0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:34.096578 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 338/706] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:38:34.097673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f70d65-7bc6-4b14-bf29-cf2ee00ed0da None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:34.122106 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587826a-bd78-4031-8d69-477807aac221 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:34.158946 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:34.165619 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264502e4-1cb8-4d1f-a941-81c88b124193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:34.167042 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264502e4-1cb8-4d1f-a941-81c88b124193 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:34.167042 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264502e4-1cb8-4d1f-a941-81c88b124193 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:34.167551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264502e4-1cb8-4d1f-a941-81c88b124193 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:34.177506 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264502e4-1cb8-4d1f-a941-81c88b124193 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:34.180166 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264502e4-1cb8-4d1f-a941-81c88b124193 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-264502e4-1cb8-4d1f-a941-81c88b124193 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:34.194785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:34.195778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:34.196747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:34.196747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:34.196747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:34.196747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:34.196747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:34.196747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:34.196747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:34.196747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:34.196747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:38:34.196747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:34.204384 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 369/707] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Aug 29 22:38:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:34.206514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264502e4-1cb8-4d1f-a941-81c88b124193 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:34.254103 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:34.318251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264502e4-1cb8-4d1f-a941-81c88b124193 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:34.356609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fe372-bf32-405c-8e31-1364ded26b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:34.357590 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe372-bf32-405c-8e31-1364ded26b50 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:34.358068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe372-bf32-405c-8e31-1364ded26b50 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:34.358563 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe372-bf32-405c-8e31-1364ded26b50 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:34.359543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fe372-bf32-405c-8e31-1364ded26b50 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:34.360097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fe372-bf32-405c-8e31-1364ded26b50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:34.362509 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fe372-bf32-405c-8e31-1364ded26b50 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:34.388329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 370/708] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Aug 29 22:38:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:34.390655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fe372-bf32-405c-8e31-1364ded26b50 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:34.469689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f70d65-7bc6-4b14-bf29-cf2ee00ed0da None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:34.504547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fe372-bf32-405c-8e31-1364ded26b50 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:34.508074 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:34.544147 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984d615-b3f2-48be-a53e-bc78992ba84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:34.545361 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984d615-b3f2-48be-a53e-bc78992ba84b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:34.545958 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984d615-b3f2-48be-a53e-bc78992ba84b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:34.546439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984d615-b3f2-48be-a53e-bc78992ba84b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:34.568596 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbc4da-1359-4bf0-b249-8f5d570d17f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:34.570725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbc4da-1359-4bf0-b249-8f5d570d17f3 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:34.572095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbc4da-1359-4bf0-b249-8f5d570d17f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:34.572616 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbc4da-1359-4bf0-b249-8f5d570d17f3 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:34.575712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbc4da-1359-4bf0-b249-8f5d570d17f3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:34.576717 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbc4da-1359-4bf0-b249-8f5d570d17f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:34.578131 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbc4da-1359-4bf0-b249-8f5d570d17f3 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:34.588257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 339/709] 10.222.0.72 () {56 vars in 1124 bytes} [Mon Aug 29 22:38:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:34.588257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b47fb-3390-45f6-be08-977ad5268451 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:34.588257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b47fb-3390-45f6-be08-977ad5268451 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:34.588257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b47fb-3390-45f6-be08-977ad5268451 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:34.588257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 340/710] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:34.594765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbb31d-0cca-4244-95a9-04e7100a48b9 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:34.595042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbb31d-0cca-4244-95a9-04e7100a48b9 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:34.595311 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbb31d-0cca-4244-95a9-04e7100a48b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:34.618728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-aebbb31d-0cca-4244-95a9-04e7100a48b9 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:34.619932 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-aebbb31d-0cca-4244-95a9-04e7100a48b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:34.650308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984d615-b3f2-48be-a53e-bc78992ba84b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:34.651915 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984d615-b3f2-48be-a53e-bc78992ba84b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:34.720307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 341/711] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:34.720307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbb31d-0cca-4244-95a9-04e7100a48b9 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:34.763237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:34.806303 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:34.811714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 371/712] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:34.818380 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984d615-b3f2-48be-a53e-bc78992ba84b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:34.888091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbb31d-0cca-4244-95a9-04e7100a48b9 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:34.931612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984d615-b3f2-48be-a53e-bc78992ba84b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:34.932676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a0fc9-0fe8-4bcd-a054-1d856579ea6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:34.933470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a0fc9-0fe8-4bcd-a054-1d856579ea6a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:34.933969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a0fc9-0fe8-4bcd-a054-1d856579ea6a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:34.934309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a0fc9-0fe8-4bcd-a054-1d856579ea6a None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:34.935090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a0fc9-0fe8-4bcd-a054-1d856579ea6a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:34.935458 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a0fc9-0fe8-4bcd-a054-1d856579ea6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:34.936935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a0fc9-0fe8-4bcd-a054-1d856579ea6a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:34.943718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 342/713] 10.222.0.72 () {56 vars in 1124 bytes} [Mon Aug 29 22:38:34 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:34.944673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a0fc9-0fe8-4bcd-a054-1d856579ea6a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:35.034194 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3d3d7-e720-428f-a99d-222a24179f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:35.035269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3d3d7-e720-428f-a99d-222a24179f05 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:35.037686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3d3d7-e720-428f-a99d-222a24179f05 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:35.038190 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3d3d7-e720-428f-a99d-222a24179f05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:35.059797 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3d3d7-e720-428f-a99d-222a24179f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:35.062054 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3d3d7-e720-428f-a99d-222a24179f05 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-7ac3d3d7-e720-428f-a99d-222a24179f05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:35.084360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:35.085370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:35.092017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:35.092017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:35.092017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:35.092017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 372/714] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:35.092017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3d3d7-e720-428f-a99d-222a24179f05 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:35.121369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:35.146699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a0fc9-0fe8-4bcd-a054-1d856579ea6a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:35.165324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:35.185931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be5dea-68be-4a2c-ac3a-6cf433215c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:35.186649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be5dea-68be-4a2c-ac3a-6cf433215c77 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:35.186867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be5dea-68be-4a2c-ac3a-6cf433215c77 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:35.187152 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be5dea-68be-4a2c-ac3a-6cf433215c77 None admin] PATH_INFO: `/v3/services/network` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:35.187730 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be5dea-68be-4a2c-ac3a-6cf433215c77 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:35.189219 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be5dea-68be-4a2c-ac3a-6cf433215c77 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-d3be5dea-68be-4a2c-ac3a-6cf433215c77 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:35.202773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:35.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:35.205410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:35.205410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:35.205410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:35.205410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:35.205410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:35.205410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:35.205410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:35.205410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:35.205410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:35.205410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:35.205410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:38:35.205410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:35.205410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:38:35.205410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:35.205410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 343/715] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:34 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:35.206270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be5dea-68be-4a2c-ac3a-6cf433215c77 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:35.229697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3d3d7-e720-428f-a99d-222a24179f05 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:35.269130 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc3b27-7dab-41b9-afd4-904208a5efe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:35.270318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc3b27-7dab-41b9-afd4-904208a5efe2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:35.271088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc3b27-7dab-41b9-afd4-904208a5efe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:35.271807 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc3b27-7dab-41b9-afd4-904208a5efe2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:35.284966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc3b27-7dab-41b9-afd4-904208a5efe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-64cc3b27-7dab-41b9-afd4-904208a5efe2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:35.290243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:35.291251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:35.292070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:35.292070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:35.292070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:35.292070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:35.292070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:35.292070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:35.292070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:35.292070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:35.292070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:35.292070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:35.292070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:35.292070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:35.292070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 373/716] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:35.294343 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc3b27-7dab-41b9-afd4-904208a5efe2 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:35.322695 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be5dea-68be-4a2c-ac3a-6cf433215c77 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:35.362976 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f741030-4575-4409-9809-2e91cd85f080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:35.363678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f741030-4575-4409-9809-2e91cd85f080 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:35.363961 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f741030-4575-4409-9809-2e91cd85f080 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:35.364260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f741030-4575-4409-9809-2e91cd85f080 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:35.365142 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f741030-4575-4409-9809-2e91cd85f080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:35.365452 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f741030-4575-4409-9809-2e91cd85f080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:35.366845 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f741030-4575-4409-9809-2e91cd85f080 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:35.385193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 344/717] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:35.385193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa3ec3-d4fa-46f7-927b-ef1a7a27cff2 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:35.385193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa3ec3-d4fa-46f7-927b-ef1a7a27cff2 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:35.385193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa3ec3-d4fa-46f7-927b-ef1a7a27cff2 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:35.385193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 345/718] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:35.385193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa3ec3-d4fa-46f7-927b-ef1a7a27cff2 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:35.388929 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:35.416098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc3b27-7dab-41b9-afd4-904208a5efe2 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:35.429766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:35.462184 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbcce5-3530-4503-92fb-628bab4bdf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:35.463253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbcce5-3530-4503-92fb-628bab4bdf77 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:35.463990 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbcce5-3530-4503-92fb-628bab4bdf77 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:35.464693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbcce5-3530-4503-92fb-628bab4bdf77 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:35.466115 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbcce5-3530-4503-92fb-628bab4bdf77 None admin] RBAC: Adding query filter params (name=network) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:35.466631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbcce5-3530-4503-92fb-628bab4bdf77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:35.468439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbcce5-3530-4503-92fb-628bab4bdf77 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:35.480056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 374/719] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Aug 29 22:38:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:35.480056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbcce5-3530-4503-92fb-628bab4bdf77 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:35.510402 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa3ec3-d4fa-46f7-927b-ef1a7a27cff2 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:35.550937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d5616-93c0-4a12-b5f8-dae3116aa105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:35.551590 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5616-93c0-4a12-b5f8-dae3116aa105 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:35.551874 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5616-93c0-4a12-b5f8-dae3116aa105 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:35.552149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5616-93c0-4a12-b5f8-dae3116aa105 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:35.552852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d5616-93c0-4a12-b5f8-dae3116aa105 None admin] RBAC: Adding query filter params (name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:35.553178 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d5616-93c0-4a12-b5f8-dae3116aa105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:35.554634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d5616-93c0-4a12-b5f8-dae3116aa105 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:35.568923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 346/720] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:35.568923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e25f92-8437-4ece-9031-9e343ddf1860 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:35.568923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e25f92-8437-4ece-9031-9e343ddf1860 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:35.568923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e25f92-8437-4ece-9031-9e343ddf1860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:35.586153 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-f5e25f92-8437-4ece-9031-9e343ddf1860 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:35.587360 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f5e25f92-8437-4ece-9031-9e343ddf1860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:35.595401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbcce5-3530-4503-92fb-628bab4bdf77 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:35.633551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695302ae-ec9b-4095-9913-2d7a5f79858e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:35.634372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695302ae-ec9b-4095-9913-2d7a5f79858e None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:35.634504 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695302ae-ec9b-4095-9913-2d7a5f79858e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:35.634727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695302ae-ec9b-4095-9913-2d7a5f79858e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:35.642014 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695302ae-ec9b-4095-9913-2d7a5f79858e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:35.643673 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695302ae-ec9b-4095-9913-2d7a5f79858e None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:35.657960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:35.658148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-695302ae-ec9b-4095-9913-2d7a5f79858e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:35.658148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:35.658148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:35.658148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:35.658148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:35.658148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:35.658148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:35.658148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:35.658148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:35.658148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:35.658148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:35.658148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:35.658148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:35.658148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:35.658148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:35.658988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:35.659909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:35.659909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:35.659909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:35.659909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:35.659909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:35.659909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:35.659909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:35.659909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:35.659909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 375/721] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:35.660427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695302ae-ec9b-4095-9913-2d7a5f79858e None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:35.677434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 347/722] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:35.677434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e25f92-8437-4ece-9031-9e343ddf1860 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:35.716550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:35.783227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695302ae-ec9b-4095-9913-2d7a5f79858e None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:35.806559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e25f92-8437-4ece-9031-9e343ddf1860 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:35.821475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47b84b-9995-43ff-b90a-840cbdcbf03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:35.822229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47b84b-9995-43ff-b90a-840cbdcbf03f None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:35.822514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47b84b-9995-43ff-b90a-840cbdcbf03f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:35.822792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47b84b-9995-43ff-b90a-840cbdcbf03f None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:35.823431 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47b84b-9995-43ff-b90a-840cbdcbf03f None admin] RBAC: Adding query filter params (type=network) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:35.823736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47b84b-9995-43ff-b90a-840cbdcbf03f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:35.825700 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47b84b-9995-43ff-b90a-840cbdcbf03f None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:35.832228 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 376/723] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Aug 29 22:38:35 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:35.833076 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47b84b-9995-43ff-b90a-840cbdcbf03f None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:35.853426 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0461da-bc86-42d5-8b3c-23e7a4755b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:35.854499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0461da-bc86-42d5-8b3c-23e7a4755b1a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:35.854781 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0461da-bc86-42d5-8b3c-23e7a4755b1a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:35.855336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0461da-bc86-42d5-8b3c-23e7a4755b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:35.870151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0461da-bc86-42d5-8b3c-23e7a4755b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:35.872859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0461da-bc86-42d5-8b3c-23e7a4755b1a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-cd0461da-bc86-42d5-8b3c-23e7a4755b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:35.894603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:35.895777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:35.897030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:35.897030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:35.897030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:35.897030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 348/724] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:35.905418 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0461da-bc86-42d5-8b3c-23e7a4755b1a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:36.006245 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:36.013913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47b84b-9995-43ff-b90a-840cbdcbf03f None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:36.017576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:36.070478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bfa40-d4eb-4ecb-8e34-d1e23a57f945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:36.071816 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bfa40-d4eb-4ecb-8e34-d1e23a57f945 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:36.072280 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bfa40-d4eb-4ecb-8e34-d1e23a57f945 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:36.072567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bfa40-d4eb-4ecb-8e34-d1e23a57f945 None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:36.073293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bfa40-d4eb-4ecb-8e34-d1e23a57f945 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:36.088307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bfa40-d4eb-4ecb-8e34-d1e23a57f945 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:36.088307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bfa40-d4eb-4ecb-8e34-d1e23a57f945 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:36.093902 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 377/725] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:36.094781 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bfa40-d4eb-4ecb-8e34-d1e23a57f945 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:36.108720 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0461da-bc86-42d5-8b3c-23e7a4755b1a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:36.149815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d83c75-f078-46dc-b98a-a3e55d01910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:36.150441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d83c75-f078-46dc-b98a-a3e55d01910d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:36.150725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d83c75-f078-46dc-b98a-a3e55d01910d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:36.151005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d83c75-f078-46dc-b98a-a3e55d01910d None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:36.151783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d83c75-f078-46dc-b98a-a3e55d01910d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:36.152093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d83c75-f078-46dc-b98a-a3e55d01910d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:36.153755 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d83c75-f078-46dc-b98a-a3e55d01910d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:36.167463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 349/726] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:36.168976 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d83c75-f078-46dc-b98a-a3e55d01910d None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:36.254484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bfa40-d4eb-4ecb-8e34-d1e23a57f945 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:36.303602 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d83c75-f078-46dc-b98a-a3e55d01910d None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:36.304557 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a8d7b-5d62-46d2-b969-9d16f1781fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:36.305316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a8d7b-5d62-46d2-b969-9d16f1781fd3 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:36.305894 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a8d7b-5d62-46d2-b969-9d16f1781fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:36.306175 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a8d7b-5d62-46d2-b969-9d16f1781fd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:36.316647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:36.320289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a8d7b-5d62-46d2-b969-9d16f1781fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-828a8d7b-5d62-46d2-b969-9d16f1781fd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:36.331157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:36.332101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:36.332969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:36.332969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:36.332969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:36.332969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:36.332969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:36.332969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:36.332969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:36.332969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:36.332969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:36.332969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:36.332969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:38:36.332969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:36.332969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 378/727] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:38:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:36.332969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a8d7b-5d62-46d2-b969-9d16f1781fd3 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:36.349018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972f921-5cc6-4e1a-bee5-c1b0d516fbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:36.349838 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972f921-5cc6-4e1a-bee5-c1b0d516fbba None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:36.350114 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972f921-5cc6-4e1a-bee5-c1b0d516fbba None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:36.350811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:36.351442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972f921-5cc6-4e1a-bee5-c1b0d516fbba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:36.352184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972f921-5cc6-4e1a-bee5-c1b0d516fbba None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=0be09bd9ba7443aaa31879f56ca4aad1) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:36.352507 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972f921-5cc6-4e1a-bee5-c1b0d516fbba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:36.353947 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972f921-5cc6-4e1a-bee5-c1b0d516fbba None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:36.363247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 350/728] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:36 2022] GET /identity/v3/role_assignments?user.id=0be09bd9ba7443aaa31879f56ca4aad1&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:36.369076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972f921-5cc6-4e1a-bee5-c1b0d516fbba None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:36.538085 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a8d7b-5d62-46d2-b969-9d16f1781fd3 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:36.564999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972f921-5cc6-4e1a-bee5-c1b0d516fbba None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:36.582127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780698c-b453-445a-977e-9556fa3299fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:36.582684 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780698c-b453-445a-977e-9556fa3299fa None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:36.582964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780698c-b453-445a-977e-9556fa3299fa None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:36.583235 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780698c-b453-445a-977e-9556fa3299fa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:36.592472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780698c-b453-445a-977e-9556fa3299fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:36.593996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780698c-b453-445a-977e-9556fa3299fa None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-8780698c-b453-445a-977e-9556fa3299fa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:36.613511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:36.614501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:36.615433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:36.615433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:36.615433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:36.615433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:36.615433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:36.615433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:36.615433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:36.615433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:36.615433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:38:36.615433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:36.615955 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2182d-64a2-4d3f-af90-16784f663a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:36.616047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2182d-64a2-4d3f-af90-16784f663a02 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:36.617273 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 379/729] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Aug 29 22:38:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:36.620738 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2182d-64a2-4d3f-af90-16784f663a02 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:36.621065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2182d-64a2-4d3f-af90-16784f663a02 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:36.623366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2182d-64a2-4d3f-af90-16784f663a02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:36.623910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2182d-64a2-4d3f-af90-16784f663a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:36.625566 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2182d-64a2-4d3f-af90-16784f663a02 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:36.629257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780698c-b453-445a-977e-9556fa3299fa None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:36.643282 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 351/730] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:38:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:36.647625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2182d-64a2-4d3f-af90-16784f663a02 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:36.736584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:36.778344 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:36.797983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780698c-b453-445a-977e-9556fa3299fa None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:36.838534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d7014-af66-4172-bcb2-ac9cfc0ae766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:36.839081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d7014-af66-4172-bcb2-ac9cfc0ae766 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:36.839360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d7014-af66-4172-bcb2-ac9cfc0ae766 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:36.839630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d7014-af66-4172-bcb2-ac9cfc0ae766 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:36.841104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d7014-af66-4172-bcb2-ac9cfc0ae766 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:36.841414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d7014-af66-4172-bcb2-ac9cfc0ae766 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:36.843044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d7014-af66-4172-bcb2-ac9cfc0ae766 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:36.866117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 380/731] 10.222.0.72 () {56 vars in 1149 bytes} [Mon Aug 29 22:38:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:36.872371 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d7014-af66-4172-bcb2-ac9cfc0ae766 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:36.942075 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2182d-64a2-4d3f-af90-16784f663a02 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:36.998351 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d7014-af66-4172-bcb2-ac9cfc0ae766 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:37.012626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06d78e-e8d6-4a77-b90d-5e4e2e2eddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:37.013483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06d78e-e8d6-4a77-b90d-5e4e2e2eddbd None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:37.013774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06d78e-e8d6-4a77-b90d-5e4e2e2eddbd None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:37.014051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06d78e-e8d6-4a77-b90d-5e4e2e2eddbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:37.030084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06d78e-e8d6-4a77-b90d-5e4e2e2eddbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:37.031563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06d78e-e8d6-4a77-b90d-5e4e2e2eddbd None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-cc06d78e-e8d6-4a77-b90d-5e4e2e2eddbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:37.048685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:37.049668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:37.050987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:37.050987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:37.050987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:37.050987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 352/732] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:37.053110 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd49c6-64d4-4da1-a63d-1adef7b8c639 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:37.053110 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd49c6-64d4-4da1-a63d-1adef7b8c639 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:37.053110 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd49c6-64d4-4da1-a63d-1adef7b8c639 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:37.053377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8218aa4-13ec-408f-9e54-e1fc60e4018e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:37.054345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8218aa4-13ec-408f-9e54-e1fc60e4018e None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:37.054803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8218aa4-13ec-408f-9e54-e1fc60e4018e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:37.055297 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8218aa4-13ec-408f-9e54-e1fc60e4018e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:37.058144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 353/733] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:37.058773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd49c6-64d4-4da1-a63d-1adef7b8c639 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:37.062265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:37.166588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8218aa4-13ec-408f-9e54-e1fc60e4018e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:37.169375 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8218aa4-13ec-408f-9e54-e1fc60e4018e None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:37.180137 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:37.203089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd49c6-64d4-4da1-a63d-1adef7b8c639 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:37.261317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461c279-9665-446e-9598-9188c0e4efef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:37.261317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461c279-9665-446e-9598-9188c0e4efef None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:37.261317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461c279-9665-446e-9598-9188c0e4efef None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:37.261317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461c279-9665-446e-9598-9188c0e4efef None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:37.261796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461c279-9665-446e-9598-9188c0e4efef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:37.261796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461c279-9665-446e-9598-9188c0e4efef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:37.261796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461c279-9665-446e-9598-9188c0e4efef None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:37.280437 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 354/734] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:37.284481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887e147-e11f-4457-afdc-a885975a4da5 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:37.285011 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887e147-e11f-4457-afdc-a885975a4da5 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:37.285520 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887e147-e11f-4457-afdc-a885975a4da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:37.308053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-c887e147-e11f-4457-afdc-a885975a4da5 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:37.310053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c887e147-e11f-4457-afdc-a885975a4da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:37.315029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 381/735] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:37.315934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8218aa4-13ec-408f-9e54-e1fc60e4018e None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:37.366319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:37.413240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 355/736] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:37.414604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887e147-e11f-4457-afdc-a885975a4da5 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:37.517905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:37.518578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8218aa4-13ec-408f-9e54-e1fc60e4018e None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:37.547942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887e147-e11f-4457-afdc-a885975a4da5 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:37.591622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bec124-0816-4a4a-be08-8078f2ca44bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:37.593170 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bec124-0816-4a4a-be08-8078f2ca44bd None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:37.593644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bec124-0816-4a4a-be08-8078f2ca44bd None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:37.594357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bec124-0816-4a4a-be08-8078f2ca44bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:37.610828 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bec124-0816-4a4a-be08-8078f2ca44bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:37.611777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31679b06-698b-4e31-929e-c50080a9b10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:37.612590 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31679b06-698b-4e31-929e-c50080a9b10a None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:37.612984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31679b06-698b-4e31-929e-c50080a9b10a None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:37.613358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31679b06-698b-4e31-929e-c50080a9b10a None admin] PATH_INFO: `/v3/users/swift` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:37.613587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bec124-0816-4a4a-be08-8078f2ca44bd None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-17bec124-0816-4a4a-be08-8078f2ca44bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:37.632267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:37.633342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:37.634253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:37.634253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:37.634253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:37.634426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31679b06-698b-4e31-929e-c50080a9b10a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:37.635607 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31679b06-698b-4e31-929e-c50080a9b10a None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:37.636729 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 356/737] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:37.642332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bec124-0816-4a4a-be08-8078f2ca44bd None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-31679b06-698b-4e31-929e-c50080a9b10a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:37.661860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:37.662858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:37.663783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:37.663783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:37.663783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:37.663783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:37.663783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:37.663783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:37.663783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:37.663783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:37.663783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:38:37.663783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:37.668724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 382/738] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:38:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:37.672895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31679b06-698b-4e31-929e-c50080a9b10a None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:37.826487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bec124-0816-4a4a-be08-8078f2ca44bd None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:37.869196 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:37.878573 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31679b06-698b-4e31-929e-c50080a9b10a None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:37.891363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:37.910210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfdf39-3e90-47eb-acd2-a4a7d31734da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:37.911776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfdf39-3e90-47eb-acd2-a4a7d31734da None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:37.912270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfdf39-3e90-47eb-acd2-a4a7d31734da None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:37.912732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfdf39-3e90-47eb-acd2-a4a7d31734da None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:37.913820 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfdf39-3e90-47eb-acd2-a4a7d31734da None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:37.914327 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfdf39-3e90-47eb-acd2-a4a7d31734da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:37.917018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfdf39-3e90-47eb-acd2-a4a7d31734da None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:37.941565 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59edba-de1a-4248-b5c9-680d62e68f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:37.943022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59edba-de1a-4248-b5c9-680d62e68f4b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:37.943724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59edba-de1a-4248-b5c9-680d62e68f4b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:37.944527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59edba-de1a-4248-b5c9-680d62e68f4b None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:37.952002 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 357/739] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:37.952002 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfdf39-3e90-47eb-acd2-a4a7d31734da None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:37.952729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59edba-de1a-4248-b5c9-680d62e68f4b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:37.952729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59edba-de1a-4248-b5c9-680d62e68f4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:37.952729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59edba-de1a-4248-b5c9-680d62e68f4b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:37.986163 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 383/740] 10.222.0.72 () {56 vars in 1135 bytes} [Mon Aug 29 22:38:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:37.987139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59edba-de1a-4248-b5c9-680d62e68f4b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:38.095442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfdf39-3e90-47eb-acd2-a4a7d31734da None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:38.108848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59edba-de1a-4248-b5c9-680d62e68f4b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:38.137652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b211f-d39e-494d-9e8f-47a1d489c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:38.138684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b211f-d39e-494d-9e8f-47a1d489c823 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:38.139162 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b211f-d39e-494d-9e8f-47a1d489c823 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:38.139816 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b211f-d39e-494d-9e8f-47a1d489c823 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:38.140920 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b211f-d39e-494d-9e8f-47a1d489c823 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:38.142516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b211f-d39e-494d-9e8f-47a1d489c823 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:38.153775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9d620-acef-446f-9cfa-d04dc6738aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:38.154546 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9d620-acef-446f-9cfa-d04dc6738aa2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:38.154831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9d620-acef-446f-9cfa-d04dc6738aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:38.155104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9d620-acef-446f-9cfa-d04dc6738aa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:38.162923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9d620-acef-446f-9cfa-d04dc6738aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:38.164397 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9d620-acef-446f-9cfa-d04dc6738aa2 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:38.175895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-22d9d620-acef-446f-9cfa-d04dc6738aa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:38.175895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:38.175895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:38.175895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:38.175895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:38.175895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:38.175895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:38.175895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:38.175895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:38.175895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:38.175895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:38.175895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:38.175895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:38.175895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:38.175895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:38.177040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:38.177942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:38.177942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:38.177942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:38.177942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:38.177942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:38.177942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:38.177942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:38.177942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:38.177942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 384/741] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:38.177942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9d620-acef-446f-9cfa-d04dc6738aa2 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:38.194776 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:38.229054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 358/742] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Aug 29 22:38:37 2022] POST /identity/v3/services => generated 251 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:38:38.230755 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258582a-4b93-40b1-83a1-0fa3c20bccd4 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:38.231351 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258582a-4b93-40b1-83a1-0fa3c20bccd4 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:38.231929 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258582a-4b93-40b1-83a1-0fa3c20bccd4 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:38.233937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 359/743] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:38.235126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258582a-4b93-40b1-83a1-0fa3c20bccd4 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:38.320709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:38.328778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9d620-acef-446f-9cfa-d04dc6738aa2 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:38.388339 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258582a-4b93-40b1-83a1-0fa3c20bccd4 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:38.396525 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca3e24-fc81-4463-8a65-35fcfd37cf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:38.397165 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca3e24-fc81-4463-8a65-35fcfd37cf7b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:38.397446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca3e24-fc81-4463-8a65-35fcfd37cf7b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:38.397722 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca3e24-fc81-4463-8a65-35fcfd37cf7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:38.445823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109143f-bb4b-47c9-8932-3e9f1339fc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:38.446644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109143f-bb4b-47c9-8932-3e9f1339fc1b None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:38.446925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109143f-bb4b-47c9-8932-3e9f1339fc1b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:38.447202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109143f-bb4b-47c9-8932-3e9f1339fc1b None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:38.453546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109143f-bb4b-47c9-8932-3e9f1339fc1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:38.453546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109143f-bb4b-47c9-8932-3e9f1339fc1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:38.453546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109143f-bb4b-47c9-8932-3e9f1339fc1b None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:38.462980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 360/744] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:38.465831 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9ba42-3244-4872-99ea-94fd4f697f6e None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:38.466733 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9ba42-3244-4872-99ea-94fd4f697f6e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:38.467046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9ba42-3244-4872-99ea-94fd4f697f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:38.487306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-15d9ba42-3244-4872-99ea-94fd4f697f6e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:38.488647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-15d9ba42-3244-4872-99ea-94fd4f697f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:38.499286 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca3e24-fc81-4463-8a65-35fcfd37cf7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:38.500790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca3e24-fc81-4463-8a65-35fcfd37cf7b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:38.514411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:38.567314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 361/745] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:38.569296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040de6-056f-4cd5-869f-5f7a6599eed7 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:38.569584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040de6-056f-4cd5-869f-5f7a6599eed7 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:38.569859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040de6-056f-4cd5-869f-5f7a6599eed7 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:38.571372 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 362/746] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:38.571898 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be040de6-056f-4cd5-869f-5f7a6599eed7 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:38.619952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 385/747] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:38 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:38.622046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442c215-d545-4b00-86dd-bcb97557bb65 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:38.622559 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442c215-d545-4b00-86dd-bcb97557bb65 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:38.623036 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442c215-d545-4b00-86dd-bcb97557bb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:38.627437 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:38.643038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f442c215-d545-4b00-86dd-bcb97557bb65 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:38.644610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f442c215-d545-4b00-86dd-bcb97557bb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:38.691526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be040de6-056f-4cd5-869f-5f7a6599eed7 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:38.719238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 386/748] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:38:38.720546 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442c215-d545-4b00-86dd-bcb97557bb65 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:38.729765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b174-a0ff-42a7-be79-9282137a39b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:38.730790 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b174-a0ff-42a7-be79-9282137a39b0 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:38.731467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b174-a0ff-42a7-be79-9282137a39b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:38.731738 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b174-a0ff-42a7-be79-9282137a39b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:38.732580 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4b174-a0ff-42a7-be79-9282137a39b0 None admin] RBAC: Adding query filter params (role.id=14efd2033a754e9b9143349f4994e356, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=e7b1650890fe409091ddbc881ee28973) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:38.732943 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4b174-a0ff-42a7-be79-9282137a39b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:38.734744 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4b174-a0ff-42a7-be79-9282137a39b0 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:38.741196 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 363/749] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:38 2022] GET /identity/v3/role_assignments?user.id=e7b1650890fe409091ddbc881ee28973&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=14efd2033a754e9b9143349f4994e356 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:38.774027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:38.850077 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442c215-d545-4b00-86dd-bcb97557bb65 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:38.892227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b174-a0ff-42a7-be79-9282137a39b0 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:38.899512 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376385c-6ccb-4f18-bede-8eab315b8227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:38.900664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376385c-6ccb-4f18-bede-8eab315b8227 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:38.901165 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376385c-6ccb-4f18-bede-8eab315b8227 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:38.901696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376385c-6ccb-4f18-bede-8eab315b8227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:38.914749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376385c-6ccb-4f18-bede-8eab315b8227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:38.917749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376385c-6ccb-4f18-bede-8eab315b8227 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-6376385c-6ccb-4f18-bede-8eab315b8227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:38.939477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:38.940913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:38.942238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:38.942238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:38.942238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:38.944230 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 387/750] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:38.951084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376385c-6ccb-4f18-bede-8eab315b8227 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:39.072301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:39.077600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:39.085157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b174-a0ff-42a7-be79-9282137a39b0 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:39.086889 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376385c-6ccb-4f18-bede-8eab315b8227 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:39.133665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060c0ca-86dd-4308-9067-f3bdf62d15ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:39.134289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060c0ca-86dd-4308-9067-f3bdf62d15ba None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:39.134572 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060c0ca-86dd-4308-9067-f3bdf62d15ba None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:39.134850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060c0ca-86dd-4308-9067-f3bdf62d15ba None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:39.135922 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060c0ca-86dd-4308-9067-f3bdf62d15ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:39.137361 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060c0ca-86dd-4308-9067-f3bdf62d15ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:39.138748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060c0ca-86dd-4308-9067-f3bdf62d15ba None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:39.141105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6760df-35cb-4700-bc63-ffbf137d693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:39.142586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6760df-35cb-4700-bc63-ffbf137d693f None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:39.143097 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6760df-35cb-4700-bc63-ffbf137d693f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:39.143586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6760df-35cb-4700-bc63-ffbf137d693f None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:39.144558 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6760df-35cb-4700-bc63-ffbf137d693f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:39.146451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6760df-35cb-4700-bc63-ffbf137d693f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:39.155516 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 388/751] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:39.156727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060c0ca-86dd-4308-9067-f3bdf62d15ba None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:39.220634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 364/752] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Aug 29 22:38:38 2022] POST /identity/v3/services => generated 240 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:38:39.222000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6760df-35cb-4700-bc63-ffbf137d693f None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:39.342897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060c0ca-86dd-4308-9067-f3bdf62d15ba None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:39.375419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6760df-35cb-4700-bc63-ffbf137d693f None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:39.426652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad63b0-2d08-4e69-9ce4-a2de0b1c98d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:39.427383 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad63b0-2d08-4e69-9ce4-a2de0b1c98d8 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:39.427743 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad63b0-2d08-4e69-9ce4-a2de0b1c98d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:39.428035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad63b0-2d08-4e69-9ce4-a2de0b1c98d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:39.433258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfced1b-374c-47d0-addc-0d63bf9a17bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:39.434866 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfced1b-374c-47d0-addc-0d63bf9a17bd None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:39.435147 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfced1b-374c-47d0-addc-0d63bf9a17bd None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:39.435418 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfced1b-374c-47d0-addc-0d63bf9a17bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:39.441083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad63b0-2d08-4e69-9ce4-a2de0b1c98d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:39.444243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfced1b-374c-47d0-addc-0d63bf9a17bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:39.445772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfced1b-374c-47d0-addc-0d63bf9a17bd None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-a2ad63b0-2d08-4e69-9ce4-a2de0b1c98d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:39.448717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:39.450434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:39.452939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:39.452939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:39.452939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:39.452939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:39.452939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:39.452939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:39.452939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:39.452939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:39.452939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:39.452939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:39.452939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:38:39.452939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:39.452939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 389/753] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:38:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:39.460268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad63b0-2d08-4e69-9ce4-a2de0b1c98d8 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:39.460479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-5cfced1b-374c-47d0-addc-0d63bf9a17bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:39.460479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:39.460479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:39.460479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:39.460479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:39.460479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:39.460479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:39.460479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:39.460479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:39.460479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:39.460479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:39.460479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:39.460479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:39.460479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:39.460479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:39.462102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:39.463824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:39.463824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:39.463824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:39.463824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:39.463824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:39.463824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:39.463824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:39.463824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:39.463824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 365/754] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:39.472176 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfced1b-374c-47d0-addc-0d63bf9a17bd None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:39.497712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:39.497956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:39.609909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfced1b-374c-47d0-addc-0d63bf9a17bd None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:39.651711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d091d-5426-4c09-88ae-b82009cc45e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:39.653094 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d091d-5426-4c09-88ae-b82009cc45e8 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:39.653094 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d091d-5426-4c09-88ae-b82009cc45e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:39.653660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d091d-5426-4c09-88ae-b82009cc45e8 None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:39.654058 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d091d-5426-4c09-88ae-b82009cc45e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:39.654359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d091d-5426-4c09-88ae-b82009cc45e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:39.656127 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d091d-5426-4c09-88ae-b82009cc45e8 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:39.673792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 366/755] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:39.676004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad63b0-2d08-4e69-9ce4-a2de0b1c98d8 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:39.679516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d091d-5426-4c09-88ae-b82009cc45e8 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:39.745217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f3872-2f18-4fd7-bea0-fb9e6ed5d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:39.747786 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f3872-2f18-4fd7-bea0-fb9e6ed5d842 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:39.748638 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f3872-2f18-4fd7-bea0-fb9e6ed5d842 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:39.749397 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f3872-2f18-4fd7-bea0-fb9e6ed5d842 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:39.751246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f3872-2f18-4fd7-bea0-fb9e6ed5d842 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:39.752095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f3872-2f18-4fd7-bea0-fb9e6ed5d842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:39.755435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f3872-2f18-4fd7-bea0-fb9e6ed5d842 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:39.769090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:39.780457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 390/756] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:38:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:39.787012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f3872-2f18-4fd7-bea0-fb9e6ed5d842 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:39.797344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d091d-5426-4c09-88ae-b82009cc45e8 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:39.865081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73759ac1-5b45-4510-bdfc-0d05c5adc848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:39.866253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759ac1-5b45-4510-bdfc-0d05c5adc848 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:39.866744 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759ac1-5b45-4510-bdfc-0d05c5adc848 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:39.867222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759ac1-5b45-4510-bdfc-0d05c5adc848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:39.868235 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73759ac1-5b45-4510-bdfc-0d05c5adc848 None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=94511ad9ee7a4ab0b70d8d5098079886) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:39.868808 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73759ac1-5b45-4510-bdfc-0d05c5adc848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:39.870472 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73759ac1-5b45-4510-bdfc-0d05c5adc848 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:39.878132 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 367/757] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:39 2022] GET /identity/v3/role_assignments?user.id=94511ad9ee7a4ab0b70d8d5098079886&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:39.924661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:39.952012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f3872-2f18-4fd7-bea0-fb9e6ed5d842 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:39.992495 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa01100-ad8d-4e07-aa96-6c332fd61f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:39.993557 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa01100-ad8d-4e07-aa96-6c332fd61f2d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:39.994056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa01100-ad8d-4e07-aa96-6c332fd61f2d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:39.994642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa01100-ad8d-4e07-aa96-6c332fd61f2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:40.008215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa01100-ad8d-4e07-aa96-6c332fd61f2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:40.009737 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa01100-ad8d-4e07-aa96-6c332fd61f2d None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-eaa01100-ad8d-4e07-aa96-6c332fd61f2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:40.032502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:40.033497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:40.034374 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:40.034374 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:40.034374 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:40.038807 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 391/758] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:40.040285 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73759ac1-5b45-4510-bdfc-0d05c5adc848 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:40.188349 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73759ac1-5b45-4510-bdfc-0d05c5adc848 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:40.260764 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dc029-1b60-4b56-b1a7-3c05c91c192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:40.261492 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dc029-1b60-4b56-b1a7-3c05c91c192d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:40.262389 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dc029-1b60-4b56-b1a7-3c05c91c192d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:40.262836 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dc029-1b60-4b56-b1a7-3c05c91c192d None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:40.263701 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dc029-1b60-4b56-b1a7-3c05c91c192d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:40.264010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dc029-1b60-4b56-b1a7-3c05c91c192d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:40.265444 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dc029-1b60-4b56-b1a7-3c05c91c192d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:40.273466 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:40.279751 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 368/759] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:40.285758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa01100-ad8d-4e07-aa96-6c332fd61f2d None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:40.460075 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa01100-ad8d-4e07-aa96-6c332fd61f2d None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:40.503530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:40.520365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782026b7-1e93-4b6d-a2c9-47d9d7e08347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:40.521393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782026b7-1e93-4b6d-a2c9-47d9d7e08347 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:40.521956 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782026b7-1e93-4b6d-a2c9-47d9d7e08347 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:40.522499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782026b7-1e93-4b6d-a2c9-47d9d7e08347 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:40.537658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782026b7-1e93-4b6d-a2c9-47d9d7e08347 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:40.539546 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782026b7-1e93-4b6d-a2c9-47d9d7e08347 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-782026b7-1e93-4b6d-a2c9-47d9d7e08347 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:40.555262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:40.556633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:40.557649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:40.557649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:40.557649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:40.557649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:40.557649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:40.557649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:40.557649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:40.557649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:40.557649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:38:40.557649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:40.566224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 392/760] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Aug 29 22:38:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:40.568074 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dc029-1b60-4b56-b1a7-3c05c91c192d None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:40.630916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e51dd-0cf5-4b42-80ed-244bcc892cbd None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:40.631264 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e51dd-0cf5-4b42-80ed-244bcc892cbd None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:40.631495 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e51dd-0cf5-4b42-80ed-244bcc892cbd None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:40.633177 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 393/761] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:38:40.639260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05820e-eecf-4931-8b9f-7680ec566a97 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:40.639676 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05820e-eecf-4931-8b9f-7680ec566a97 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:40.640140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05820e-eecf-4931-8b9f-7680ec566a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:40.674239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-dc05820e-eecf-4931-8b9f-7680ec566a97 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:40.676316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-dc05820e-eecf-4931-8b9f-7680ec566a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:40.716749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dc029-1b60-4b56-b1a7-3c05c91c192d None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:40.758355 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a21572-3978-430b-b828-904de5c0002a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:40.759380 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a21572-3978-430b-b828-904de5c0002a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:40.759865 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a21572-3978-430b-b828-904de5c0002a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:40.760376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a21572-3978-430b-b828-904de5c0002a None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:40.761320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a21572-3978-430b-b828-904de5c0002a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:40.761962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a21572-3978-430b-b828-904de5c0002a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:40.764247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a21572-3978-430b-b828-904de5c0002a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:40.788484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 369/762] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Aug 29 22:38:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:40.791892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a21572-3978-430b-b828-904de5c0002a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:40.804076 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 394/763] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:38:40.890580 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:40.952064 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a21572-3978-430b-b828-904de5c0002a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:41.000489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b147fe-471b-4a9b-a7b5-faef5cffd5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:41.001135 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b147fe-471b-4a9b-a7b5-faef5cffd5b6 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:41.001412 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b147fe-471b-4a9b-a7b5-faef5cffd5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:41.001686 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b147fe-471b-4a9b-a7b5-faef5cffd5b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:41.021451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b147fe-471b-4a9b-a7b5-faef5cffd5b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:41.024595 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b147fe-471b-4a9b-a7b5-faef5cffd5b6 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-02b147fe-471b-4a9b-a7b5-faef5cffd5b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:41.060882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:41.061855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:41.063192 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:41.063192 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:41.063192 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:41.063192 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 370/764] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:41.083975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05820e-eecf-4931-8b9f-7680ec566a97 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:41.151106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b147fe-471b-4a9b-a7b5-faef5cffd5b6 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:41.284230 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05820e-eecf-4931-8b9f-7680ec566a97 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:41.305074 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:41.348515 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c909b31-6c68-4f90-8e8e-14e8f72af43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:41.350514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c909b31-6c68-4f90-8e8e-14e8f72af43e None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:41.351714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c909b31-6c68-4f90-8e8e-14e8f72af43e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:41.352385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c909b31-6c68-4f90-8e8e-14e8f72af43e None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:41.354429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c909b31-6c68-4f90-8e8e-14e8f72af43e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:41.356270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c909b31-6c68-4f90-8e8e-14e8f72af43e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:41.358797 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c909b31-6c68-4f90-8e8e-14e8f72af43e None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:41.362656 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b147fe-471b-4a9b-a7b5-faef5cffd5b6 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:41.394960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 395/765] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:41.397082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c909b31-6c68-4f90-8e8e-14e8f72af43e None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:41.400544 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:41.462003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a2866-20f8-4037-9fa7-f491f1a66c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:41.462997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a2866-20f8-4037-9fa7-f491f1a66c2c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:41.463624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a2866-20f8-4037-9fa7-f491f1a66c2c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:41.466012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a2866-20f8-4037-9fa7-f491f1a66c2c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:41.466974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a2866-20f8-4037-9fa7-f491f1a66c2c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:41.468821 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a2866-20f8-4037-9fa7-f491f1a66c2c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-634a2866-20f8-4037-9fa7-f491f1a66c2c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:41.486659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:41.487693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:41.488625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:41.488625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:41.488625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:41.488625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:41.488625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:41.488625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:41.488625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:41.488625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:41.488625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:41.488625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:41.488625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:38:41.488625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:41.488625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:38:41.488625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:41.499019 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 371/766] 10.222.0.72 () {56 vars in 1129 bytes} [Mon Aug 29 22:38:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:41.500208 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a2866-20f8-4037-9fa7-f491f1a66c2c None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:41.604578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c909b31-6c68-4f90-8e8e-14e8f72af43e None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:41.648844 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1f83f-8b2c-494d-b022-1d7f7d0163f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:41.649741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1f83f-8b2c-494d-b022-1d7f7d0163f6 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:41.650194 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1f83f-8b2c-494d-b022-1d7f7d0163f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:41.650607 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1f83f-8b2c-494d-b022-1d7f7d0163f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:41.659490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1f83f-8b2c-494d-b022-1d7f7d0163f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:41.661199 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1f83f-8b2c-494d-b022-1d7f7d0163f6 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:41.679923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-c7e1f83f-8b2c-494d-b022-1d7f7d0163f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:41.679923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:41.679923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:41.679923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:41.679923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:41.679923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:41.679923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:41.679923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:41.679923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:41.679923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:41.679923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:41.679923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:41.679923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:41.679923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:41.679923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:41.681517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:41.682609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:41.682609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:41.682609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:41.682609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:41.682609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:41.682609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:41.682609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:41.682609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:41.690286 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 396/767] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:41.692131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1f83f-8b2c-494d-b022-1d7f7d0163f6 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:41.733364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a2866-20f8-4037-9fa7-f491f1a66c2c None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:41.758523 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:41.780356 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8520-4aef-4910-885d-029ecd5b68a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:41.781078 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8520-4aef-4910-885d-029ecd5b68a6 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:41.781425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8520-4aef-4910-885d-029ecd5b68a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:41.781770 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8520-4aef-4910-885d-029ecd5b68a6 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:41.782578 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8520-4aef-4910-885d-029ecd5b68a6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:41.782951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8520-4aef-4910-885d-029ecd5b68a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:41.784418 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8520-4aef-4910-885d-029ecd5b68a6 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:41.793543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 372/768] 10.222.0.72 () {56 vars in 1124 bytes} [Mon Aug 29 22:38:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:41.793543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b535d8-e89f-45f0-8aab-800a11b84dc3 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:41.793543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b535d8-e89f-45f0-8aab-800a11b84dc3 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:41.793543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b535d8-e89f-45f0-8aab-800a11b84dc3 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:41.797780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 373/769] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:41.799517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a1cb9-5ade-4f25-8c78-42c8570aab99 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:41.799803 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a1cb9-5ade-4f25-8c78-42c8570aab99 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:41.800079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a1cb9-5ade-4f25-8c78-42c8570aab99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:41.819125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-ff5a1cb9-5ade-4f25-8c78-42c8570aab99 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:41.820366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-ff5a1cb9-5ade-4f25-8c78-42c8570aab99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:41.854046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1f83f-8b2c-494d-b022-1d7f7d0163f6 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:41.855119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:41.892383 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed420d-703c-4a55-90c6-d800c8db7e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:41.893069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed420d-703c-4a55-90c6-d800c8db7e52 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:41.893675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed420d-703c-4a55-90c6-d800c8db7e52 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:41.893953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed420d-703c-4a55-90c6-d800c8db7e52 None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:41.894798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed420d-703c-4a55-90c6-d800c8db7e52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:41.895181 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed420d-703c-4a55-90c6-d800c8db7e52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:41.896696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed420d-703c-4a55-90c6-d800c8db7e52 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:41.898029 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 374/770] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:38:41.898800 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a1cb9-5ade-4f25-8c78-42c8570aab99 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:41.919602 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 397/771] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:41.921318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e40c93-f4fe-49df-a51b-a7b4eac1b605 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:41.921839 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e40c93-f4fe-49df-a51b-a7b4eac1b605 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:41.922309 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e40c93-f4fe-49df-a51b-a7b4eac1b605 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:41.928600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 398/772] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:41.929747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e40c93-f4fe-49df-a51b-a7b4eac1b605 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:42.025289 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a1cb9-5ade-4f25-8c78-42c8570aab99 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:42.062108 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:42.069411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e40c93-f4fe-49df-a51b-a7b4eac1b605 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:42.077100 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706fe9f-90bb-412d-8308-a2449a1d220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:42.078091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706fe9f-90bb-412d-8308-a2449a1d220f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:42.078717 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706fe9f-90bb-412d-8308-a2449a1d220f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:42.079694 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706fe9f-90bb-412d-8308-a2449a1d220f None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:42.080636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706fe9f-90bb-412d-8308-a2449a1d220f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:42.081529 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706fe9f-90bb-412d-8308-a2449a1d220f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:42.083610 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706fe9f-90bb-412d-8308-a2449a1d220f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:42.092262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 375/773] 10.222.0.72 () {56 vars in 1124 bytes} [Mon Aug 29 22:38:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:42.093792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf13f7-5132-4a9b-86b4-88cc71198686 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:42.094266 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf13f7-5132-4a9b-86b4-88cc71198686 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:42.094747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf13f7-5132-4a9b-86b4-88cc71198686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:42.117115 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4977fc2-5a93-4044-a7d9-34301fe6e13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:42.117873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4977fc2-5a93-4044-a7d9-34301fe6e13b None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:42.118228 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4977fc2-5a93-4044-a7d9-34301fe6e13b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:42.118577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4977fc2-5a93-4044-a7d9-34301fe6e13b None admin] PATH_INFO: `/v3/projects/7abc4d6c6e004b15abff7738164175db/users/0be09bd9ba7443aaa31879f56ca4aad1/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:42.120664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4977fc2-5a93-4044-a7d9-34301fe6e13b None admin] RBAC: Authorizing `identity:create_grant(project_id=7abc4d6c6e004b15abff7738164175db, user_id=0be09bd9ba7443aaa31879f56ca4aad1, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:42.121917 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-fcdf13f7-5132-4a9b-86b4-88cc71198686 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:42.122546 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4977fc2-5a93-4044-a7d9-34301fe6e13b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:42.123669 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-fcdf13f7-5132-4a9b-86b4-88cc71198686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:42.153551 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:42.200760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 399/774] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:38:41 2022] PUT /identity/v3/projects/7abc4d6c6e004b15abff7738164175db/users/0be09bd9ba7443aaa31879f56ca4aad1/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:38:42.202136 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4977fc2-5a93-4044-a7d9-34301fe6e13b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:42.216668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 376/775] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:38:42.217855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf13f7-5132-4a9b-86b4-88cc71198686 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:42.338242 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4977fc2-5a93-4044-a7d9-34301fe6e13b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:42.388094 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f43f3-78c9-4caf-b7ed-e68b332ebdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:42.391586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f43f3-78c9-4caf-b7ed-e68b332ebdd0 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:42.391586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f43f3-78c9-4caf-b7ed-e68b332ebdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:42.391586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f43f3-78c9-4caf-b7ed-e68b332ebdd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:42.391586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f43f3-78c9-4caf-b7ed-e68b332ebdd0 None admin] RBAC: Adding query filter params (interface=public, service_id=9bd987b5487143f58a4668c438bc956c, region_id=RegionOne) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:42.391586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f43f3-78c9-4caf-b7ed-e68b332ebdd0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:42.392125 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f43f3-78c9-4caf-b7ed-e68b332ebdd0 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:42.403044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 400/776] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Aug 29 22:38:42 2022] GET /identity/v3/endpoints?service_id=9bd987b5487143f58a4668c438bc956c&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:42.410363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f43f3-78c9-4caf-b7ed-e68b332ebdd0 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:42.410549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf13f7-5132-4a9b-86b4-88cc71198686 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:42.438389 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:42.455907 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f66ced-d7b8-4a9e-9698-5c2ca84efb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:42.456597 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f66ced-d7b8-4a9e-9698-5c2ca84efb29 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:42.456929 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f66ced-d7b8-4a9e-9698-5c2ca84efb29 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:42.457203 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f66ced-d7b8-4a9e-9698-5c2ca84efb29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:42.477187 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f66ced-d7b8-4a9e-9698-5c2ca84efb29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-d5f66ced-d7b8-4a9e-9698-5c2ca84efb29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:42.482776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:42.486960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:42.487887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:42.487887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:42.487887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:42.487887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:42.487887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:42.487887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:42.487887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:42.487887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:42.487887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:42.487887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:42.487887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:42.487887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:42.487887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 377/777] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:42.487887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1c2a8-8a44-4b41-8c44-5d9f4b306f9e None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:42.489697 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1c2a8-8a44-4b41-8c44-5d9f4b306f9e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:42.489697 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1c2a8-8a44-4b41-8c44-5d9f4b306f9e None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:42.489697 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 378/778] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:42.493959 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1c2a8-8a44-4b41-8c44-5d9f4b306f9e None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:42.525133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:42.541282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f43f3-78c9-4caf-b7ed-e68b332ebdd0 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:42.585205 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1b80c-fd77-4cd5-b262-f059b4965c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:42.586210 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1b80c-fd77-4cd5-b262-f059b4965c17 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:42.586708 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1b80c-fd77-4cd5-b262-f059b4965c17 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:42.587186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1b80c-fd77-4cd5-b262-f059b4965c17 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:42.588004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1b80c-fd77-4cd5-b262-f059b4965c17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:42.589617 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1b80c-fd77-4cd5-b262-f059b4965c17 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:42.596719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 401/779] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Aug 29 22:38:42 2022] GET /identity/v3/services => generated 772 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:42.598695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a232f1-597c-49c6-8d42-4e068a65b0dd None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:42.599268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a232f1-597c-49c6-8d42-4e068a65b0dd None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:42.599876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a232f1-597c-49c6-8d42-4e068a65b0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:42.622211 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f9a232f1-597c-49c6-8d42-4e068a65b0dd None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:42.624110 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f9a232f1-597c-49c6-8d42-4e068a65b0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:42.635154 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1c2a8-8a44-4b41-8c44-5d9f4b306f9e None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:42.680098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9390255-4672-431f-bd8c-f281caa36823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:42.681272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9390255-4672-431f-bd8c-f281caa36823 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:42.681957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9390255-4672-431f-bd8c-f281caa36823 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:42.682515 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9390255-4672-431f-bd8c-f281caa36823 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:42.683585 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9390255-4672-431f-bd8c-f281caa36823 None admin] RBAC: Adding query filter params (name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:42.684663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9390255-4672-431f-bd8c-f281caa36823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:42.686337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9390255-4672-431f-bd8c-f281caa36823 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:42.697889 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 379/780] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:42.700082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9390255-4672-431f-bd8c-f281caa36823 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:42.743791 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 402/781] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:38:42.745641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a232f1-597c-49c6-8d42-4e068a65b0dd None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:42.765359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:42.813108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:42.837766 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9390255-4672-431f-bd8c-f281caa36823 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:42.875642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a232f1-597c-49c6-8d42-4e068a65b0dd None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:42.884285 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587ba2f-428f-47a8-9c24-c1ab7e6cb6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:42.885095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587ba2f-428f-47a8-9c24-c1ab7e6cb6e1 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:42.885524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587ba2f-428f-47a8-9c24-c1ab7e6cb6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:42.885888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587ba2f-428f-47a8-9c24-c1ab7e6cb6e1 None admin] PATH_INFO: `/v3/services/network` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:42.887310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587ba2f-428f-47a8-9c24-c1ab7e6cb6e1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:42.888788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587ba2f-428f-47a8-9c24-c1ab7e6cb6e1 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-8587ba2f-428f-47a8-9c24-c1ab7e6cb6e1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:42.899062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:42.900183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:42.901020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:42.901020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:42.901020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:42.901020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:42.901020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:42.901020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:42.901020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:42.901020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:42.901020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:42.901020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:42.901020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:38:42.901020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:42.901020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:38:42.901020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:42.904331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 380/782] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:42 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:42.907279 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587ba2f-428f-47a8-9c24-c1ab7e6cb6e1 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:42.925590 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2d72d-983d-4106-89c1-032277818ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:42.926600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2d72d-983d-4106-89c1-032277818ea2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:42.927096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2d72d-983d-4106-89c1-032277818ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:42.927577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2d72d-983d-4106-89c1-032277818ea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:42.940900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2d72d-983d-4106-89c1-032277818ea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:42.942829 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2d72d-983d-4106-89c1-032277818ea2 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-c8d2d72d-983d-4106-89c1-032277818ea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:42.960800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:42.961799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:42.962760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:42.962760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:42.962760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:42.965553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 403/783] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:42.974340 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2d72d-983d-4106-89c1-032277818ea2 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:43.091356 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:43.098470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587ba2f-428f-47a8-9c24-c1ab7e6cb6e1 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:43.144984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2d72d-983d-4106-89c1-032277818ea2 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:43.156391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55acb9-ec06-4a92-9657-b4eafed90c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:43.157022 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55acb9-ec06-4a92-9657-b4eafed90c69 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:43.157307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55acb9-ec06-4a92-9657-b4eafed90c69 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:43.157588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55acb9-ec06-4a92-9657-b4eafed90c69 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:43.158240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55acb9-ec06-4a92-9657-b4eafed90c69 None admin] RBAC: Adding query filter params (name=network) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:43.158875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55acb9-ec06-4a92-9657-b4eafed90c69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:43.160572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55acb9-ec06-4a92-9657-b4eafed90c69 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:43.172335 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 381/784] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Aug 29 22:38:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:43.174788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55acb9-ec06-4a92-9657-b4eafed90c69 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:43.190153 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaac665-bfa2-41a4-a077-ab393eda4358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:43.191010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaac665-bfa2-41a4-a077-ab393eda4358 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:43.191010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaac665-bfa2-41a4-a077-ab393eda4358 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:43.191294 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaac665-bfa2-41a4-a077-ab393eda4358 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:43.191943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaac665-bfa2-41a4-a077-ab393eda4358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:43.192285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaac665-bfa2-41a4-a077-ab393eda4358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:43.193576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:43.193760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaac665-bfa2-41a4-a077-ab393eda4358 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:43.207248 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 404/785] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:43.208179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaac665-bfa2-41a4-a077-ab393eda4358 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:43.322969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55acb9-ec06-4a92-9657-b4eafed90c69 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:43.329288 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaac665-bfa2-41a4-a077-ab393eda4358 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:43.365682 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:43.376081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a255c9-2713-456a-98e2-7736fbe3c5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:43.376468 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5c34-9db0-4b98-8413-5a493b1a9e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:43.376969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a255c9-2713-456a-98e2-7736fbe3c5ca None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:43.381924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a255c9-2713-456a-98e2-7736fbe3c5ca None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:43.382041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5c34-9db0-4b98-8413-5a493b1a9e9b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:43.382120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a255c9-2713-456a-98e2-7736fbe3c5ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:43.382208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5c34-9db0-4b98-8413-5a493b1a9e9b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:43.382208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5c34-9db0-4b98-8413-5a493b1a9e9b None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:43.382208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5c34-9db0-4b98-8413-5a493b1a9e9b None admin] RBAC: Adding query filter params (type=network) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:43.382208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5c34-9db0-4b98-8413-5a493b1a9e9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:43.382208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5c34-9db0-4b98-8413-5a493b1a9e9b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:43.387847 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 405/786] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Aug 29 22:38:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:43.391870 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a255c9-2713-456a-98e2-7736fbe3c5ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:43.395370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5c34-9db0-4b98-8413-5a493b1a9e9b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-98a255c9-2713-456a-98e2-7736fbe3c5ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:43.396257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:43.397354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:43.399050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:43.399050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:43.399050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:43.399050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:43.399050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:43.399050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:43.399050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:43.399050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:43.399050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:43.399050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:43.399050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:38:43.399050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:43.399050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 382/787] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:38:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:43.399050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a255c9-2713-456a-98e2-7736fbe3c5ca None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:43.504885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:43.523090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5c34-9db0-4b98-8413-5a493b1a9e9b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:43.555175 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a255c9-2713-456a-98e2-7736fbe3c5ca None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:43.571350 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77251c52-0e4f-4bed-b7c2-5152d46f5502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:43.572666 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251c52-0e4f-4bed-b7c2-5152d46f5502 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:43.573434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251c52-0e4f-4bed-b7c2-5152d46f5502 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:43.574100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251c52-0e4f-4bed-b7c2-5152d46f5502 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:43.585544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77251c52-0e4f-4bed-b7c2-5152d46f5502 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:43.587843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77251c52-0e4f-4bed-b7c2-5152d46f5502 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:43.593602 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb867a5-1109-4b1a-ab02-5c3f794048fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:43.594302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb867a5-1109-4b1a-ab02-5c3f794048fe None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:43.594705 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb867a5-1109-4b1a-ab02-5c3f794048fe None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:43.595076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb867a5-1109-4b1a-ab02-5c3f794048fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:43.595898 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb867a5-1109-4b1a-ab02-5c3f794048fe None admin] RBAC: Adding query filter params (interface=public, service_id=bdd9546004df40e592dff7c30617a861, region_id=RegionOne) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:43.596324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb867a5-1109-4b1a-ab02-5c3f794048fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:43.598098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb867a5-1109-4b1a-ab02-5c3f794048fe None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-77251c52-0e4f-4bed-b7c2-5152d46f5502 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:43.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:43.605236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:43.606186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:43.606186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:43.606186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:43.606186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:43.606186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:43.606186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:43.606186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:43.606186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:43.606186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:38:43.606186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:43.608669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 406/788] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Aug 29 22:38:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:43.609830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77251c52-0e4f-4bed-b7c2-5152d46f5502 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:43.613842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 383/789] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Aug 29 22:38:43 2022] GET /identity/v3/endpoints?service_id=bdd9546004df40e592dff7c30617a861&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:43.615258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb867a5-1109-4b1a-ab02-5c3f794048fe None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:43.692604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:43.737201 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb867a5-1109-4b1a-ab02-5c3f794048fe None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:43.756363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77251c52-0e4f-4bed-b7c2-5152d46f5502 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:43.780814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d52ee-9e6d-4992-ba38-90c6cc4bd9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:43.781736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d52ee-9e6d-4992-ba38-90c6cc4bd9c8 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:43.782145 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d52ee-9e6d-4992-ba38-90c6cc4bd9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:43.782623 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d52ee-9e6d-4992-ba38-90c6cc4bd9c8 None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:43.783470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d52ee-9e6d-4992-ba38-90c6cc4bd9c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:43.783911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d52ee-9e6d-4992-ba38-90c6cc4bd9c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:43.785915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d52ee-9e6d-4992-ba38-90c6cc4bd9c8 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:43.787607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:43.808016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cfeba-9d23-498c-ba02-7b4212e35439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:43.809681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cfeba-9d23-498c-ba02-7b4212e35439 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:43.810174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 384/790] 10.222.0.72 () {56 vars in 1149 bytes} [Mon Aug 29 22:38:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:43.810436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cfeba-9d23-498c-ba02-7b4212e35439 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:43.810975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cfeba-9d23-498c-ba02-7b4212e35439 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:43.811318 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d52ee-9e6d-4992-ba38-90c6cc4bd9c8 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:43.812320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cfeba-9d23-498c-ba02-7b4212e35439 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:43.812837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cfeba-9d23-498c-ba02-7b4212e35439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:43.815016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cfeba-9d23-498c-ba02-7b4212e35439 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:43.828845 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 407/791] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:38:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:43.830231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cfeba-9d23-498c-ba02-7b4212e35439 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:43.960393 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d52ee-9e6d-4992-ba38-90c6cc4bd9c8 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:44.015805 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636034e-6b36-4d40-a3d8-37f2330c427a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:44.016527 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636034e-6b36-4d40-a3d8-37f2330c427a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:44.016811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636034e-6b36-4d40-a3d8-37f2330c427a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:44.017083 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636034e-6b36-4d40-a3d8-37f2330c427a None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:44.017702 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636034e-6b36-4d40-a3d8-37f2330c427a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:44.019531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636034e-6b36-4d40-a3d8-37f2330c427a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:44.031776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 385/792] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Aug 29 22:38:43 2022] GET /identity/v3/services => generated 772 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:44.032629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636034e-6b36-4d40-a3d8-37f2330c427a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:44.125570 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cfeba-9d23-498c-ba02-7b4212e35439 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:44.159033 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:44.163015 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:44.229176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a424492-712a-4307-a184-bfae80fe9cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:44.229824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a424492-712a-4307-a184-bfae80fe9cf1 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:44.230101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a424492-712a-4307-a184-bfae80fe9cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:44.230913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a424492-712a-4307-a184-bfae80fe9cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:44.241985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636034e-6b36-4d40-a3d8-37f2330c427a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:44.247606 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a424492-712a-4307-a184-bfae80fe9cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:44.249172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a424492-712a-4307-a184-bfae80fe9cf1 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-8a424492-712a-4307-a184-bfae80fe9cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:44.266318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:44.267327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:44.268249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:44.268249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:44.268249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:44.268249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 408/793] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:44.273466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a424492-712a-4307-a184-bfae80fe9cf1 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:44.290932 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf3011-0758-4522-816b-6dd3115f9172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:44.292359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf3011-0758-4522-816b-6dd3115f9172 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:44.293400 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf3011-0758-4522-816b-6dd3115f9172 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:44.293833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf3011-0758-4522-816b-6dd3115f9172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:44.308161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf3011-0758-4522-816b-6dd3115f9172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:44.310083 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf3011-0758-4522-816b-6dd3115f9172 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-36bf3011-0758-4522-816b-6dd3115f9172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:44.331185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:44.332425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:44.334018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:44.334018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:44.334018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:44.336474 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 386/794] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:44.343065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf3011-0758-4522-816b-6dd3115f9172 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:44.451095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a424492-712a-4307-a184-bfae80fe9cf1 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:44.494061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf3011-0758-4522-816b-6dd3115f9172 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:44.498486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8ab32-3cc8-41b5-9dc7-d4457469b5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:44.499202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8ab32-3cc8-41b5-9dc7-d4457469b5a2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:44.499601 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8ab32-3cc8-41b5-9dc7-d4457469b5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:44.499960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8ab32-3cc8-41b5-9dc7-d4457469b5a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:44.500781 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8ab32-3cc8-41b5-9dc7-d4457469b5a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:44.501165 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8ab32-3cc8-41b5-9dc7-d4457469b5a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:44.503245 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8ab32-3cc8-41b5-9dc7-d4457469b5a2 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:44.505028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:44.520876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 409/795] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:44.522769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5dadb-3e60-49c0-ba97-fa8dd4e0009e None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:44.523253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5dadb-3e60-49c0-ba97-fa8dd4e0009e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:44.523707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5dadb-3e60-49c0-ba97-fa8dd4e0009e None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:44.529134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 410/796] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:44.531334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5dadb-3e60-49c0-ba97-fa8dd4e0009e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:44.544693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5565837-ef6b-46ba-a129-eb75701eb59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:44.545268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5565837-ef6b-46ba-a129-eb75701eb59a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:44.545528 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5565837-ef6b-46ba-a129-eb75701eb59a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:44.545800 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5565837-ef6b-46ba-a129-eb75701eb59a None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:44.546451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5565837-ef6b-46ba-a129-eb75701eb59a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:44.546749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5565837-ef6b-46ba-a129-eb75701eb59a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:44.549450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5565837-ef6b-46ba-a129-eb75701eb59a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:44.563052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:44.569491 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 387/797] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:44.571211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8dff8-73f1-4aab-9728-3f2a105a60b3 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:44.571651 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8dff8-73f1-4aab-9728-3f2a105a60b3 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:44.574690 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8dff8-73f1-4aab-9728-3f2a105a60b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:44.592706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-a1a8dff8-73f1-4aab-9728-3f2a105a60b3 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:44.595377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-a1a8dff8-73f1-4aab-9728-3f2a105a60b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:44.650591 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5dadb-3e60-49c0-ba97-fa8dd4e0009e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:44.676875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 388/798] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:38:44.678056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8dff8-73f1-4aab-9728-3f2a105a60b3 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:44.707609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0300d7b-baa9-4720-9b74-e5222af638d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:44.708452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0300d7b-baa9-4720-9b74-e5222af638d3 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:44.709217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0300d7b-baa9-4720-9b74-e5222af638d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:44.709217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0300d7b-baa9-4720-9b74-e5222af638d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:44.722753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0300d7b-baa9-4720-9b74-e5222af638d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:44.724391 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0300d7b-baa9-4720-9b74-e5222af638d3 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:44.741794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-a0300d7b-baa9-4720-9b74-e5222af638d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:44.741794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:44.741794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:44.741794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:44.741794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:44.741794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:44.741794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:44.741794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:44.741794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:44.741794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:44.741794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:44.741794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:44.741794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:44.741794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:44.741794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:44.742822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:44.743690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:44.743690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:44.743690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:44.743690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:44.743690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:44.743690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:44.743690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:44.743690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:44.753157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 411/799] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:44.765364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0300d7b-baa9-4720-9b74-e5222af638d3 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:44.800363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:44.805110 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8dff8-73f1-4aab-9728-3f2a105a60b3 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:44.843779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ede48-25db-4900-a31e-260938d571ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:44.844806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ede48-25db-4900-a31e-260938d571ad None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:44.845332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ede48-25db-4900-a31e-260938d571ad None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:44.845834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ede48-25db-4900-a31e-260938d571ad None admin] PATH_INFO: `/v3/users/swift` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:44.855898 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ede48-25db-4900-a31e-260938d571ad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:44.857823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ede48-25db-4900-a31e-260938d571ad None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-560ede48-25db-4900-a31e-260938d571ad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:44.872579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:44.873564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:44.874591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:44.874591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:44.874591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:44.874591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:44.874591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:44.874591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:44.874591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:44.874591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:44.874591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:38:44.874591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:44.877289 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 389/800] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:38:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:44.889535 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ede48-25db-4900-a31e-260938d571ad None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:44.953650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:44.977196 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0300d7b-baa9-4720-9b74-e5222af638d3 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:45.031182 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de0b73-8ce1-421e-857e-046b5ad3c6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:45.032258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de0b73-8ce1-421e-857e-046b5ad3c6cb None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:45.032541 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de0b73-8ce1-421e-857e-046b5ad3c6cb None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:45.032811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de0b73-8ce1-421e-857e-046b5ad3c6cb None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:45.036253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de0b73-8ce1-421e-857e-046b5ad3c6cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:45.036253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de0b73-8ce1-421e-857e-046b5ad3c6cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:45.036253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de0b73-8ce1-421e-857e-046b5ad3c6cb None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:45.056407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 412/801] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:45.058082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de0b73-8ce1-421e-857e-046b5ad3c6cb None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:45.099340 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ede48-25db-4900-a31e-260938d571ad None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:45.161962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f949a4-e900-454a-987b-2e60a1fe827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:45.162753 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f949a4-e900-454a-987b-2e60a1fe827d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:45.163220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f949a4-e900-454a-987b-2e60a1fe827d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:45.163502 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f949a4-e900-454a-987b-2e60a1fe827d None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:45.164652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f949a4-e900-454a-987b-2e60a1fe827d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:45.165155 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f949a4-e900-454a-987b-2e60a1fe827d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:45.168404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f949a4-e900-454a-987b-2e60a1fe827d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:45.190677 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 390/802] 10.222.0.72 () {56 vars in 1135 bytes} [Mon Aug 29 22:38:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:45.196750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0170c-58bc-45be-85ee-54c69df6da00 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:45.196750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0170c-58bc-45be-85ee-54c69df6da00 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:45.196988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0170c-58bc-45be-85ee-54c69df6da00 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:45.199565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 391/803] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:45.199774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0170c-58bc-45be-85ee-54c69df6da00 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:45.219333 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de0b73-8ce1-421e-857e-046b5ad3c6cb None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:45.226676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:45.282864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fdc59-a77c-4ffc-8f23-9510a863ec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:45.283961 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fdc59-a77c-4ffc-8f23-9510a863ec7b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:45.284507 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fdc59-a77c-4ffc-8f23-9510a863ec7b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:45.285005 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fdc59-a77c-4ffc-8f23-9510a863ec7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:45.304768 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fdc59-a77c-4ffc-8f23-9510a863ec7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-b80fdc59-a77c-4ffc-8f23-9510a863ec7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:45.316265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:45.317634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:45.318550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:45.318550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:45.318550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:45.318550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:45.318550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:45.318550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:45.318550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:45.318550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:45.318550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:45.318550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:45.318550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:38:45.318550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:45.318550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 413/804] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:38:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:45.319724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fdc59-a77c-4ffc-8f23-9510a863ec7b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:45.326977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:45.343579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0170c-58bc-45be-85ee-54c69df6da00 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:45.400997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2af5c-8ec8-4bf3-becb-855bf50ff389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:45.402404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2af5c-8ec8-4bf3-becb-855bf50ff389 None admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:45.403078 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2af5c-8ec8-4bf3-becb-855bf50ff389 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:45.403537 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2af5c-8ec8-4bf3-becb-855bf50ff389 None admin] PATH_INFO: `/v3/projects/7abc4d6c6e004b15abff7738164175db/users/e7b1650890fe409091ddbc881ee28973/roles/14efd2033a754e9b9143349f4994e356` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:45.431537 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2af5c-8ec8-4bf3-becb-855bf50ff389 None admin] RBAC: Authorizing `identity:create_grant(project_id=7abc4d6c6e004b15abff7738164175db, user_id=e7b1650890fe409091ddbc881ee28973, role_id=14efd2033a754e9b9143349f4994e356)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:45.433133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2af5c-8ec8-4bf3-becb-855bf50ff389 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:45.488858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fdc59-a77c-4ffc-8f23-9510a863ec7b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:45.519921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 392/805] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:38:45 2022] PUT /identity/v3/projects/7abc4d6c6e004b15abff7738164175db/users/e7b1650890fe409091ddbc881ee28973/roles/14efd2033a754e9b9143349f4994e356 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:38:45.528425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bd6a5-9993-4a24-b812-7fca6edc2bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:45.528561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bd6a5-9993-4a24-b812-7fca6edc2bb3 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:45.529069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bd6a5-9993-4a24-b812-7fca6edc2bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:45.529561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bd6a5-9993-4a24-b812-7fca6edc2bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:45.530233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a709ae-e6f1-4336-813a-1a7a2efe6438 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:45.530572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a709ae-e6f1-4336-813a-1a7a2efe6438 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:45.530838 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a709ae-e6f1-4336-813a-1a7a2efe6438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:45.551826 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bd6a5-9993-4a24-b812-7fca6edc2bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:45.554776 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bd6a5-9993-4a24-b812-7fca6edc2bb3 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:45.578162 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-79a709ae-e6f1-4336-813a-1a7a2efe6438 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:45.580370 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-79a709ae-e6f1-4336-813a-1a7a2efe6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-0f3bd6a5-9993-4a24-b812-7fca6edc2bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:45.588884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:45.591301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:45.592986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:45.592986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:45.592986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:45.595503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 414/806] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:45.596962 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bd6a5-9993-4a24-b812-7fca6edc2bb3 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:45.673477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:45.711017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:45.721707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 393/807] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:38:45.722782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a709ae-e6f1-4336-813a-1a7a2efe6438 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:45.745501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bd6a5-9993-4a24-b812-7fca6edc2bb3 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:45.828147 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca95ee6-0647-4709-96d2-8c52d3e07b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:45.828871 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca95ee6-0647-4709-96d2-8c52d3e07b81 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:45.829133 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca95ee6-0647-4709-96d2-8c52d3e07b81 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:45.829318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca95ee6-0647-4709-96d2-8c52d3e07b81 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:45.830002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca95ee6-0647-4709-96d2-8c52d3e07b81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:45.830306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca95ee6-0647-4709-96d2-8c52d3e07b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:45.832044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca95ee6-0647-4709-96d2-8c52d3e07b81 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:45.849970 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 415/808] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:38:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:45.858867 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca95ee6-0647-4709-96d2-8c52d3e07b81 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:45.943018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a709ae-e6f1-4336-813a-1a7a2efe6438 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:45.989215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911bb09-3953-4eda-b7bc-70c1f8abf616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:45.993320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911bb09-3953-4eda-b7bc-70c1f8abf616 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:45.993592 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911bb09-3953-4eda-b7bc-70c1f8abf616 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:45.993871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911bb09-3953-4eda-b7bc-70c1f8abf616 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:45.994553 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911bb09-3953-4eda-b7bc-70c1f8abf616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:45.994859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911bb09-3953-4eda-b7bc-70c1f8abf616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:45.997346 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911bb09-3953-4eda-b7bc-70c1f8abf616 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:46.032071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 394/809] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:46.037844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911bb09-3953-4eda-b7bc-70c1f8abf616 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:46.088683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca95ee6-0647-4709-96d2-8c52d3e07b81 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:46.125273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:46.129329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:46.168295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea261f49-b26f-4855-b53a-78cf129dd8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:46.169565 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea261f49-b26f-4855-b53a-78cf129dd8f6 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:46.170127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea261f49-b26f-4855-b53a-78cf129dd8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:46.170581 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea261f49-b26f-4855-b53a-78cf129dd8f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:46.187253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911bb09-3953-4eda-b7bc-70c1f8abf616 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:46.194975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea261f49-b26f-4855-b53a-78cf129dd8f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:46.197562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea261f49-b26f-4855-b53a-78cf129dd8f6 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-ea261f49-b26f-4855-b53a-78cf129dd8f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:46.218432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:46.219455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:46.220369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:46.220369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:46.220369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:46.226924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 416/810] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:46.226924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea261f49-b26f-4855-b53a-78cf129dd8f6 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:46.238979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8384134-5b2d-407d-b4b3-f53e1759a4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:46.239640 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8384134-5b2d-407d-b4b3-f53e1759a4d8 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:46.239922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8384134-5b2d-407d-b4b3-f53e1759a4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:46.240253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8384134-5b2d-407d-b4b3-f53e1759a4d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:46.249678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8384134-5b2d-407d-b4b3-f53e1759a4d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:46.251171 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8384134-5b2d-407d-b4b3-f53e1759a4d8 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:46.265734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-f8384134-5b2d-407d-b4b3-f53e1759a4d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:46.265734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:46.265734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:46.265734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:46.265734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:46.265734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:46.265734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:46.265734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:46.265734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:46.265734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:46.265734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:46.265734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:46.265734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:46.265734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:46.265734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:46.267371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:46.268967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:46.268967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:46.268967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:46.268967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:46.268967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:46.268967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:46.268967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:46.268967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:46.271896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 395/811] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:46.273056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8384134-5b2d-407d-b4b3-f53e1759a4d8 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:46.384724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea261f49-b26f-4855-b53a-78cf129dd8f6 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:46.410723 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8384134-5b2d-407d-b4b3-f53e1759a4d8 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:46.440815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:46.443665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e407f-5802-44e7-8591-f0960265e28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:46.444360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e407f-5802-44e7-8591-f0960265e28f None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:46.444682 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e407f-5802-44e7-8591-f0960265e28f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:46.444960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e407f-5802-44e7-8591-f0960265e28f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:46.445556 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e407f-5802-44e7-8591-f0960265e28f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:46.447048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e407f-5802-44e7-8591-f0960265e28f None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-584e407f-5802-44e7-8591-f0960265e28f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:46.458050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:46.459089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:46.460455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:46.460455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:46.460455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:46.460455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:46.460455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:46.460455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:46.460455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:46.460455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:46.460455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:46.460455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:46.460455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:38:46.460455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:46.460455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:38:46.460455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:46.460455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 417/812] 10.222.0.72 () {56 vars in 1129 bytes} [Mon Aug 29 22:38:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:46.461271 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e407f-5802-44e7-8591-f0960265e28f None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:46.470592 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7d299-6059-41a4-8fbf-db388ab5d22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:46.471579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7d299-6059-41a4-8fbf-db388ab5d22a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:46.471866 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7d299-6059-41a4-8fbf-db388ab5d22a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:46.472137 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7d299-6059-41a4-8fbf-db388ab5d22a None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:46.473163 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7d299-6059-41a4-8fbf-db388ab5d22a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:46.473689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7d299-6059-41a4-8fbf-db388ab5d22a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:46.476175 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7d299-6059-41a4-8fbf-db388ab5d22a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:46.499091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 396/813] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:46.500539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b038a-9d7d-4399-924a-a3c27f5f8d1e None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:46.500822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b038a-9d7d-4399-924a-a3c27f5f8d1e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:46.501136 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b038a-9d7d-4399-924a-a3c27f5f8d1e None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:46.504240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 397/814] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:46.504240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b038a-9d7d-4399-924a-a3c27f5f8d1e None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:46.523276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:46.626559 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e407f-5802-44e7-8591-f0960265e28f None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:46.645830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b038a-9d7d-4399-924a-a3c27f5f8d1e None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:46.671966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987eed3-d9d9-4b53-b52d-8f23304809af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:46.672626 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987eed3-d9d9-4b53-b52d-8f23304809af None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:46.672901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987eed3-d9d9-4b53-b52d-8f23304809af None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:46.673166 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987eed3-d9d9-4b53-b52d-8f23304809af None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:46.673876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987eed3-d9d9-4b53-b52d-8f23304809af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:46.674181 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987eed3-d9d9-4b53-b52d-8f23304809af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:46.675655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987eed3-d9d9-4b53-b52d-8f23304809af None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:46.690174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057187e-76d3-448e-96c3-2ecd4ded7f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:46.690975 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057187e-76d3-448e-96c3-2ecd4ded7f0d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:46.691257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057187e-76d3-448e-96c3-2ecd4ded7f0d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:46.691548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057187e-76d3-448e-96c3-2ecd4ded7f0d None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:46.692169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057187e-76d3-448e-96c3-2ecd4ded7f0d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:46.692511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057187e-76d3-448e-96c3-2ecd4ded7f0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:46.693442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 418/815] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:46.694010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057187e-76d3-448e-96c3-2ecd4ded7f0d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:46.699828 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987eed3-d9d9-4b53-b52d-8f23304809af None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:46.701591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 398/816] 10.222.0.72 () {56 vars in 1124 bytes} [Mon Aug 29 22:38:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:46.702934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1a882-c0d2-4adc-b7c2-2cf34d8d4253 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:46.703212 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1a882-c0d2-4adc-b7c2-2cf34d8d4253 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:46.703485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1a882-c0d2-4adc-b7c2-2cf34d8d4253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:46.722998 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-d7a1a882-c0d2-4adc-b7c2-2cf34d8d4253 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:46.724260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d7a1a882-c0d2-4adc-b7c2-2cf34d8d4253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:46.776681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:46.822771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 399/817] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:38:46.824567 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1a882-c0d2-4adc-b7c2-2cf34d8d4253 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:46.849185 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:46.861265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987eed3-d9d9-4b53-b52d-8f23304809af None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:46.913855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426f543-8f6d-4ee3-aaee-7fd574238315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:46.914253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426f543-8f6d-4ee3-aaee-7fd574238315 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:46.914542 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426f543-8f6d-4ee3-aaee-7fd574238315 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:46.914818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426f543-8f6d-4ee3-aaee-7fd574238315 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:46.924315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426f543-8f6d-4ee3-aaee-7fd574238315 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:46.925957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426f543-8f6d-4ee3-aaee-7fd574238315 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-b426f543-8f6d-4ee3-aaee-7fd574238315 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:46.939578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:46.940611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:46.941532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:46.941532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:46.941532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:46.941532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:46.941532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:46.941532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:46.941532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:46.941532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:46.941532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:38:46.941532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:46.941532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 419/818] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Aug 29 22:38:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:46.942610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426f543-8f6d-4ee3-aaee-7fd574238315 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:46.985619 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1a882-c0d2-4adc-b7c2-2cf34d8d4253 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:47.023448 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac1d22-7fb3-43a1-ad71-cf61a1f59f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:47.024611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac1d22-7fb3-43a1-ad71-cf61a1f59f43 None admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:47.025120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac1d22-7fb3-43a1-ad71-cf61a1f59f43 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:47.025612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac1d22-7fb3-43a1-ad71-cf61a1f59f43 None admin] PATH_INFO: `/v3/projects/7abc4d6c6e004b15abff7738164175db/users/94511ad9ee7a4ab0b70d8d5098079886/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:47.028611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac1d22-7fb3-43a1-ad71-cf61a1f59f43 None admin] RBAC: Authorizing `identity:create_grant(project_id=7abc4d6c6e004b15abff7738164175db, user_id=94511ad9ee7a4ab0b70d8d5098079886, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:47.030358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac1d22-7fb3-43a1-ad71-cf61a1f59f43 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:47.132980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 400/819] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:38:46 2022] PUT /identity/v3/projects/7abc4d6c6e004b15abff7738164175db/users/94511ad9ee7a4ab0b70d8d5098079886/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:38:47.132980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac1d22-7fb3-43a1-ad71-cf61a1f59f43 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:47.138111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426f543-8f6d-4ee3-aaee-7fd574238315 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:47.171763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:47.189733 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c1859-44eb-4271-bd6f-8e8fb6600615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:47.190420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c1859-44eb-4271-bd6f-8e8fb6600615 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:47.190706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c1859-44eb-4271-bd6f-8e8fb6600615 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:47.190996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c1859-44eb-4271-bd6f-8e8fb6600615 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:47.191628 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c1859-44eb-4271-bd6f-8e8fb6600615 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:47.191933 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c1859-44eb-4271-bd6f-8e8fb6600615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:47.193681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c1859-44eb-4271-bd6f-8e8fb6600615 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:47.200886 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 420/820] 10.222.0.72 () {56 vars in 1124 bytes} [Mon Aug 29 22:38:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:47.201835 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c1859-44eb-4271-bd6f-8e8fb6600615 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:47.235505 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:47.314291 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac1d22-7fb3-43a1-ad71-cf61a1f59f43 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:47.386043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3201be6-1912-44a9-8fd2-2276f27d4d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:47.387593 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3201be6-1912-44a9-8fd2-2276f27d4d4c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:47.387593 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3201be6-1912-44a9-8fd2-2276f27d4d4c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:47.388064 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3201be6-1912-44a9-8fd2-2276f27d4d4c None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:47.388672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3201be6-1912-44a9-8fd2-2276f27d4d4c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:47.388982 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3201be6-1912-44a9-8fd2-2276f27d4d4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:47.390460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3201be6-1912-44a9-8fd2-2276f27d4d4c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:47.401554 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c1859-44eb-4271-bd6f-8e8fb6600615 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:47.416467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 401/821] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Aug 29 22:38:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:47.430009 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3201be6-1912-44a9-8fd2-2276f27d4d4c None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:47.460690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549b372-5cd4-47bc-8cf8-492a8ce9c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:47.464636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549b372-5cd4-47bc-8cf8-492a8ce9c4a1 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:47.464636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549b372-5cd4-47bc-8cf8-492a8ce9c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:47.464636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549b372-5cd4-47bc-8cf8-492a8ce9c4a1 None admin] PATH_INFO: `/v3/services/network` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:47.464636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549b372-5cd4-47bc-8cf8-492a8ce9c4a1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:47.464636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549b372-5cd4-47bc-8cf8-492a8ce9c4a1 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-0549b372-5cd4-47bc-8cf8-492a8ce9c4a1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:47.491293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:47.493229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:47.494274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:47.494274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:47.494274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:47.494274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:47.494274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:47.494274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:47.494274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:47.494274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:47.494274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:47.494274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:47.494274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:38:47.494274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:47.494274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:38:47.494274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:47.497752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 421/822] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:47 2022] GET /identity/v3/services/network => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:47.497752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549b372-5cd4-47bc-8cf8-492a8ce9c4a1 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:47.563251 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:47.584522 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3201be6-1912-44a9-8fd2-2276f27d4d4c None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:47.606776 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:47.627049 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549b372-5cd4-47bc-8cf8-492a8ce9c4a1 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:47.639008 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd1cf6-58b6-4b1e-971f-52f83b16f792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:47.640523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd1cf6-58b6-4b1e-971f-52f83b16f792 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:47.641354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd1cf6-58b6-4b1e-971f-52f83b16f792 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:47.642279 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd1cf6-58b6-4b1e-971f-52f83b16f792 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:47.643725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd1cf6-58b6-4b1e-971f-52f83b16f792 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:47.645545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd1cf6-58b6-4b1e-971f-52f83b16f792 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:47.666063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00198736-f066-4252-87f7-4d653d2fe471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:47.666745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00198736-f066-4252-87f7-4d653d2fe471 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:47.667025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00198736-f066-4252-87f7-4d653d2fe471 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:47.667296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00198736-f066-4252-87f7-4d653d2fe471 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:47.752419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 402/823] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:38:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:38:47.756678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd1cf6-58b6-4b1e-971f-52f83b16f792 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:47.768535 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00198736-f066-4252-87f7-4d653d2fe471 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:47.770680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00198736-f066-4252-87f7-4d653d2fe471 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:47.890511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:47.903789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd1cf6-58b6-4b1e-971f-52f83b16f792 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:47.920391 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 422/824] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:38:47.922642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc701c32-f753-44e1-88ab-0fd818049518 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:47.922642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc701c32-f753-44e1-88ab-0fd818049518 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:47.922642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc701c32-f753-44e1-88ab-0fd818049518 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:47.925252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 423/825] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:47.926072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc701c32-f753-44e1-88ab-0fd818049518 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:47.959779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefaa0e-bf5d-4990-9b38-a61815c663b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:47.960458 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefaa0e-bf5d-4990-9b38-a61815c663b0 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:47.960777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefaa0e-bf5d-4990-9b38-a61815c663b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:47.961002 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefaa0e-bf5d-4990-9b38-a61815c663b0 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:47.961647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefaa0e-bf5d-4990-9b38-a61815c663b0 None admin] RBAC: Adding query filter params (name=network) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:47.961952 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefaa0e-bf5d-4990-9b38-a61815c663b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:47.963371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefaa0e-bf5d-4990-9b38-a61815c663b0 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:47.970475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 403/826] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Aug 29 22:38:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:47.971931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ca903-bdd7-45a2-bd97-f3358a820e02 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:47.972514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ca903-bdd7-45a2-bd97-f3358a820e02 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:47.972793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ca903-bdd7-45a2-bd97-f3358a820e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:47.982188 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:47.995132 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-0f6ca903-bdd7-45a2-bd97-f3358a820e02 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:47.997048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0f6ca903-bdd7-45a2-bd97-f3358a820e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:48.088257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc701c32-f753-44e1-88ab-0fd818049518 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:48.101091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 404/827] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:38:48.101997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ca903-bdd7-45a2-bd97-f3358a820e02 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:48.134720 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fa973-f759-405b-b449-a9bb0847ad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:48.135600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fa973-f759-405b-b449-a9bb0847ad83 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:48.136870 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fa973-f759-405b-b449-a9bb0847ad83 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:48.137205 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fa973-f759-405b-b449-a9bb0847ad83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:48.151249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fa973-f759-405b-b449-a9bb0847ad83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:48.153356 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fa973-f759-405b-b449-a9bb0847ad83 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-ca4fa973-f759-405b-b449-a9bb0847ad83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:48.177857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:48.178884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:48.179760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:48.179760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:48.179760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:48.184565 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 424/828] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:48.185930 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fa973-f759-405b-b449-a9bb0847ad83 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:48.235346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:48.300427 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ca903-bdd7-45a2-bd97-f3358a820e02 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:48.325923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fa973-f759-405b-b449-a9bb0847ad83 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:48.368672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ca58f-1b07-4ea6-9f48-6832184feede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:48.369548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ca58f-1b07-4ea6-9f48-6832184feede None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:48.369905 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ca58f-1b07-4ea6-9f48-6832184feede None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:48.370253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ca58f-1b07-4ea6-9f48-6832184feede None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:48.371547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ca58f-1b07-4ea6-9f48-6832184feede None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:48.371986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ca58f-1b07-4ea6-9f48-6832184feede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:48.374012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ca58f-1b07-4ea6-9f48-6832184feede None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:48.385206 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77987dce-0bef-4fa7-b71c-6e16a2876f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:48.385844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77987dce-0bef-4fa7-b71c-6e16a2876f9b None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:48.386156 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77987dce-0bef-4fa7-b71c-6e16a2876f9b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:48.386462 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77987dce-0bef-4fa7-b71c-6e16a2876f9b None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:48.387113 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77987dce-0bef-4fa7-b71c-6e16a2876f9b None admin] RBAC: Adding query filter params (type=network) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:48.387418 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77987dce-0bef-4fa7-b71c-6e16a2876f9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:48.396279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 425/829] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:48.397399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77987dce-0bef-4fa7-b71c-6e16a2876f9b None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:48.397635 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ca58f-1b07-4ea6-9f48-6832184feede None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:48.399066 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:48.405024 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 405/830] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Aug 29 22:38:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:48.410973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77987dce-0bef-4fa7-b71c-6e16a2876f9b None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:48.537340 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77987dce-0bef-4fa7-b71c-6e16a2876f9b None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:48.539544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:48.548155 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ca58f-1b07-4ea6-9f48-6832184feede None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:48.578418 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c971c52-7e05-4d91-9889-914d16bc5db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:48.579317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c971c52-7e05-4d91-9889-914d16bc5db4 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:48.579791 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c971c52-7e05-4d91-9889-914d16bc5db4 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:48.580290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c971c52-7e05-4d91-9889-914d16bc5db4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:48.581384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c971c52-7e05-4d91-9889-914d16bc5db4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:48.582991 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c971c52-7e05-4d91-9889-914d16bc5db4 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:48.593376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7f169-ff12-4cfa-a77d-f88ecb4adeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:48.594027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7f169-ff12-4cfa-a77d-f88ecb4adeb4 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:48.594308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7f169-ff12-4cfa-a77d-f88ecb4adeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:48.594580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7f169-ff12-4cfa-a77d-f88ecb4adeb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:48.603148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7f169-ff12-4cfa-a77d-f88ecb4adeb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:48.604919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7f169-ff12-4cfa-a77d-f88ecb4adeb4 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:48.618558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-5fd7f169-ff12-4cfa-a77d-f88ecb4adeb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:48.618558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:48.618558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:48.618558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:48.618558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:48.618558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:48.618558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:48.618558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:48.618558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:48.618558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:48.618558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:48.618558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:48.618558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:48.618558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:48.618558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:48.620116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:48.621945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:48.621945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:48.621945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:48.621945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:48.621945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:48.621945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:48.621945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:48.621945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:48.623363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 426/831] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:48.626495 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7f169-ff12-4cfa-a77d-f88ecb4adeb4 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:48.668562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 406/832] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:38:48 2022] POST /identity/v3/endpoints => generated 337 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:38:48.669992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c971c52-7e05-4d91-9889-914d16bc5db4 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:48.756227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7f169-ff12-4cfa-a77d-f88ecb4adeb4 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:48.793893 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:48.809397 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c9eeb-2edf-40f5-8aa4-c54a1bea9297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:48.810626 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9eeb-2edf-40f5-8aa4-c54a1bea9297 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:48.811128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9eeb-2edf-40f5-8aa4-c54a1bea9297 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:48.811669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9eeb-2edf-40f5-8aa4-c54a1bea9297 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:48.831713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c9eeb-2edf-40f5-8aa4-c54a1bea9297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-ed1c9eeb-2edf-40f5-8aa4-c54a1bea9297 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:48.839869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:48.841142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:48.842002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:48.842002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:48.842002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:48.842002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:48.842002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:48.842002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:48.842002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:48.842002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:48.842002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:48.842002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:48.842002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:38:48.842002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:48.845686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 427/833] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:38:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:48.852039 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c9eeb-2edf-40f5-8aa4-c54a1bea9297 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:48.870446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:48.913617 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c971c52-7e05-4d91-9889-914d16bc5db4 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:48.969901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333dbda-1eb8-464f-ae47-471c4d31e3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:48.970945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333dbda-1eb8-464f-ae47-471c4d31e3aa None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:48.972447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333dbda-1eb8-464f-ae47-471c4d31e3aa None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:48.973090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333dbda-1eb8-464f-ae47-471c4d31e3aa None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:48.974187 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333dbda-1eb8-464f-ae47-471c4d31e3aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:48.974971 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333dbda-1eb8-464f-ae47-471c4d31e3aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:48.977826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333dbda-1eb8-464f-ae47-471c4d31e3aa None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:49.000984 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 407/834] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:49.008660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333dbda-1eb8-464f-ae47-471c4d31e3aa None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:49.021928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c9eeb-2edf-40f5-8aa4-c54a1bea9297 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:49.067212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394888c-fae6-4aff-bf5b-e6bdc9496a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:49.068248 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394888c-fae6-4aff-bf5b-e6bdc9496a02 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:49.068742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394888c-fae6-4aff-bf5b-e6bdc9496a02 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:49.069219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394888c-fae6-4aff-bf5b-e6bdc9496a02 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:49.070098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394888c-fae6-4aff-bf5b-e6bdc9496a02 None admin] RBAC: Adding query filter params (name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:49.070623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394888c-fae6-4aff-bf5b-e6bdc9496a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:49.072327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394888c-fae6-4aff-bf5b-e6bdc9496a02 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:49.082709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 428/835] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:38:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:49.091489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394888c-fae6-4aff-bf5b-e6bdc9496a02 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:49.143640 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333dbda-1eb8-464f-ae47-471c4d31e3aa None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:49.164464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:49.191753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:49.192838 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f313c8c-a94b-4320-b0f6-d97610cefe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:49.196571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f313c8c-a94b-4320-b0f6-d97610cefe19 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:49.197153 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f313c8c-a94b-4320-b0f6-d97610cefe19 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:49.197666 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f313c8c-a94b-4320-b0f6-d97610cefe19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:49.200829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f313c8c-a94b-4320-b0f6-d97610cefe19 None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=0be09bd9ba7443aaa31879f56ca4aad1) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:49.205890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f313c8c-a94b-4320-b0f6-d97610cefe19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:49.205890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f313c8c-a94b-4320-b0f6-d97610cefe19 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:49.213265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 408/836] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:49 2022] GET /identity/v3/role_assignments?user.id=0be09bd9ba7443aaa31879f56ca4aad1&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:49.237575 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394888c-fae6-4aff-bf5b-e6bdc9496a02 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:49.281000 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7319fc2-022c-4c6a-b74d-9a7788ca15b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:49.281660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7319fc2-022c-4c6a-b74d-9a7788ca15b7 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:49.281944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7319fc2-022c-4c6a-b74d-9a7788ca15b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:49.282363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7319fc2-022c-4c6a-b74d-9a7788ca15b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:49.296222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7319fc2-022c-4c6a-b74d-9a7788ca15b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:49.297727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7319fc2-022c-4c6a-b74d-9a7788ca15b7 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-b7319fc2-022c-4c6a-b74d-9a7788ca15b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:49.315394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:49.316433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:49.317304 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:49.317304 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:49.317304 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:49.317304 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 429/837] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:49.325460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f313c8c-a94b-4320-b0f6-d97610cefe19 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:49.379222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960dee4-d8f4-47e6-ab92-0df1018c87e1 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:49.379585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960dee4-d8f4-47e6-ab92-0df1018c87e1 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:49.379787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960dee4-d8f4-47e6-ab92-0df1018c87e1 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:49.381503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 430/838] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:49.387111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec69b7-5656-4b18-8d0f-89536b240d89 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:49.387491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec69b7-5656-4b18-8d0f-89536b240d89 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:49.387772 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec69b7-5656-4b18-8d0f-89536b240d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:49.409274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-48ec69b7-5656-4b18-8d0f-89536b240d89 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:49.410429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-48ec69b7-5656-4b18-8d0f-89536b240d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:49.477109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f313c8c-a94b-4320-b0f6-d97610cefe19 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:49.516169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 431/839] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:38:49.528756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd580860-1ba1-46a3-a116-6f9ba659fbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:49.530080 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd580860-1ba1-46a3-a116-6f9ba659fbb8 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:49.530718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd580860-1ba1-46a3-a116-6f9ba659fbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:49.531347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd580860-1ba1-46a3-a116-6f9ba659fbb8 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:49.532556 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd580860-1ba1-46a3-a116-6f9ba659fbb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:49.533024 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd580860-1ba1-46a3-a116-6f9ba659fbb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:49.534557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd580860-1ba1-46a3-a116-6f9ba659fbb8 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:49.549334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 409/840] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:49.555191 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec69b7-5656-4b18-8d0f-89536b240d89 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:49.621887 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:49.673957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec69b7-5656-4b18-8d0f-89536b240d89 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:49.713979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0744-644b-4e92-ac68-8d15a7064044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:49.715672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0744-644b-4e92-ac68-8d15a7064044 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:49.716124 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0744-644b-4e92-ac68-8d15a7064044 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:49.716570 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0744-644b-4e92-ac68-8d15a7064044 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:49.724976 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b0744-644b-4e92-ac68-8d15a7064044 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:49.726653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b0744-644b-4e92-ac68-8d15a7064044 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-b44b0744-644b-4e92-ac68-8d15a7064044 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:49.741514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:49.742746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:49.743985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:49.743985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:49.743985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:49.743985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:49.743985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:49.743985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:49.743985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:49.743985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:49.743985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:38:49.743985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:49.748322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 432/841] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Aug 29 22:38:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:49.754224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd580860-1ba1-46a3-a116-6f9ba659fbb8 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:49.801998 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:49.833631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0744-644b-4e92-ac68-8d15a7064044 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:49.873867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd580860-1ba1-46a3-a116-6f9ba659fbb8 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:49.916126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a611e-c7be-4ce3-be74-e2188e539721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:49.917272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a611e-c7be-4ce3-be74-e2188e539721 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:49.918615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a611e-c7be-4ce3-be74-e2188e539721 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:49.919148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a611e-c7be-4ce3-be74-e2188e539721 None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:49.920097 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a611e-c7be-4ce3-be74-e2188e539721 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:49.920859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a611e-c7be-4ce3-be74-e2188e539721 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:49.922618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a611e-c7be-4ce3-be74-e2188e539721 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:49.949452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0744-644b-4e92-ac68-8d15a7064044 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:49.950171 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 410/842] 10.222.0.72 () {56 vars in 1149 bytes} [Mon Aug 29 22:38:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:49.951293 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a611e-c7be-4ce3-be74-e2188e539721 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:49.959823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:49.982989 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180babc6-1f82-4968-a3e0-ef3833736a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:49.983635 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180babc6-1f82-4968-a3e0-ef3833736a95 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:49.983913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180babc6-1f82-4968-a3e0-ef3833736a95 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:49.984184 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180babc6-1f82-4968-a3e0-ef3833736a95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:49.996877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180babc6-1f82-4968-a3e0-ef3833736a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-180babc6-1f82-4968-a3e0-ef3833736a95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:50.002549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:50.003697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:50.004698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:50.004698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:50.004698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:50.004698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:50.004698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:50.004698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:50.004698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:50.004698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:50.004698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:50.004698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:50.004698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:38:50.004698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:50.009982 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 433/843] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:38:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:50.018877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180babc6-1f82-4968-a3e0-ef3833736a95 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:50.068252 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:50.075953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a611e-c7be-4ce3-be74-e2188e539721 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:50.116302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2f403-599d-4a44-b3a7-62562845cf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:50.117027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2f403-599d-4a44-b3a7-62562845cf76 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:50.117382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2f403-599d-4a44-b3a7-62562845cf76 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:50.117729 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2f403-599d-4a44-b3a7-62562845cf76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:50.139275 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180babc6-1f82-4968-a3e0-ef3833736a95 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:50.177730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084230e-bdfc-4669-bbad-9641ab916f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:50.178619 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084230e-bdfc-4669-bbad-9641ab916f61 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:50.179052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084230e-bdfc-4669-bbad-9641ab916f61 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:50.179582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084230e-bdfc-4669-bbad-9641ab916f61 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:50.181106 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084230e-bdfc-4669-bbad-9641ab916f61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:50.181855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084230e-bdfc-4669-bbad-9641ab916f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:50.184072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084230e-bdfc-4669-bbad-9641ab916f61 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:50.194459 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 434/844] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:38:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:50.196033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f34d01-b869-4f4e-9190-2210557df925 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:50.196545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f34d01-b869-4f4e-9190-2210557df925 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:50.197018 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f34d01-b869-4f4e-9190-2210557df925 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:50.198421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 435/845] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:50.200537 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f34d01-b869-4f4e-9190-2210557df925 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:50.205936 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2f403-599d-4a44-b3a7-62562845cf76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:50.207412 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2f403-599d-4a44-b3a7-62562845cf76 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:50.243948 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:50.318590 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f34d01-b869-4f4e-9190-2210557df925 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:50.324681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:50.336405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 411/846] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:49 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:38:50.336405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b42314-e45b-4b99-85e8-8d6c16575d91 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:50.336405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b42314-e45b-4b99-85e8-8d6c16575d91 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:50.336405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b42314-e45b-4b99-85e8-8d6c16575d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:50.354652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-91b42314-e45b-4b99-85e8-8d6c16575d91 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:50.356599 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-91b42314-e45b-4b99-85e8-8d6c16575d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:50.369318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacf4ed-1627-4878-906c-f0f5ee3b2627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:50.371349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacf4ed-1627-4878-906c-f0f5ee3b2627 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:50.372000 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacf4ed-1627-4878-906c-f0f5ee3b2627 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:50.372470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacf4ed-1627-4878-906c-f0f5ee3b2627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:50.384945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caacf4ed-1627-4878-906c-f0f5ee3b2627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:50.387219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caacf4ed-1627-4878-906c-f0f5ee3b2627 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-caacf4ed-1627-4878-906c-f0f5ee3b2627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:50.403697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:50.405803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:50.407782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:50.407782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:50.407782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:50.407782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 436/847] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:50.407782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacf4ed-1627-4878-906c-f0f5ee3b2627 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:50.466509 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 412/848] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:38:50.467843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b42314-e45b-4b99-85e8-8d6c16575d91 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:50.543577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:50.560320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacf4ed-1627-4878-906c-f0f5ee3b2627 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:50.613258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76387b57-daef-4912-9f1c-c5242bd3a43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:50.614340 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76387b57-daef-4912-9f1c-c5242bd3a43c None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:50.614837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76387b57-daef-4912-9f1c-c5242bd3a43c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:50.615315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76387b57-daef-4912-9f1c-c5242bd3a43c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:50.629228 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76387b57-daef-4912-9f1c-c5242bd3a43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:50.630572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b42314-e45b-4b99-85e8-8d6c16575d91 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:50.631266 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76387b57-daef-4912-9f1c-c5242bd3a43c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-76387b57-daef-4912-9f1c-c5242bd3a43c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:50.648449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:50.649450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:50.650329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:50.650329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:50.650329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:50.653415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 437/849] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:50.658863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76387b57-daef-4912-9f1c-c5242bd3a43c None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:50.664692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:50.675965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16733c65-ca23-44a4-a045-f90483ab0faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:50.678052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16733c65-ca23-44a4-a045-f90483ab0faf None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:50.678052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16733c65-ca23-44a4-a045-f90483ab0faf None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:50.678052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16733c65-ca23-44a4-a045-f90483ab0faf None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:50.679145 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16733c65-ca23-44a4-a045-f90483ab0faf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:50.679626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16733c65-ca23-44a4-a045-f90483ab0faf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:50.681189 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16733c65-ca23-44a4-a045-f90483ab0faf None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:50.702108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 413/850] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:50.705793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16733c65-ca23-44a4-a045-f90483ab0faf None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:50.774265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76387b57-daef-4912-9f1c-c5242bd3a43c None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:50.813503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29498106-6070-4a42-9cec-7de7a1ac0d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:50.814260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29498106-6070-4a42-9cec-7de7a1ac0d4c None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:50.814392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29498106-6070-4a42-9cec-7de7a1ac0d4c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:50.814636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29498106-6070-4a42-9cec-7de7a1ac0d4c None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:50.815344 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29498106-6070-4a42-9cec-7de7a1ac0d4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:50.815579 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29498106-6070-4a42-9cec-7de7a1ac0d4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:50.816988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29498106-6070-4a42-9cec-7de7a1ac0d4c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:50.827372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:50.836671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 438/851] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:50.840733 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29498106-6070-4a42-9cec-7de7a1ac0d4c None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:50.848559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16733c65-ca23-44a4-a045-f90483ab0faf None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:50.887233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107f64e-1316-4fa6-9d9f-a3fa19ceb986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:50.887876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107f64e-1316-4fa6-9d9f-a3fa19ceb986 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:50.888161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107f64e-1316-4fa6-9d9f-a3fa19ceb986 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:50.888494 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107f64e-1316-4fa6-9d9f-a3fa19ceb986 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:50.896587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107f64e-1316-4fa6-9d9f-a3fa19ceb986 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:50.898060 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107f64e-1316-4fa6-9d9f-a3fa19ceb986 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-e107f64e-1316-4fa6-9d9f-a3fa19ceb986 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:50.910242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:50.911218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:50.912359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:50.912359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:50.912359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:50.912359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:50.912359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:50.912359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:50.912359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:50.912359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:50.912359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:38:50.912359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:50.912359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 414/852] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:38:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:50.912359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107f64e-1316-4fa6-9d9f-a3fa19ceb986 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:50.961616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29498106-6070-4a42-9cec-7de7a1ac0d4c None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:50.966894 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:51.002541 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee0e67-17a5-4954-99de-8c37fc3c740a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:51.002541 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee0e67-17a5-4954-99de-8c37fc3c740a None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:51.003187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee0e67-17a5-4954-99de-8c37fc3c740a None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:51.003187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee0e67-17a5-4954-99de-8c37fc3c740a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:51.005098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee0e67-17a5-4954-99de-8c37fc3c740a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:51.005585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee0e67-17a5-4954-99de-8c37fc3c740a None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-76ee0e67-17a5-4954-99de-8c37fc3c740a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:51.017531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:51.018782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:51.019837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:51.019837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:51.019837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:51.019837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:51.019837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:51.019837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:51.019837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:51.019837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:51.019837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:51.019837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:51.019837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:38:51.019837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:51.019837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:38:51.019837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:51.019837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 439/853] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:38:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:51.021001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee0e67-17a5-4954-99de-8c37fc3c740a None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:51.038403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107f64e-1316-4fa6-9d9f-a3fa19ceb986 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:51.077455 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f92c59-2f74-4713-929c-ad6c9251d9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:51.078136 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f92c59-2f74-4713-929c-ad6c9251d9eb None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:51.078419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f92c59-2f74-4713-929c-ad6c9251d9eb None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:51.078695 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f92c59-2f74-4713-929c-ad6c9251d9eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:51.086633 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f92c59-2f74-4713-929c-ad6c9251d9eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:51.088076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f92c59-2f74-4713-929c-ad6c9251d9eb None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:51.092833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:51.101793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-68f92c59-2f74-4713-929c-ad6c9251d9eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:51.101793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:51.101793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:51.101793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:51.101793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:51.101793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:51.101793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:51.101793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:51.101793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:51.101793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:51.101793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:51.101793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:51.101793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:51.101793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:51.101793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:51.108910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:51.109830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:51.109830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:51.109830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:51.109830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:51.109830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:51.109830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:51.109830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:51.109830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:51.109830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 415/854] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:51.109830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f92c59-2f74-4713-929c-ad6c9251d9eb None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:51.148403 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee0e67-17a5-4954-99de-8c37fc3c740a None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:51.189509 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a720c2-1fef-4994-90ab-342cec8b8f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:51.190433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a720c2-1fef-4994-90ab-342cec8b8f6b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:51.190886 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a720c2-1fef-4994-90ab-342cec8b8f6b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:51.191518 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a720c2-1fef-4994-90ab-342cec8b8f6b None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:51.192375 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a720c2-1fef-4994-90ab-342cec8b8f6b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:51.192720 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a720c2-1fef-4994-90ab-342cec8b8f6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:51.194372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a720c2-1fef-4994-90ab-342cec8b8f6b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:51.215027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 440/855] 10.222.0.72 () {56 vars in 1135 bytes} [Mon Aug 29 22:38:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:51.215976 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a720c2-1fef-4994-90ab-342cec8b8f6b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:51.225654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f92c59-2f74-4713-929c-ad6c9251d9eb None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:51.234405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:51.266971 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd2c31-5483-4d60-a4e0-560ab17c7f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:51.267587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd2c31-5483-4d60-a4e0-560ab17c7f88 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:51.267863 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd2c31-5483-4d60-a4e0-560ab17c7f88 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:51.268131 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd2c31-5483-4d60-a4e0-560ab17c7f88 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:51.268856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd2c31-5483-4d60-a4e0-560ab17c7f88 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:51.269700 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd2c31-5483-4d60-a4e0-560ab17c7f88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:51.271663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd2c31-5483-4d60-a4e0-560ab17c7f88 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:51.282557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 416/856] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:38:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:51.282557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd2c31-5483-4d60-a4e0-560ab17c7f88 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:51.347656 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a720c2-1fef-4994-90ab-342cec8b8f6b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:51.375770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:51.388545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a72075-ca7a-4c1f-b63c-f2ee344c5a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:51.391960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a72075-ca7a-4c1f-b63c-f2ee344c5a78 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:51.391960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a72075-ca7a-4c1f-b63c-f2ee344c5a78 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:51.391960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a72075-ca7a-4c1f-b63c-f2ee344c5a78 None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:51.391960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a72075-ca7a-4c1f-b63c-f2ee344c5a78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:51.391960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a72075-ca7a-4c1f-b63c-f2ee344c5a78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:51.394254 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a72075-ca7a-4c1f-b63c-f2ee344c5a78 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:51.400342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd2c31-5483-4d60-a4e0-560ab17c7f88 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:51.407276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 441/857] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:51.407959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a72075-ca7a-4c1f-b63c-f2ee344c5a78 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:51.447592 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1c414-65e0-4957-8c72-c4fe423a152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:51.448223 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1c414-65e0-4957-8c72-c4fe423a152c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:51.448595 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1c414-65e0-4957-8c72-c4fe423a152c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:51.448864 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1c414-65e0-4957-8c72-c4fe423a152c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:51.497067 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:51.519007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a72075-ca7a-4c1f-b63c-f2ee344c5a78 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:51.530622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1c414-65e0-4957-8c72-c4fe423a152c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:51.532110 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1c414-65e0-4957-8c72-c4fe423a152c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:51.555053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9107ff-1eb4-4cb3-8d73-3121bc89f86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:51.555662 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9107ff-1eb4-4cb3-8d73-3121bc89f86b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:51.555941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9107ff-1eb4-4cb3-8d73-3121bc89f86b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:51.556224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9107ff-1eb4-4cb3-8d73-3121bc89f86b None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:51.556865 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9107ff-1eb4-4cb3-8d73-3121bc89f86b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:51.557167 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9107ff-1eb4-4cb3-8d73-3121bc89f86b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:51.559219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9107ff-1eb4-4cb3-8d73-3121bc89f86b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:51.563907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 442/858] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:38:51 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:51.564736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9107ff-1eb4-4cb3-8d73-3121bc89f86b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:51.628664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:51.653782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 417/859] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:51 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:38:51.653782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b490102-88b8-4f57-874e-4c9a4cf1b39e None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:51.653782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b490102-88b8-4f57-874e-4c9a4cf1b39e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:51.653782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b490102-88b8-4f57-874e-4c9a4cf1b39e None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:51.653782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 418/860] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:51.654838 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b490102-88b8-4f57-874e-4c9a4cf1b39e None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:51.703507 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9107ff-1eb4-4cb3-8d73-3121bc89f86b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:51.747292 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:51.749886 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846193d4-dead-4c77-a5a3-8c542896dbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:51.750570 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846193d4-dead-4c77-a5a3-8c542896dbe0 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:51.750858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846193d4-dead-4c77-a5a3-8c542896dbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:51.751410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846193d4-dead-4c77-a5a3-8c542896dbe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:51.752209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846193d4-dead-4c77-a5a3-8c542896dbe0 None admin] RBAC: Adding query filter params (role.id=14efd2033a754e9b9143349f4994e356, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=e7b1650890fe409091ddbc881ee28973) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:51.752751 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846193d4-dead-4c77-a5a3-8c542896dbe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:51.754310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846193d4-dead-4c77-a5a3-8c542896dbe0 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:51.763580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 443/861] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:51 2022] GET /identity/v3/role_assignments?user.id=e7b1650890fe409091ddbc881ee28973&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=14efd2033a754e9b9143349f4994e356 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:51.763580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cd1e0-3823-4214-9f96-001dc25af2a8 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:51.763580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cd1e0-3823-4214-9f96-001dc25af2a8 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:51.763580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cd1e0-3823-4214-9f96-001dc25af2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:51.785346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-359cd1e0-3823-4214-9f96-001dc25af2a8 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:51.786715 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-359cd1e0-3823-4214-9f96-001dc25af2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:51.787673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b490102-88b8-4f57-874e-4c9a4cf1b39e None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:51.900839 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 444/862] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:38:51.955862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a8bc4-cdc7-462a-b42b-045e093eebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:51.956543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a8bc4-cdc7-462a-b42b-045e093eebc0 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:51.956824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a8bc4-cdc7-462a-b42b-045e093eebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:51.957095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a8bc4-cdc7-462a-b42b-045e093eebc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:51.968965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a8bc4-cdc7-462a-b42b-045e093eebc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:51.970784 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a8bc4-cdc7-462a-b42b-045e093eebc0 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-7b3a8bc4-cdc7-462a-b42b-045e093eebc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:51.988063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:51.989967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:51.991017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:51.991017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:51.991017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:51.991017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 419/863] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:51.996125 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cd1e0-3823-4214-9f96-001dc25af2a8 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:52.057233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:52.129187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cd1e0-3823-4214-9f96-001dc25af2a8 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:52.166668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2243c-e56c-460e-ad81-1071305fd87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:52.167363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2243c-e56c-460e-ad81-1071305fd87a None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:52.167502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2243c-e56c-460e-ad81-1071305fd87a None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:52.167778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2243c-e56c-460e-ad81-1071305fd87a None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:52.168444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2243c-e56c-460e-ad81-1071305fd87a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:52.168745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2243c-e56c-460e-ad81-1071305fd87a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:52.170111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2243c-e56c-460e-ad81-1071305fd87a None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:52.182559 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 445/864] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:52.188384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a8bc4-cdc7-462a-b42b-045e093eebc0 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:52.294826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a8bc4-cdc7-462a-b42b-045e093eebc0 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:52.320586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:52.331428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd75ca2-bf1b-45ff-b185-d4aaa81cb6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:52.339666 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd75ca2-bf1b-45ff-b185-d4aaa81cb6c0 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:52.339666 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd75ca2-bf1b-45ff-b185-d4aaa81cb6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:52.339666 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd75ca2-bf1b-45ff-b185-d4aaa81cb6c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:52.340181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd75ca2-bf1b-45ff-b185-d4aaa81cb6c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:52.341544 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd75ca2-bf1b-45ff-b185-d4aaa81cb6c0 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:52.353524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-7bd75ca2-bf1b-45ff-b185-d4aaa81cb6c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:52.353524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:52.353524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:52.353524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:52.353524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:52.353524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:52.353524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:52.353524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:52.353524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:52.353524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:52.353524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:52.353524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:52.353524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:52.353524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:52.353524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:52.354467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:52.356079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:52.356079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:52.356079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:52.356079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:52.356079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:52.356079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:52.356079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:52.356079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:52.356079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 420/865] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:52.364349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2243c-e56c-460e-ad81-1071305fd87a None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:52.400010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd75ca2-bf1b-45ff-b185-d4aaa81cb6c0 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:52.482299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:52.486652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2243c-e56c-460e-ad81-1071305fd87a None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:52.531135 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365214d-de78-41ce-b235-3eae8260db6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:52.532027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365214d-de78-41ce-b235-3eae8260db6d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:52.532478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365214d-de78-41ce-b235-3eae8260db6d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:52.533486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365214d-de78-41ce-b235-3eae8260db6d None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:52.534334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365214d-de78-41ce-b235-3eae8260db6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:52.534790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365214d-de78-41ce-b235-3eae8260db6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:52.536382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365214d-de78-41ce-b235-3eae8260db6d None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:52.557534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 446/866] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:52.566456 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365214d-de78-41ce-b235-3eae8260db6d None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:52.575155 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd75ca2-bf1b-45ff-b185-d4aaa81cb6c0 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:52.615212 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bb80e-56ba-4c3d-83e7-9775429ac938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:52.616150 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bb80e-56ba-4c3d-83e7-9775429ac938 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:52.616593 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bb80e-56ba-4c3d-83e7-9775429ac938 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:52.617009 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bb80e-56ba-4c3d-83e7-9775429ac938 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:52.617760 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327bb80e-56ba-4c3d-83e7-9775429ac938 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:52.619916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327bb80e-56ba-4c3d-83e7-9775429ac938 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-327bb80e-56ba-4c3d-83e7-9775429ac938 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:52.633495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:52.634505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:52.635369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:52.635369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:52.635369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:52.635369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:52.635369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:52.635369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:52.635369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:52.635369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:52.635369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:52.635369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:52.635369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:38:52.635369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:52.635369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:38:52.635369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:52.639674 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 421/867] 10.222.0.72 () {56 vars in 1132 bytes} [Mon Aug 29 22:38:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:52.645611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bb80e-56ba-4c3d-83e7-9775429ac938 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:52.688001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365214d-de78-41ce-b235-3eae8260db6d None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:52.697436 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:52.727180 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca1dcf-1f1e-4357-a640-2b7a9bec5f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:52.728082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca1dcf-1f1e-4357-a640-2b7a9bec5f09 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:52.728535 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca1dcf-1f1e-4357-a640-2b7a9bec5f09 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:52.728981 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca1dcf-1f1e-4357-a640-2b7a9bec5f09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:52.730459 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca1dcf-1f1e-4357-a640-2b7a9bec5f09 None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=94511ad9ee7a4ab0b70d8d5098079886) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:52.730963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca1dcf-1f1e-4357-a640-2b7a9bec5f09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:52.732884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca1dcf-1f1e-4357-a640-2b7a9bec5f09 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:52.739708 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 447/868] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:52 2022] GET /identity/v3/role_assignments?user.id=94511ad9ee7a4ab0b70d8d5098079886&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:52.781428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bb80e-56ba-4c3d-83e7-9775429ac938 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:52.825631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2413a26-e85b-4858-a828-41faade79f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:52.826638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2413a26-e85b-4858-a828-41faade79f39 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:52.827143 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2413a26-e85b-4858-a828-41faade79f39 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:52.827613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2413a26-e85b-4858-a828-41faade79f39 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:52.828540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2413a26-e85b-4858-a828-41faade79f39 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:52.829059 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2413a26-e85b-4858-a828-41faade79f39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:52.830660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2413a26-e85b-4858-a828-41faade79f39 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:52.836659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 422/869] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Aug 29 22:38:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:52.845445 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca1dcf-1f1e-4357-a640-2b7a9bec5f09 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:52.883650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:52.974938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca1dcf-1f1e-4357-a640-2b7a9bec5f09 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:53.016391 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bae424-9cea-465c-ab78-687d84701fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:53.017322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae424-9cea-465c-ab78-687d84701fc2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:53.017744 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae424-9cea-465c-ab78-687d84701fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:53.018184 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae424-9cea-465c-ab78-687d84701fc2 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:53.018962 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bae424-9cea-465c-ab78-687d84701fc2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:53.019406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bae424-9cea-465c-ab78-687d84701fc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:53.020999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bae424-9cea-465c-ab78-687d84701fc2 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:53.027190 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 448/870] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Aug 29 22:38:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:53.609593 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d70b25-eb48-401d-829e-38eca8d1b729 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:53.610113 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d70b25-eb48-401d-829e-38eca8d1b729 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:53.610113 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d70b25-eb48-401d-829e-38eca8d1b729 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:53.611731 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 423/871] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:53.617023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96f23d-4fcb-4c43-8673-d6ae9087f68d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:53.617462 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96f23d-4fcb-4c43-8673-d6ae9087f68d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:53.617643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96f23d-4fcb-4c43-8673-d6ae9087f68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:53.637058 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-4c96f23d-4fcb-4c43-8673-d6ae9087f68d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:53.638257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4c96f23d-4fcb-4c43-8673-d6ae9087f68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:53.717145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 449/872] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:38:53.980724 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028364d-4c0a-42e5-b8d1-f562e063d4b7 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:53.980978 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028364d-4c0a-42e5-b8d1-f562e063d4b7 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:53.981356 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028364d-4c0a-42e5-b8d1-f562e063d4b7 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:53.982796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 424/873] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:53.988077 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089ccf8-1a18-411e-b276-9a82f3eb3422 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:53.988452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089ccf8-1a18-411e-b276-9a82f3eb3422 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:53.988670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089ccf8-1a18-411e-b276-9a82f3eb3422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:54.011831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-e089ccf8-1a18-411e-b276-9a82f3eb3422 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:54.012762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028364d-4c0a-42e5-b8d1-f562e063d4b7 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:54.013059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e089ccf8-1a18-411e-b276-9a82f3eb3422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:54.036565 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:54.110412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 450/874] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:38:54.149126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028364d-4c0a-42e5-b8d1-f562e063d4b7 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:54.163453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:54.192817 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c87331-fa49-443c-b6fc-bb10964a40b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:54.193425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c87331-fa49-443c-b6fc-bb10964a40b5 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:54.193763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c87331-fa49-443c-b6fc-bb10964a40b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:54.194038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c87331-fa49-443c-b6fc-bb10964a40b5 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:54.194698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c87331-fa49-443c-b6fc-bb10964a40b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:54.196053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c87331-fa49-443c-b6fc-bb10964a40b5 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:54.271197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 425/875] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Aug 29 22:38:54 2022] POST /identity/v3/services => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:38:54.399949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089ccf8-1a18-411e-b276-9a82f3eb3422 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:54.521520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089ccf8-1a18-411e-b276-9a82f3eb3422 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:54.568826 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa9a5-790c-4c92-874e-8fb208b2f3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:54.569825 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa9a5-790c-4c92-874e-8fb208b2f3a2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:54.570273 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa9a5-790c-4c92-874e-8fb208b2f3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:54.570696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa9a5-790c-4c92-874e-8fb208b2f3a2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:54.583043 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfa9a5-790c-4c92-874e-8fb208b2f3a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-7fbfa9a5-790c-4c92-874e-8fb208b2f3a2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:54.588259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:54.590009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:54.591008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:54.591008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:54.591008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:54.591008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:54.591008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:54.591008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:54.591008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:54.591008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:54.591008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:54.591008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:54.591008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:38:54.591008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:54.598233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 451/876] 10.222.0.72 () {56 vars in 1120 bytes} [Mon Aug 29 22:38:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:54.599899 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c87331-fa49-443c-b6fc-bb10964a40b5 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:54.711297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c87331-fa49-443c-b6fc-bb10964a40b5 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:54.750654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aee5d1-aba5-4c94-9379-2b698d829010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:54.751265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aee5d1-aba5-4c94-9379-2b698d829010 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:54.751540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aee5d1-aba5-4c94-9379-2b698d829010 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:54.751810 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aee5d1-aba5-4c94-9379-2b698d829010 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:54.752514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aee5d1-aba5-4c94-9379-2b698d829010 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:54.752814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aee5d1-aba5-4c94-9379-2b698d829010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:54.754176 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aee5d1-aba5-4c94-9379-2b698d829010 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:54.764230 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 426/877] 10.222.0.72 () {56 vars in 1115 bytes} [Mon Aug 29 22:38:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:54.769840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa9a5-790c-4c92-874e-8fb208b2f3a2 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:54.775156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:54.828262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cf871-c5c5-4b5f-aaf7-040b6e1bade9 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:54.828728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cf871-c5c5-4b5f-aaf7-040b6e1bade9 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:54.829133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cf871-c5c5-4b5f-aaf7-040b6e1bade9 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:54.830867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 427/878] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:38:54.838571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268053c-b227-47a2-b971-f1d60ed18e4e None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:54.839657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268053c-b227-47a2-b971-f1d60ed18e4e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:54.840126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268053c-b227-47a2-b971-f1d60ed18e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:54.860961 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-8268053c-b227-47a2-b971-f1d60ed18e4e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:54.862249 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8268053c-b227-47a2-b971-f1d60ed18e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:54.897866 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:54.900814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa9a5-790c-4c92-874e-8fb208b2f3a2 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:54.952341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 428/879] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:54 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:38:54.957474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e311af-a29e-4a12-a780-09ea4d9646ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:54.958209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e311af-a29e-4a12-a780-09ea4d9646ba None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:54.958492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e311af-a29e-4a12-a780-09ea4d9646ba None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:54.958831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e311af-a29e-4a12-a780-09ea4d9646ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:54.970469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e311af-a29e-4a12-a780-09ea4d9646ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:54.972421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e311af-a29e-4a12-a780-09ea4d9646ba None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-55e311af-a29e-4a12-a780-09ea4d9646ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:54.989924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:54.990890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:54.991758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:54.991758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:54.991758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:54.991758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 452/880] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:54.997612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268053c-b227-47a2-b971-f1d60ed18e4e None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:55.044221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be9ff7-67eb-43fd-b368-852577094296 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:55.044413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be9ff7-67eb-43fd-b368-852577094296 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:55.044675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be9ff7-67eb-43fd-b368-852577094296 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:55.046149 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 453/881] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:38:55.051411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aefcd-62fc-4e67-8d04-df2a013ef15a None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:55.051689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aefcd-62fc-4e67-8d04-df2a013ef15a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:55.051951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aefcd-62fc-4e67-8d04-df2a013ef15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:55.071887 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-ca0aefcd-62fc-4e67-8d04-df2a013ef15a None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:55.073924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ca0aefcd-62fc-4e67-8d04-df2a013ef15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:55.118071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268053c-b227-47a2-b971-f1d60ed18e4e None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:55.130634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:55.156245 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 454/882] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:55 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:38:55.164440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c10a03-3521-498c-ae52-4e86a01dc481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:55.165052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c10a03-3521-498c-ae52-4e86a01dc481 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:55.165382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c10a03-3521-498c-ae52-4e86a01dc481 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:55.165585 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c10a03-3521-498c-ae52-4e86a01dc481 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:55.166228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c10a03-3521-498c-ae52-4e86a01dc481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:55.166532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c10a03-3521-498c-ae52-4e86a01dc481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:55.172215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c10a03-3521-498c-ae52-4e86a01dc481 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:55.181737 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 429/883] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:55.187447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0aefcd-62fc-4e67-8d04-df2a013ef15a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:55.293522 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c10a03-3521-498c-ae52-4e86a01dc481 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:55.296033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0aefcd-62fc-4e67-8d04-df2a013ef15a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:55.320806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:55.333778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9151b-629c-4e5c-b40f-645c3aebc4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:55.334416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9151b-629c-4e5c-b40f-645c3aebc4bd None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:55.334696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9151b-629c-4e5c-b40f-645c3aebc4bd None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:55.334965 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9151b-629c-4e5c-b40f-645c3aebc4bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:55.343015 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9151b-629c-4e5c-b40f-645c3aebc4bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:55.344618 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9151b-629c-4e5c-b40f-645c3aebc4bd None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-22b9151b-629c-4e5c-b40f-645c3aebc4bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:38:55.358818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:55.360008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:55.360998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:55.360998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:55.360998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:38:55.360998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:38:55.360998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:38:55.360998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:38:55.360998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:38:55.360998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:38:55.360998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:38:55.360998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:55.360998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 455/884] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Aug 29 22:38:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:55.366709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9151b-629c-4e5c-b40f-645c3aebc4bd None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:55.432429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:55.436481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c10a03-3521-498c-ae52-4e86a01dc481 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:55.477982 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d20d48-c648-4d30-a594-3825df090166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:55.478896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d20d48-c648-4d30-a594-3825df090166 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:55.479215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d20d48-c648-4d30-a594-3825df090166 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:55.479549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d20d48-c648-4d30-a594-3825df090166 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:55.480379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d20d48-c648-4d30-a594-3825df090166 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:55.481924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d20d48-c648-4d30-a594-3825df090166 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-92d20d48-c648-4d30-a594-3825df090166 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:55.491840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:55.492895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:55.493711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:55.493711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:55.493711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:55.493711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:55.493711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:55.493711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:55.493711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:55.493711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:55.493711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:55.493711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:55.493711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:38:55.493711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:55.493711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:38:55.493711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:55.493711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 430/885] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Aug 29 22:38:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:55.494494 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d20d48-c648-4d30-a594-3825df090166 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:55.500885 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9151b-629c-4e5c-b40f-645c3aebc4bd None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:55.540587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a3fdd-3774-426c-b509-d56dea153a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:55.541206 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a3fdd-3774-426c-b509-d56dea153a2d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:55.541484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a3fdd-3774-426c-b509-d56dea153a2d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:55.541756 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a3fdd-3774-426c-b509-d56dea153a2d None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:55.542693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a3fdd-3774-426c-b509-d56dea153a2d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:55.543001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a3fdd-3774-426c-b509-d56dea153a2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:55.544460 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a3fdd-3774-426c-b509-d56dea153a2d None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:55.567963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 456/886] 10.222.0.72 () {56 vars in 1149 bytes} [Mon Aug 29 22:38:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:55.567963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a3fdd-3774-426c-b509-d56dea153a2d None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:55.598689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:55.614481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d20d48-c648-4d30-a594-3825df090166 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:55.650352 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c3386-31bf-4951-9f61-ec0d11cf2b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:55.650963 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c3386-31bf-4951-9f61-ec0d11cf2b3d None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:55.651266 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c3386-31bf-4951-9f61-ec0d11cf2b3d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:55.651613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c3386-31bf-4951-9f61-ec0d11cf2b3d None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:55.652584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c3386-31bf-4951-9f61-ec0d11cf2b3d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:55.653945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c3386-31bf-4951-9f61-ec0d11cf2b3d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:55.673376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a3fdd-3774-426c-b509-d56dea153a2d None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:55.676063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:55.709564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf11b55-d317-4a09-8bc8-6123f287cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:55.710224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf11b55-d317-4a09-8bc8-6123f287cd00 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:55.710452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf11b55-d317-4a09-8bc8-6123f287cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:55.710779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf11b55-d317-4a09-8bc8-6123f287cd00 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:55.711351 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf11b55-d317-4a09-8bc8-6123f287cd00 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:55.711654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf11b55-d317-4a09-8bc8-6123f287cd00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:55.713056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf11b55-d317-4a09-8bc8-6123f287cd00 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:55.717889 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 457/887] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Aug 29 22:38:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:55.718499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf11b55-d317-4a09-8bc8-6123f287cd00 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:55.740158 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 431/888] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Aug 29 22:38:55 2022] POST /identity/v3/services => generated 269 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:38:55.741618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c3386-31bf-4951-9f61-ec0d11cf2b3d None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:55.845986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf11b55-d317-4a09-8bc8-6123f287cd00 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:55.899698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4053a0f-f9e9-4594-98de-f94ca2ce1fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:55.900017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c3386-31bf-4951-9f61-ec0d11cf2b3d None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:55.901305 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4053a0f-f9e9-4594-98de-f94ca2ce1fb0 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:55.902372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4053a0f-f9e9-4594-98de-f94ca2ce1fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:55.903090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4053a0f-f9e9-4594-98de-f94ca2ce1fb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:55.940724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:55.952741 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44be614-41ae-4f4b-8bfe-481ae7beeb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:55.954120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44be614-41ae-4f4b-8bfe-481ae7beeb37 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:55.954120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44be614-41ae-4f4b-8bfe-481ae7beeb37 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:55.954120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44be614-41ae-4f4b-8bfe-481ae7beeb37 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:55.954511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44be614-41ae-4f4b-8bfe-481ae7beeb37 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:55.954891 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44be614-41ae-4f4b-8bfe-481ae7beeb37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:55.956900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44be614-41ae-4f4b-8bfe-481ae7beeb37 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:55.962314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 432/889] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Aug 29 22:38:55 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:55.999032 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4053a0f-f9e9-4594-98de-f94ca2ce1fb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:56.001205 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4053a0f-f9e9-4594-98de-f94ca2ce1fb0 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:56.124842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 458/890] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:38:55 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:38:56.130476 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44be614-41ae-4f4b-8bfe-481ae7beeb37 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:56.141994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:56.248344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44be614-41ae-4f4b-8bfe-481ae7beeb37 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:56.285031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd8220-53d4-4b06-b7a9-2106c5332ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:56.286083 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd8220-53d4-4b06-b7a9-2106c5332ee5 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:56.286511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd8220-53d4-4b06-b7a9-2106c5332ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:56.287098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd8220-53d4-4b06-b7a9-2106c5332ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:56.299649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd8220-53d4-4b06-b7a9-2106c5332ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:56.301377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd8220-53d4-4b06-b7a9-2106c5332ee5 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-adbd8220-53d4-4b06-b7a9-2106c5332ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:38:56.317226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:56.318435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:38:56.319547 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:38:56.319547 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:38:56.319547 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:56.321316 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 433/891] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:56.327193 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4053a0f-f9e9-4594-98de-f94ca2ce1fb0 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:56.384935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7e440-25e0-4d9f-993f-deada18e94cd None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:56.385122 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7e440-25e0-4d9f-993f-deada18e94cd None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:56.385425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7e440-25e0-4d9f-993f-deada18e94cd None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:56.391090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 434/892] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:38:56.393155 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24590878-51f4-4c7b-b59c-d7d69b4b3dd4 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:56.393439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24590878-51f4-4c7b-b59c-d7d69b4b3dd4 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:56.393715 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24590878-51f4-4c7b-b59c-d7d69b4b3dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:56.403209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:56.414160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-24590878-51f4-4c7b-b59c-d7d69b4b3dd4 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:56.415093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-24590878-51f4-4c7b-b59c-d7d69b4b3dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:56.460918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4053a0f-f9e9-4594-98de-f94ca2ce1fb0 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:56.484253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:56.502420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a2d7a-fb32-4e78-8e65-75272191b509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:56.503066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a2d7a-fb32-4e78-8e65-75272191b509 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:56.503343 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a2d7a-fb32-4e78-8e65-75272191b509 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:56.503621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a2d7a-fb32-4e78-8e65-75272191b509 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:56.504491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a2d7a-fb32-4e78-8e65-75272191b509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:56.504910 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a2d7a-fb32-4e78-8e65-75272191b509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:56.506053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 435/893] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:56 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:38:56.512934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a2d7a-fb32-4e78-8e65-75272191b509 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:56.528790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 459/894] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:56.534322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24590878-51f4-4c7b-b59c-d7d69b4b3dd4 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:56.642976 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24590878-51f4-4c7b-b59c-d7d69b4b3dd4 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:56.680788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb1986-6b87-45ca-bd32-7e87315bdce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:56.681806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1986-6b87-45ca-bd32-7e87315bdce2 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:56.682286 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1986-6b87-45ca-bd32-7e87315bdce2 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:56.683323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1986-6b87-45ca-bd32-7e87315bdce2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:56.690878 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb1986-6b87-45ca-bd32-7e87315bdce2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:56.692618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb1986-6b87-45ca-bd32-7e87315bdce2 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:56.704798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-4edb1986-6b87-45ca-bd32-7e87315bdce2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:56.704798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:56.704798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:56.704798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:56.704798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:56.704798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:56.704798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:56.704798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:56.704798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:56.704798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:56.704798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:56.704798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:56.704798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:38:56.704798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:38:56.704798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:56.705678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:56.706559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:38:56.706559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:38:56.706559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:38:56.706559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:38:56.706559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:38:56.706559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:38:56.706559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:38:56.706559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:56.709000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 436/895] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:38:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:56.715205 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a2d7a-fb32-4e78-8e65-75272191b509 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:56.820971 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb1986-6b87-45ca-bd32-7e87315bdce2 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:56.830417 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a2d7a-fb32-4e78-8e65-75272191b509 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:56.857899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:56.869133 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4f59c-0dc5-4b24-b4b3-316de1643d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:56.869748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4f59c-0dc5-4b24-b4b3-316de1643d91 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:56.870651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4f59c-0dc5-4b24-b4b3-316de1643d91 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:56.870928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4f59c-0dc5-4b24-b4b3-316de1643d91 None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:56.872217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4f59c-0dc5-4b24-b4b3-316de1643d91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:56.872217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4f59c-0dc5-4b24-b4b3-316de1643d91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:56.873551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4f59c-0dc5-4b24-b4b3-316de1643d91 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:56.882685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:56.888252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 460/896] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:38:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:56.894231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4f59c-0dc5-4b24-b4b3-316de1643d91 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:56.960024 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb1986-6b87-45ca-bd32-7e87315bdce2 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:56.999783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c618d-2054-4b14-b6c8-bb9f5d9b174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:57.000878 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c618d-2054-4b14-b6c8-bb9f5d9b174a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:57.001372 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c618d-2054-4b14-b6c8-bb9f5d9b174a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:57.001883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c618d-2054-4b14-b6c8-bb9f5d9b174a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:57.002705 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c618d-2054-4b14-b6c8-bb9f5d9b174a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:57.004443 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c618d-2054-4b14-b6c8-bb9f5d9b174a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:57.010832 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4f59c-0dc5-4b24-b4b3-316de1643d91 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-471c618d-2054-4b14-b6c8-bb9f5d9b174a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:57.015447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:57.016440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:57.017262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:57.017262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:57.017262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:57.017262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:57.017262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:57.017262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:57.017262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:57.017262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:57.017262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:57.017262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:57.017262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:38:57.017262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:57.017262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:38:57.017262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:57.024533 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 437/897] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:38:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:38:57.026702 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c618d-2054-4b14-b6c8-bb9f5d9b174a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:57.052991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29b4ce-de49-4ba2-977c-cbc05a3bef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:57.053604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29b4ce-de49-4ba2-977c-cbc05a3bef92 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:57.053880 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29b4ce-de49-4ba2-977c-cbc05a3bef92 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:57.054152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29b4ce-de49-4ba2-977c-cbc05a3bef92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:57.054882 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29b4ce-de49-4ba2-977c-cbc05a3bef92 None admin] RBAC: Adding query filter params (role.id=136e6370b0c7476f898673d4d697ed28, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=e7b1650890fe409091ddbc881ee28973) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:57.055354 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29b4ce-de49-4ba2-977c-cbc05a3bef92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:57.056738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29b4ce-de49-4ba2-977c-cbc05a3bef92 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 461/898] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:38:56 2022] GET /identity/v3/role_assignments?user.id=e7b1650890fe409091ddbc881ee28973&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=136e6370b0c7476f898673d4d697ed28 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:57.160023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c618d-2054-4b14-b6c8-bb9f5d9b174a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:57.177000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:57.203166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef55dc2-ecce-46e2-87e0-138b1bda78c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:57.203797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef55dc2-ecce-46e2-87e0-138b1bda78c6 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:57.204098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef55dc2-ecce-46e2-87e0-138b1bda78c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:57.204436 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef55dc2-ecce-46e2-87e0-138b1bda78c6 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:57.205490 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef55dc2-ecce-46e2-87e0-138b1bda78c6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:57.205811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef55dc2-ecce-46e2-87e0-138b1bda78c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:57.207887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef55dc2-ecce-46e2-87e0-138b1bda78c6 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:57.214623 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 438/899] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:38:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:57.222189 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29b4ce-de49-4ba2-977c-cbc05a3bef92 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:57.285266 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:57.341575 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29b4ce-de49-4ba2-977c-cbc05a3bef92 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:57.379747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcdb4b-e6b1-48a0-ae68-b5c9f655fd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:57.380791 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcdb4b-e6b1-48a0-ae68-b5c9f655fd1b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:57.381294 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcdb4b-e6b1-48a0-ae68-b5c9f655fd1b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:57.381766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcdb4b-e6b1-48a0-ae68-b5c9f655fd1b None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:57.382608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcdb4b-e6b1-48a0-ae68-b5c9f655fd1b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:57.383124 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcdb4b-e6b1-48a0-ae68-b5c9f655fd1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:57.384737 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcdb4b-e6b1-48a0-ae68-b5c9f655fd1b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:57.392170 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 462/900] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:38:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:57.398301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef55dc2-ecce-46e2-87e0-138b1bda78c6 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:57.511950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef55dc2-ecce-46e2-87e0-138b1bda78c6 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:57.549548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadda86a-0755-409d-8b3a-478e360b172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:57.550170 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadda86a-0755-409d-8b3a-478e360b172f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:57.550449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadda86a-0755-409d-8b3a-478e360b172f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:57.550719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadda86a-0755-409d-8b3a-478e360b172f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:57.551425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadda86a-0755-409d-8b3a-478e360b172f None admin] RBAC: Adding query filter params (interface=public, service_id=2a06af7af48241d9b2b039903244b3c9, region_id=RegionOne) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:57.551732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadda86a-0755-409d-8b3a-478e360b172f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:57.553148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadda86a-0755-409d-8b3a-478e360b172f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:57.559887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 439/901] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Aug 29 22:38:57 2022] GET /identity/v3/endpoints?service_id=2a06af7af48241d9b2b039903244b3c9&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:57.565400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcdb4b-e6b1-48a0-ae68-b5c9f655fd1b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:57.673643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcdb4b-e6b1-48a0-ae68-b5c9f655fd1b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:57.688932 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:57.710400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c7818-257d-42a8-896e-a0863717929a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:57.711015 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c7818-257d-42a8-896e-a0863717929a None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:57.711292 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c7818-257d-42a8-896e-a0863717929a None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:57.711562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c7818-257d-42a8-896e-a0863717929a None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:57.712171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c7818-257d-42a8-896e-a0863717929a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:57.713604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c7818-257d-42a8-896e-a0863717929a None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:57.724628 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 463/902] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Aug 29 22:38:57 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:38:57.905269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e5969-a4aa-4d58-a1f9-092f169aa79e None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:57.906269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e5969-a4aa-4d58-a1f9-092f169aa79e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:57.906785 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e5969-a4aa-4d58-a1f9-092f169aa79e None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:57.908628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 440/903] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:57.914334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aece51-44a7-481d-8899-93ce49251109 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:57.915246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aece51-44a7-481d-8899-93ce49251109 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:57.915738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aece51-44a7-481d-8899-93ce49251109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:57.936111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-c9aece51-44a7-481d-8899-93ce49251109 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:57.937862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c9aece51-44a7-481d-8899-93ce49251109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:57.987354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cdc1e-5c82-48f0-9ba3-ff2c388a6f61 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:57.987667 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cdc1e-5c82-48f0-9ba3-ff2c388a6f61 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:57.987830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cdc1e-5c82-48f0-9ba3-ff2c388a6f61 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:57.989531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 441/904] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:57.994988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12567f-bbb8-45d8-b015-28cc5b560b03 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:57.995273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12567f-bbb8-45d8-b015-28cc5b560b03 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:57.995555 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12567f-bbb8-45d8-b015-28cc5b560b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:58.012542 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 464/905] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:38:58.018706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-4f12567f-bbb8-45d8-b015-28cc5b560b03 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:58.018706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4f12567f-bbb8-45d8-b015-28cc5b560b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:58.059150 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:58.093924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 442/906] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:38:58.301826 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aece51-44a7-481d-8899-93ce49251109 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:58.380066 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12567f-bbb8-45d8-b015-28cc5b560b03 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:58.416376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aece51-44a7-481d-8899-93ce49251109 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:58.431233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:58.465034 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961cd7c-9c13-41d2-821d-7481edc6c93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:58.465688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961cd7c-9c13-41d2-821d-7481edc6c93b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:58.465969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961cd7c-9c13-41d2-821d-7481edc6c93b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:58.466241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961cd7c-9c13-41d2-821d-7481edc6c93b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:58.467004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961cd7c-9c13-41d2-821d-7481edc6c93b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:58.469047 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961cd7c-9c13-41d2-821d-7481edc6c93b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-0961cd7c-9c13-41d2-821d-7481edc6c93b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:58.481372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:58.482352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:58.483231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:58.483231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:58.483231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:58.483231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:58.483231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:58.483231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:58.483231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:58.483231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:58.483231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:58.483231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:58.483231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:38:58.483231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:38:58.483231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:38:58.483231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:38:58.483231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 465/907] 10.222.0.72 () {56 vars in 1132 bytes} [Mon Aug 29 22:38:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:58.490059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961cd7c-9c13-41d2-821d-7481edc6c93b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:58.524860 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12567f-bbb8-45d8-b015-28cc5b560b03 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:58.574123 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd676c6-1235-41f9-987d-0da241c5de14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:58.574735 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd676c6-1235-41f9-987d-0da241c5de14 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:58.575017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd676c6-1235-41f9-987d-0da241c5de14 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:58.575295 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd676c6-1235-41f9-987d-0da241c5de14 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:58.576572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd676c6-1235-41f9-987d-0da241c5de14 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:58.577965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd676c6-1235-41f9-987d-0da241c5de14 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:58.605377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961cd7c-9c13-41d2-821d-7481edc6c93b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:58.642680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed696e-a04c-492c-9604-ae05c89c68c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:58.643298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed696e-a04c-492c-9604-ae05c89c68c5 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:58.643580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed696e-a04c-492c-9604-ae05c89c68c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:58.643856 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed696e-a04c-492c-9604-ae05c89c68c5 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:58.644528 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed696e-a04c-492c-9604-ae05c89c68c5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:58.644834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed696e-a04c-492c-9604-ae05c89c68c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:58.646211 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed696e-a04c-492c-9604-ae05c89c68c5 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:58.656318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 466/908] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Aug 29 22:38:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:38:58.657260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed696e-a04c-492c-9604-ae05c89c68c5 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:58.664612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 443/909] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Aug 29 22:38:58 2022] POST /identity/v3/services => generated 241 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:38:58.711483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:58.798263 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed696e-a04c-492c-9604-ae05c89c68c5 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:58.847844 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4e888-19de-4306-8a8c-829e1ca28416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:58.848866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e888-19de-4306-8a8c-829e1ca28416 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:58.849351 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e888-19de-4306-8a8c-829e1ca28416 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:58.849828 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e888-19de-4306-8a8c-829e1ca28416 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:58.850660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4e888-19de-4306-8a8c-829e1ca28416 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:58.851159 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4e888-19de-4306-8a8c-829e1ca28416 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:58.852781 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4e888-19de-4306-8a8c-829e1ca28416 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:58.860138 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 467/910] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Aug 29 22:38:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:58.866458 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd676c6-1235-41f9-987d-0da241c5de14 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:58.909619 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:58.991534 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd676c6-1235-41f9-987d-0da241c5de14 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:59.029026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cb817-ab5d-45c3-893a-d75f6b7ac61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:59.030038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cb817-ab5d-45c3-893a-d75f6b7ac61c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:59.030519 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cb817-ab5d-45c3-893a-d75f6b7ac61c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:59.031000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cb817-ab5d-45c3-893a-d75f6b7ac61c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:59.031903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cb817-ab5d-45c3-893a-d75f6b7ac61c None admin] RBAC: Adding query filter params (interface=public, service_id=644666274dab4d12b198992c3d286e0a, region_id=RegionOne) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:38:59.032455 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cb817-ab5d-45c3-893a-d75f6b7ac61c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:59.034038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cb817-ab5d-45c3-893a-d75f6b7ac61c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:59.042414 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 444/911] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Aug 29 22:38:58 2022] GET /identity/v3/endpoints?service_id=644666274dab4d12b198992c3d286e0a&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:38:59.048055 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4e888-19de-4306-8a8c-829e1ca28416 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:59.153444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:59.160900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4e888-19de-4306-8a8c-829e1ca28416 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:59.199023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ff35c-96ae-4d88-bcdc-2691e639c1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:59.199934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff35c-96ae-4d88-bcdc-2691e639c1b9 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:59.200394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff35c-96ae-4d88-bcdc-2691e639c1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:59.200814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff35c-96ae-4d88-bcdc-2691e639c1b9 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:59.201588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ff35c-96ae-4d88-bcdc-2691e639c1b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:59.203126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ff35c-96ae-4d88-bcdc-2691e639c1b9 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:59.210002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 468/912] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Aug 29 22:38:59 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:38:59.235442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7032f5-fd2e-4458-bb0c-d26b568304d6 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:59.235972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7032f5-fd2e-4458-bb0c-d26b568304d6 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:59.236423 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7032f5-fd2e-4458-bb0c-d26b568304d6 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:59.238313 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 445/913] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:59.244045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575be06-155f-4fdc-9370-005e3829de22 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:59.244385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575be06-155f-4fdc-9370-005e3829de22 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:59.244654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575be06-155f-4fdc-9370-005e3829de22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:59.264131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-5575be06-155f-4fdc-9370-005e3829de22 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:59.265380 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-5575be06-155f-4fdc-9370-005e3829de22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:59.348393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 469/914] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:38:59.657602 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7032f5-fd2e-4458-bb0c-d26b568304d6 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:59.746455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6ff3-a157-4ddf-8091-cbbafa7c3737 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:59.746794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6ff3-a157-4ddf-8091-cbbafa7c3737 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:59.747051 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6ff3-a157-4ddf-8091-cbbafa7c3737 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:59.748707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 470/915] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:59.754088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d9dc8-ab5f-4626-8d7f-0cb225819f20 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:59.754633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d9dc8-ab5f-4626-8d7f-0cb225819f20 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:59.754633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d9dc8-ab5f-4626-8d7f-0cb225819f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:59.765931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:59.773798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7032f5-fd2e-4458-bb0c-d26b568304d6 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:59.775553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-d80d9dc8-ab5f-4626-8d7f-0cb225819f20 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:59.777710 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d80d9dc8-ab5f-4626-8d7f-0cb225819f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:59.815338 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8631d-e2ce-41cb-aadc-9aac34902a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:59.816026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8631d-e2ce-41cb-aadc-9aac34902a4a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:59.817660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8631d-e2ce-41cb-aadc-9aac34902a4a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:59.818748 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8631d-e2ce-41cb-aadc-9aac34902a4a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:59.835055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8631d-e2ce-41cb-aadc-9aac34902a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-b4f8631d-e2ce-41cb-aadc-9aac34902a4a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:38:59.841209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:38:59.842269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:38:59.843101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:38:59.843101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:38:59.843101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:38:59.843101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:38:59.843101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:38:59.843101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:38:59.843101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:38:59.843101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:38:59.843101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:38:59.843101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:38:59.843101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:38:59.843101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:38:59.847629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 446/916] 10.222.0.72 () {56 vars in 1120 bytes} [Mon Aug 29 22:38:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:38:59.849126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8631d-e2ce-41cb-aadc-9aac34902a4a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:59.884230 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 471/917] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:38:59.974538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8631d-e2ce-41cb-aadc-9aac34902a4a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:00.012033 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143f993-7486-4248-8c1c-deb4ec19aa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:00.012597 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f993-7486-4248-8c1c-deb4ec19aa49 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:00.012879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f993-7486-4248-8c1c-deb4ec19aa49 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:00.013155 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f993-7486-4248-8c1c-deb4ec19aa49 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:00.013832 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143f993-7486-4248-8c1c-deb4ec19aa49 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:00.014134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143f993-7486-4248-8c1c-deb4ec19aa49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:00.015505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143f993-7486-4248-8c1c-deb4ec19aa49 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:00.029938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 447/918] 10.222.0.72 () {56 vars in 1115 bytes} [Mon Aug 29 22:38:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:00.031964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d9dc8-ab5f-4626-8d7f-0cb225819f20 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:00.060451 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:00.148531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d9dc8-ab5f-4626-8d7f-0cb225819f20 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:00.183018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143f993-7486-4248-8c1c-deb4ec19aa49 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:00.191256 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73e271-1441-4e74-9f9d-78b6559795d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:00.191918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73e271-1441-4e74-9f9d-78b6559795d9 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:00.192281 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73e271-1441-4e74-9f9d-78b6559795d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:00.192561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73e271-1441-4e74-9f9d-78b6559795d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:00.204565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:00.207046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73e271-1441-4e74-9f9d-78b6559795d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:00.208611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73e271-1441-4e74-9f9d-78b6559795d9 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-da73e271-1441-4e74-9f9d-78b6559795d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:39:00.232420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:00.233410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:39:00.234820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:39:00.234820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:00.234820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:00.239485 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 472/919] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:00.241893 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73e271-1441-4e74-9f9d-78b6559795d9 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:00.325201 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143f993-7486-4248-8c1c-deb4ec19aa49 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:00.329489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:00.365665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e398d-788f-44b2-b296-9793c4321333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:00.366731 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e398d-788f-44b2-b296-9793c4321333 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:00.367220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e398d-788f-44b2-b296-9793c4321333 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:00.367736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e398d-788f-44b2-b296-9793c4321333 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:00.368571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e398d-788f-44b2-b296-9793c4321333 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:00.370569 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73e271-1441-4e74-9f9d-78b6559795d9 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:00.371229 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e398d-788f-44b2-b296-9793c4321333 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-f35e398d-788f-44b2-b296-9793c4321333 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:00.384680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:00.386750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:00.388475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:00.388475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:00.388475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:00.388475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:00.388475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:00.388475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:00.388475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:00.388475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:00.388475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:00.388475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:00.388475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:39:00.388475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:00.388475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:39:00.388475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:00.395937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 448/920] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:39:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:00.395937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e398d-788f-44b2-b296-9793c4321333 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:00.428320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9e5f9-c1bc-4595-8979-884b00d17d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:00.429147 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9e5f9-c1bc-4595-8979-884b00d17d75 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:00.429435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9e5f9-c1bc-4595-8979-884b00d17d75 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:00.429747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9e5f9-c1bc-4595-8979-884b00d17d75 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:00.430408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9e5f9-c1bc-4595-8979-884b00d17d75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:00.430712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9e5f9-c1bc-4595-8979-884b00d17d75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:00.433484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9e5f9-c1bc-4595-8979-884b00d17d75 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:00.450570 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 473/921] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:00.455895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9e5f9-c1bc-4595-8979-884b00d17d75 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:00.507345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:00.528624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e398d-788f-44b2-b296-9793c4321333 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:00.567268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec3642-c3bb-43cc-a6d1-003ec1ea51e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:00.568704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec3642-c3bb-43cc-a6d1-003ec1ea51e4 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:00.569253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec3642-c3bb-43cc-a6d1-003ec1ea51e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:00.569732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec3642-c3bb-43cc-a6d1-003ec1ea51e4 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:00.570566 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec3642-c3bb-43cc-a6d1-003ec1ea51e4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:00.571071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec3642-c3bb-43cc-a6d1-003ec1ea51e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:00.572215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9e5f9-c1bc-4595-8979-884b00d17d75 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:00.572978 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec3642-c3bb-43cc-a6d1-003ec1ea51e4 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:00.578858 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 449/922] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:39:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:00.586261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec3642-c3bb-43cc-a6d1-003ec1ea51e4 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:00.605550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:00.612690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb92ea-0648-4c61-8e1d-d1fb5d85ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:00.618372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb92ea-0648-4c61-8e1d-d1fb5d85ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:00.618372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb92ea-0648-4c61-8e1d-d1fb5d85ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:00.618372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb92ea-0648-4c61-8e1d-d1fb5d85ffc0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:00.621938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb92ea-0648-4c61-8e1d-d1fb5d85ffc0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:00.623579 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb92ea-0648-4c61-8e1d-d1fb5d85ffc0 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-7beb92ea-0648-4c61-8e1d-d1fb5d85ffc0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:39:00.638033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:00.639016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:00.640690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:00.640690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:00.640690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:39:00.640690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:39:00.640690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:39:00.640690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:39:00.640690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:39:00.640690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:39:00.640690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:39:00.640690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:00.644007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 474/923] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Aug 29 22:39:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:00.645302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb92ea-0648-4c61-8e1d-d1fb5d85ffc0 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:00.704171 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec3642-c3bb-43cc-a6d1-003ec1ea51e4 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:00.741568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d249f-8331-46a1-b145-eeaae6c65d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:00.742567 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d249f-8331-46a1-b145-eeaae6c65d80 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:00.743052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d249f-8331-46a1-b145-eeaae6c65d80 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:00.743813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d249f-8331-46a1-b145-eeaae6c65d80 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:00.744803 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d249f-8331-46a1-b145-eeaae6c65d80 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:00.745474 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d249f-8331-46a1-b145-eeaae6c65d80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:00.747048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d249f-8331-46a1-b145-eeaae6c65d80 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:00.758105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 450/924] 10.222.0.72 () {56 vars in 1114 bytes} [Mon Aug 29 22:39:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:00.759154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb92ea-0648-4c61-8e1d-d1fb5d85ffc0 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:00.759500 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00091d75-e2f9-4710-86b6-b3b325464594 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:00.759789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00091d75-e2f9-4710-86b6-b3b325464594 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:00.760066 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00091d75-e2f9-4710-86b6-b3b325464594 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:00.761595 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 451/925] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:00.762927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00091d75-e2f9-4710-86b6-b3b325464594 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:00.774891 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:00.798707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77466a-7334-4442-8bea-11674903d18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:00.799316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77466a-7334-4442-8bea-11674903d18f None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:00.799595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77466a-7334-4442-8bea-11674903d18f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:00.799868 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77466a-7334-4442-8bea-11674903d18f None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:00.800643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77466a-7334-4442-8bea-11674903d18f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:00.800938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77466a-7334-4442-8bea-11674903d18f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:00.802358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77466a-7334-4442-8bea-11674903d18f None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:00.825649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 475/926] 10.222.0.72 () {56 vars in 1149 bytes} [Mon Aug 29 22:39:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:00.825649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f1e48-7d37-4542-8351-7844d17fbcdf None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:00.825649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f1e48-7d37-4542-8351-7844d17fbcdf None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:00.825649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f1e48-7d37-4542-8351-7844d17fbcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:00.841802 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-702f1e48-7d37-4542-8351-7844d17fbcdf None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:00.842905 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-702f1e48-7d37-4542-8351-7844d17fbcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:00.893873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:00.906848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00091d75-e2f9-4710-86b6-b3b325464594 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:00.925621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 476/927] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:00.927128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f1e48-7d37-4542-8351-7844d17fbcdf None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:00.966046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aeda59-eda4-4aa4-95dc-ec405fa9f59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:00.966831 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aeda59-eda4-4aa4-95dc-ec405fa9f59b None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:00.967212 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aeda59-eda4-4aa4-95dc-ec405fa9f59b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:00.967609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aeda59-eda4-4aa4-95dc-ec405fa9f59b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:00.968784 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aeda59-eda4-4aa4-95dc-ec405fa9f59b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:00.971224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aeda59-eda4-4aa4-95dc-ec405fa9f59b None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:01.042046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f1e48-7d37-4542-8351-7844d17fbcdf None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:01.064635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 452/928] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:39:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:39:01.101748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7886a2a-0140-4e3d-b06b-9304626b91e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:01.103093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7886a2a-0140-4e3d-b06b-9304626b91e8 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:01.103622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7886a2a-0140-4e3d-b06b-9304626b91e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:01.104150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7886a2a-0140-4e3d-b06b-9304626b91e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:01.118272 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7886a2a-0140-4e3d-b06b-9304626b91e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:01.120495 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7886a2a-0140-4e3d-b06b-9304626b91e8 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-f7886a2a-0140-4e3d-b06b-9304626b91e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:39:01.140950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:01.141940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:39:01.142870 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:39:01.142870 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:01.142870 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:01.149148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 477/929] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:01.152654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aeda59-eda4-4aa4-95dc-ec405fa9f59b None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:01.205339 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7886a2a-0140-4e3d-b06b-9304626b91e8 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:01.237846 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:01.241487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:01.287473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aeda59-eda4-4aa4-95dc-ec405fa9f59b None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:01.324556 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2510f-a811-4c10-b850-cae7186d69db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:01.325181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2510f-a811-4c10-b850-cae7186d69db None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:01.325462 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2510f-a811-4c10-b850-cae7186d69db None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:01.325734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2510f-a811-4c10-b850-cae7186d69db None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:01.326391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2510f-a811-4c10-b850-cae7186d69db None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:01.326678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2510f-a811-4c10-b850-cae7186d69db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:01.328044 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2510f-a811-4c10-b850-cae7186d69db None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:01.328790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7886a2a-0140-4e3d-b06b-9304626b91e8 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:01.344146 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 453/930] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:01.345753 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78e9e-9d30-4eda-9671-be5189a8fc76 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:01.346036 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78e9e-9d30-4eda-9671-be5189a8fc76 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:01.346304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78e9e-9d30-4eda-9671-be5189a8fc76 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:01.348676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 454/931] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:01.349465 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e78e9e-9d30-4eda-9671-be5189a8fc76 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:01.374498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cad4f-0632-472c-a62b-396b52757199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:01.375224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cad4f-0632-472c-a62b-396b52757199 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:01.375611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cad4f-0632-472c-a62b-396b52757199 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:01.375883 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cad4f-0632-472c-a62b-396b52757199 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:01.376764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cad4f-0632-472c-a62b-396b52757199 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:01.378833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cad4f-0632-472c-a62b-396b52757199 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-a70cad4f-0632-472c-a62b-396b52757199 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:01.389595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:01.390610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:01.391423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:01.391423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:01.391423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:01.391423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:01.391423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:01.391423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:01.391423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:01.391423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:01.391423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:01.391423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:01.391423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:39:01.391423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:01.391423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:39:01.391423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:01.391423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 478/932] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Aug 29 22:39:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:01.392302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a750b-3262-4d9b-8b06-9a75e29cbc0a None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:01.392889 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a750b-3262-4d9b-8b06-9a75e29cbc0a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:01.392889 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a750b-3262-4d9b-8b06-9a75e29cbc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:01.414242 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-154a750b-3262-4d9b-8b06-9a75e29cbc0a None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:01.415499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-154a750b-3262-4d9b-8b06-9a75e29cbc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:01.473583 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e78e9e-9d30-4eda-9671-be5189a8fc76 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:01.496240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 479/933] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:01.496240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a750b-3262-4d9b-8b06-9a75e29cbc0a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:01.517941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:01.521092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:01.536060 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13878a-d876-4b67-9a08-eab1b4f312c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:01.537576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13878a-d876-4b67-9a08-eab1b4f312c0 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:01.538043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13878a-d876-4b67-9a08-eab1b4f312c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:01.538520 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13878a-d876-4b67-9a08-eab1b4f312c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:01.547269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13878a-d876-4b67-9a08-eab1b4f312c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:01.548694 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13878a-d876-4b67-9a08-eab1b4f312c0 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:01.562197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-2b13878a-d876-4b67-9a08-eab1b4f312c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:39:01.562197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:01.562197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:01.562197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:01.562197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:01.562197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:01.562197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:01.562197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:01.562197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:01.562197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:01.562197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:01.562197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:01.562197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:39:01.562197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:39:01.562197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:01.569115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:01.569992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:39:01.569992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:39:01.569992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:39:01.569992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:39:01.569992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:39:01.569992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:39:01.569992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:39:01.569992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:01.569992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 455/934] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:39:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:01.573386 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13878a-d876-4b67-9a08-eab1b4f312c0 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:01.624702 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a750b-3262-4d9b-8b06-9a75e29cbc0a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:01.668015 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f13ff-2ccc-4402-ad79-afe68b73acb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:01.669018 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f13ff-2ccc-4402-ad79-afe68b73acb3 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:01.669481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f13ff-2ccc-4402-ad79-afe68b73acb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:01.669897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f13ff-2ccc-4402-ad79-afe68b73acb3 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:01.670804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f13ff-2ccc-4402-ad79-afe68b73acb3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:01.671253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f13ff-2ccc-4402-ad79-afe68b73acb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:01.672927 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f13ff-2ccc-4402-ad79-afe68b73acb3 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:01.678931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 480/935] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Aug 29 22:39:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:01.685709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f13ff-2ccc-4402-ad79-afe68b73acb3 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:01.700722 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13878a-d876-4b67-9a08-eab1b4f312c0 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:01.748366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a8088-bdc2-4179-8f4b-3d4e0b61da89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:01.749314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a8088-bdc2-4179-8f4b-3d4e0b61da89 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:01.750026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a8088-bdc2-4179-8f4b-3d4e0b61da89 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:01.750875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a8088-bdc2-4179-8f4b-3d4e0b61da89 None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:01.751795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a8088-bdc2-4179-8f4b-3d4e0b61da89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:01.752313 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a8088-bdc2-4179-8f4b-3d4e0b61da89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:01.754776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a8088-bdc2-4179-8f4b-3d4e0b61da89 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:01.776302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 456/936] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:39:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:01.777255 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a8088-bdc2-4179-8f4b-3d4e0b61da89 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:01.797336 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:01.814690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f13ff-2ccc-4402-ad79-afe68b73acb3 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:01.831388 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:01.852029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a79374-7e2e-46e9-9a11-e8208c465c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:01.852685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a79374-7e2e-46e9-9a11-e8208c465c89 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:01.852967 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a79374-7e2e-46e9-9a11-e8208c465c89 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:01.853237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a79374-7e2e-46e9-9a11-e8208c465c89 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:01.854383 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a79374-7e2e-46e9-9a11-e8208c465c89 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:01.854898 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a79374-7e2e-46e9-9a11-e8208c465c89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:01.856551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a79374-7e2e-46e9-9a11-e8208c465c89 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:01.861881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 481/937] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Aug 29 22:39:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:01.862475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a79374-7e2e-46e9-9a11-e8208c465c89 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:01.898663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a8088-bdc2-4179-8f4b-3d4e0b61da89 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:01.943429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba7cc1-ab8a-48b7-8d18-a8de29ebe344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:01.944068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba7cc1-ab8a-48b7-8d18-a8de29ebe344 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:01.944379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba7cc1-ab8a-48b7-8d18-a8de29ebe344 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:01.944655 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba7cc1-ab8a-48b7-8d18-a8de29ebe344 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:01.945246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba7cc1-ab8a-48b7-8d18-a8de29ebe344 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:01.946665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba7cc1-ab8a-48b7-8d18-a8de29ebe344 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-dbba7cc1-ab8a-48b7-8d18-a8de29ebe344 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:01.956767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:01.957934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:01.959765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:01.959765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:01.959765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:01.959765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:01.959765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:01.959765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:01.959765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:01.959765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:01.959765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:01.959765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:01.959765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:39:01.959765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:01.959765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:39:01.959765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:01.959765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 457/938] 10.222.0.72 () {56 vars in 1132 bytes} [Mon Aug 29 22:39:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:01.961186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba7cc1-ab8a-48b7-8d18-a8de29ebe344 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:01.977050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a79374-7e2e-46e9-9a11-e8208c465c89 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:02.022078 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647dcf0-c908-497c-814c-4153d317cc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:02.022818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647dcf0-c908-497c-814c-4153d317cc56 None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:02.023008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647dcf0-c908-497c-814c-4153d317cc56 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:02.023283 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647dcf0-c908-497c-814c-4153d317cc56 None admin] PATH_INFO: `/v3/projects/7abc4d6c6e004b15abff7738164175db/users/e7b1650890fe409091ddbc881ee28973/roles/136e6370b0c7476f898673d4d697ed28` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:02.025529 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647dcf0-c908-497c-814c-4153d317cc56 None admin] RBAC: Authorizing `identity:create_grant(project_id=7abc4d6c6e004b15abff7738164175db, user_id=e7b1650890fe409091ddbc881ee28973, role_id=136e6370b0c7476f898673d4d697ed28)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:02.027522 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647dcf0-c908-497c-814c-4153d317cc56 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:02.070317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba7cc1-ab8a-48b7-8d18-a8de29ebe344 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:02.079846 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:02.106896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d395673-e98f-4251-b690-69445c20a1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:02.107519 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d395673-e98f-4251-b690-69445c20a1fe None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:02.107798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d395673-e98f-4251-b690-69445c20a1fe None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:02.108075 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d395673-e98f-4251-b690-69445c20a1fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:02.108814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d395673-e98f-4251-b690-69445c20a1fe None admin] RBAC: Adding query filter params (interface=public, service_id=6fd5db7fbd8342e68981bf1cd82d3307, region_id=RegionOne) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:02.109131 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d395673-e98f-4251-b690-69445c20a1fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:02.110499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d395673-e98f-4251-b690-69445c20a1fe None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:02.116611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 458/939] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Aug 29 22:39:01 2022] GET /identity/v3/endpoints?service_id=6fd5db7fbd8342e68981bf1cd82d3307&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:02.121545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d395673-e98f-4251-b690-69445c20a1fe None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:02.132553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 482/940] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:39:01 2022] PUT /identity/v3/projects/7abc4d6c6e004b15abff7738164175db/users/e7b1650890fe409091ddbc881ee28973/roles/136e6370b0c7476f898673d4d697ed28 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:02.133608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647dcf0-c908-497c-814c-4153d317cc56 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:02.155432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:02.255622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d395673-e98f-4251-b690-69445c20a1fe None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:02.269606 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647dcf0-c908-497c-814c-4153d317cc56 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:02.297323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefea128-9242-4fa1-a938-4607f738533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:02.298554 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefea128-9242-4fa1-a938-4607f738533a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:02.298842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefea128-9242-4fa1-a938-4607f738533a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:02.299119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefea128-9242-4fa1-a938-4607f738533a None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:02.300333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefea128-9242-4fa1-a938-4607f738533a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:02.300333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefea128-9242-4fa1-a938-4607f738533a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:02.301715 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefea128-9242-4fa1-a938-4607f738533a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:02.308952 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 459/941] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Aug 29 22:39:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:02.314289 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefea128-9242-4fa1-a938-4607f738533a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:02.315950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9dcdc-6603-48a4-ba49-f778ef471572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:02.316806 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9dcdc-6603-48a4-ba49-f778ef471572 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:02.317198 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9dcdc-6603-48a4-ba49-f778ef471572 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:02.317599 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9dcdc-6603-48a4-ba49-f778ef471572 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:02.318322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9dcdc-6603-48a4-ba49-f778ef471572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:02.319811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9dcdc-6603-48a4-ba49-f778ef471572 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:02.328298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 483/942] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Aug 29 22:39:02 2022] GET /identity/v3/services => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:39:02.372408 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:02.446249 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefea128-9242-4fa1-a938-4607f738533a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:02.487352 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa9889-9ea0-40cb-adaa-643a7764165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:02.487976 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa9889-9ea0-40cb-adaa-643a7764165d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:02.488409 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa9889-9ea0-40cb-adaa-643a7764165d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:02.488835 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa9889-9ea0-40cb-adaa-643a7764165d None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:02.489522 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa9889-9ea0-40cb-adaa-643a7764165d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:02.489828 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa9889-9ea0-40cb-adaa-643a7764165d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:02.491227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa9889-9ea0-40cb-adaa-643a7764165d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:02.497856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 460/943] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Aug 29 22:39:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:02.503154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9dcdc-6603-48a4-ba49-f778ef471572 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:02.585620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:02.617736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9dcdc-6603-48a4-ba49-f778ef471572 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:02.656165 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410cb46-c380-44b3-b9c3-2d2706b12784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:02.656915 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410cb46-c380-44b3-b9c3-2d2706b12784 None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:02.657197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410cb46-c380-44b3-b9c3-2d2706b12784 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:02.657471 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410cb46-c380-44b3-b9c3-2d2706b12784 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:02.658167 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410cb46-c380-44b3-b9c3-2d2706b12784 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:02.659540 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410cb46-c380-44b3-b9c3-2d2706b12784 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:02.756509 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 484/944] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:39:02 2022] POST /identity/v3/endpoints => generated 347 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:03.116598 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719c31a-f682-44c1-aafb-7b2a24e76df4 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:03.117090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719c31a-f682-44c1-aafb-7b2a24e76df4 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:03.117090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719c31a-f682-44c1-aafb-7b2a24e76df4 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:03.118654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 461/945] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:03.124860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc8a69-c354-42c7-8f31-203ce71e2cce None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:03.125152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc8a69-c354-42c7-8f31-203ce71e2cce None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:03.125435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc8a69-c354-42c7-8f31-203ce71e2cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:03.145864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-94fc8a69-c354-42c7-8f31-203ce71e2cce None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:03.147077 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-94fc8a69-c354-42c7-8f31-203ce71e2cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:03.233408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 485/946] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:03.518535 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719c31a-f682-44c1-aafb-7b2a24e76df4 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:03.626867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:03.631389 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719c31a-f682-44c1-aafb-7b2a24e76df4 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:03.671864 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dc951-0e1f-405a-b986-bcbb11668a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:03.672512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc951-0e1f-405a-b986-bcbb11668a02 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:03.672799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc951-0e1f-405a-b986-bcbb11668a02 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:03.673070 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc951-0e1f-405a-b986-bcbb11668a02 None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:03.673733 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dc951-0e1f-405a-b986-bcbb11668a02 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:03.675162 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dc951-0e1f-405a-b986-bcbb11668a02 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:03.677924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: WARNING keystone.server.flask.common [None req-ea4dc951-0e1f-405a-b986-bcbb11668a02 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 22:39:03.726601 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.sql.core [None req-ea4dc951-0e1f-405a-b986-bcbb11668a02 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 22:39:03.726601 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 22:39:03.726601 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [parameters: {'id': '0febd8b2c81742e299bb83435e4ad3d2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 22:39:03.726601 dv-cinder-854271-4-smb devstack@keystone.service[88553]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88553) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 22:39:03.735119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-ea4dc951-0e1f-405a-b986-bcbb11668a02 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0febd8b2c81742e299bb83435e4ad3d2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0febd8b2c81742e299bb83435e4ad3d2. Aug 29 22:39:03.735119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:03.735119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:39:03.735119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:39:03.735119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:39:03.735119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:39:03.735119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:39:03.735119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:39:03.735119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:39:03.735119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:39:03.735119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:39:03.735119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:39:03.735119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application result.read() Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 22:39:03.735958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application yield resource Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise self.value Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application session.commit() Aug 29 22:39:03.737539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self.session.flush() Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application compat.raise_( Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 22:39:03.738518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 22:39:03.739395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 22:39:03.739395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 22:39:03.739395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 22:39:03.739395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 22:39:03.739395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 22:39:03.739395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 22:39:03.739395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 22:39:03.739395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 22:39:03.739395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 22:39:03.739395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 22:39:03.739395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 22:39:03.739395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 22:39:03.739395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 22:39:03.739395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 22:39:03.739395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application result.read() Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:39:03.740174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:39:03.742003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:39:03.742003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:39:03.742003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:39:03.742003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:39:03.742003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:39:03.742003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:39:03.742003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 22:39:03.742003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 22:39:03.742003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [parameters: {'id': '0febd8b2c81742e299bb83435e4ad3d2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 22:39:03.742003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 22:39:03.742003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:03.742003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:03.742003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:03.742003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:03.742003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:03.743822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:03.752793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:03.752793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 22:39:03.752793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 22:39:03.752793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:03.752793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:03.752793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 22:39:03.752793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 22:39:03.752793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0febd8b2c81742e299bb83435e4ad3d2. Aug 29 22:39:03.752793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:03.752793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 462/947] 10.222.0.72 () {60 vars in 1140 bytes} [Mon Aug 29 22:39:03 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:03.753473 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc8a69-c354-42c7-8f31-203ce71e2cce None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:03.806346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:03.856408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc8a69-c354-42c7-8f31-203ce71e2cce None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:03.896433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5363ab8-37c6-4ad7-8bc3-3c1ac461bc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:03.897486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5363ab8-37c6-4ad7-8bc3-3c1ac461bc43 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:03.897986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5363ab8-37c6-4ad7-8bc3-3c1ac461bc43 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:03.898559 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5363ab8-37c6-4ad7-8bc3-3c1ac461bc43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:03.907526 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5363ab8-37c6-4ad7-8bc3-3c1ac461bc43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:03.909405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5363ab8-37c6-4ad7-8bc3-3c1ac461bc43 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:03.922670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-a5363ab8-37c6-4ad7-8bc3-3c1ac461bc43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:39:03.922670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:03.922670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:03.922670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:03.922670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:03.922670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:03.922670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:03.922670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:03.922670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:03.922670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:03.922670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:03.922670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:03.922670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:39:03.922670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:39:03.922670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:03.923735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:03.924801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:39:03.924801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:39:03.924801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:39:03.924801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:39:03.924801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:39:03.924801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:39:03.924801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:39:03.924801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:03.926990 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 486/948] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:39:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:03.934290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dc951-0e1f-405a-b986-bcbb11668a02 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:04.044958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dc951-0e1f-405a-b986-bcbb11668a02 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:04.085134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b4dbc-f254-44bd-9c1e-c5b2885866af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:04.086009 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b4dbc-f254-44bd-9c1e-c5b2885866af None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:04.086442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b4dbc-f254-44bd-9c1e-c5b2885866af None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:04.086895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b4dbc-f254-44bd-9c1e-c5b2885866af None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:04.087722 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b4dbc-f254-44bd-9c1e-c5b2885866af None admin] RBAC: Adding query filter params (name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:04.088330 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b4dbc-f254-44bd-9c1e-c5b2885866af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:04.090265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b4dbc-f254-44bd-9c1e-c5b2885866af None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:04.113390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 463/949] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Aug 29 22:39:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:04.337012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3197a81-3e92-4295-83ec-0572440a735d None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:04.337499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3197a81-3e92-4295-83ec-0572440a735d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:04.337499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3197a81-3e92-4295-83ec-0572440a735d None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:04.339842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 487/950] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:04.345610 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9336b-1eaa-4e58-88b8-265e330045bd None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:04.346850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9336b-1eaa-4e58-88b8-265e330045bd None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:04.347339 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9336b-1eaa-4e58-88b8-265e330045bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:04.367819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-8bd9336b-1eaa-4e58-88b8-265e330045bd None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:04.369812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8bd9336b-1eaa-4e58-88b8-265e330045bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:04.382117 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:04.457045 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 464/951] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:04.524649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945f2c-2c3a-407f-8543-a8ba080e8202 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:04.524964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945f2c-2c3a-407f-8543-a8ba080e8202 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:04.525208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945f2c-2c3a-407f-8543-a8ba080e8202 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:04.527565 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 488/952] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:04.532884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92ac85-b0b8-4182-b811-260844b14fbe None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:04.533172 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92ac85-b0b8-4182-b811-260844b14fbe None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:04.533449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92ac85-b0b8-4182-b811-260844b14fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:04.553700 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-1f92ac85-b0b8-4182-b811-260844b14fbe None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:04.554906 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1f92ac85-b0b8-4182-b811-260844b14fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:04.632395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 465/953] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:39:04.734966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75945f2c-2c3a-407f-8543-a8ba080e8202 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:04.783686 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583cef0-a5dd-47e4-9946-71dfb245b4b2 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:04.784072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583cef0-a5dd-47e4-9946-71dfb245b4b2 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:04.784791 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583cef0-a5dd-47e4-9946-71dfb245b4b2 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:04.786811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 466/954] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:39:04.792571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2d9aa-3922-4762-bf38-89344fdf4e15 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:04.792880 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2d9aa-3922-4762-bf38-89344fdf4e15 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:04.793159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2d9aa-3922-4762-bf38-89344fdf4e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:04.812274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-c7e2d9aa-3922-4762-bf38-89344fdf4e15 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:04.813491 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c7e2d9aa-3922-4762-bf38-89344fdf4e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:04.851771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75945f2c-2c3a-407f-8543-a8ba080e8202 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:04.868609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:04.896343 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 467/955] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:39:04.896522 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02413d18-0a57-47cd-a9fa-b786a8d485de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:04.896522 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02413d18-0a57-47cd-a9fa-b786a8d485de None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:04.896522 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02413d18-0a57-47cd-a9fa-b786a8d485de None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:04.896522 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02413d18-0a57-47cd-a9fa-b786a8d485de None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:04.905754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02413d18-0a57-47cd-a9fa-b786a8d485de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:39:04.909192 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2d9aa-3922-4762-bf38-89344fdf4e15 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-02413d18-0a57-47cd-a9fa-b786a8d485de None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:39:04.911770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:04.913355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:04.914249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:04.914249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:04.914249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:04.914249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:04.914249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:39:04.914249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:39:04.914249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:39:04.914249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:39:04.914249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:39:04.914249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:39:04.914249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:39:04.914249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:04.919446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 489/956] 10.222.0.72 () {56 vars in 1120 bytes} [Mon Aug 29 22:39:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:04.920462 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02413d18-0a57-47cd-a9fa-b786a8d485de None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:04.923369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:05.023273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2d9aa-3922-4762-bf38-89344fdf4e15 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.037954 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02413d18-0a57-47cd-a9fa-b786a8d485de None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.059944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df76c64-9eee-455c-ae07-75395bcab845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:05.060609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df76c64-9eee-455c-ae07-75395bcab845 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.060888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df76c64-9eee-455c-ae07-75395bcab845 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.061153 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df76c64-9eee-455c-ae07-75395bcab845 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.061740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df76c64-9eee-455c-ae07-75395bcab845 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:05.063110 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df76c64-9eee-455c-ae07-75395bcab845 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-1df76c64-9eee-455c-ae07-75395bcab845 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:05.072376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:05.075357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:05.077691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:05.077691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:05.077691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:05.077691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:05.077691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:05.077691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:05.077691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:05.077691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:05.077691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:05.077691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:05.077691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:39:05.077691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:05.077691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:39:05.077691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:05.077691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 468/957] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Aug 29 22:39:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:05.088692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df76c64-9eee-455c-ae07-75395bcab845 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.088987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb12da3-b0df-4327-a964-2e4d11df60cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:05.088987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb12da3-b0df-4327-a964-2e4d11df60cf None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.088987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb12da3-b0df-4327-a964-2e4d11df60cf None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.088987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb12da3-b0df-4327-a964-2e4d11df60cf None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.089640 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb12da3-b0df-4327-a964-2e4d11df60cf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:05.089640 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb12da3-b0df-4327-a964-2e4d11df60cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:05.089640 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb12da3-b0df-4327-a964-2e4d11df60cf None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:05.099082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 490/958] 10.222.0.72 () {56 vars in 1115 bytes} [Mon Aug 29 22:39:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:05.105047 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb12da3-b0df-4327-a964-2e4d11df60cf None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.156022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:05.180463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:05.214873 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df76c64-9eee-455c-ae07-75395bcab845 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.247073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb12da3-b0df-4327-a964-2e4d11df60cf None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.251994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a2678-bb4b-484d-9db9-26fc4ebcaa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:05.252646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a2678-bb4b-484d-9db9-26fc4ebcaa23 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.252921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a2678-bb4b-484d-9db9-26fc4ebcaa23 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.253191 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a2678-bb4b-484d-9db9-26fc4ebcaa23 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.253830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a2678-bb4b-484d-9db9-26fc4ebcaa23 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:05.254129 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a2678-bb4b-484d-9db9-26fc4ebcaa23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:05.255597 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a2678-bb4b-484d-9db9-26fc4ebcaa23 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:05.266773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 469/959] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Aug 29 22:39:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:05.266773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a2678-bb4b-484d-9db9-26fc4ebcaa23 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.291192 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086805e-571b-4232-9d8b-01ad65446102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:05.292066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086805e-571b-4232-9d8b-01ad65446102 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.292312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086805e-571b-4232-9d8b-01ad65446102 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.292588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086805e-571b-4232-9d8b-01ad65446102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.309010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086805e-571b-4232-9d8b-01ad65446102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:05.310468 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086805e-571b-4232-9d8b-01ad65446102 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-b086805e-571b-4232-9d8b-01ad65446102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:39:05.327023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:05.328045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:39:05.329739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:39:05.329739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:05.329739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:05.329739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 491/960] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:05.329739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086805e-571b-4232-9d8b-01ad65446102 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.391391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a2678-bb4b-484d-9db9-26fc4ebcaa23 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.432831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:05.436938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adfd2f-8a8c-49fa-9b3c-f81392459249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:05.437586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adfd2f-8a8c-49fa-9b3c-f81392459249 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.437867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adfd2f-8a8c-49fa-9b3c-f81392459249 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.438140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adfd2f-8a8c-49fa-9b3c-f81392459249 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.438733 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adfd2f-8a8c-49fa-9b3c-f81392459249 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:05.440099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adfd2f-8a8c-49fa-9b3c-f81392459249 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:05.442042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:05.447332 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086805e-571b-4232-9d8b-01ad65446102 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-d7adfd2f-8a8c-49fa-9b3c-f81392459249 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:05.456091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:05.457098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:05.457985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:05.457985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:05.457985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:05.457985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:05.457985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:05.457985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:05.457985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:05.457985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:05.457985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:05.457985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:05.457985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:39:05.457985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:05.457985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:39:05.457985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:05.457985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 470/961] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:39:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:05.458777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adfd2f-8a8c-49fa-9b3c-f81392459249 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.491247 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b5120-c45b-47ff-abb1-36810e7bcbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:05.491863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b5120-c45b-47ff-abb1-36810e7bcbfd None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.492145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b5120-c45b-47ff-abb1-36810e7bcbfd None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.492450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b5120-c45b-47ff-abb1-36810e7bcbfd None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.493144 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b5120-c45b-47ff-abb1-36810e7bcbfd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:05.493392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b5120-c45b-47ff-abb1-36810e7bcbfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:05.495427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b5120-c45b-47ff-abb1-36810e7bcbfd None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:05.500593 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 492/962] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Aug 29 22:39:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:05.500593 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b5120-c45b-47ff-abb1-36810e7bcbfd None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.571175 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adfd2f-8a8c-49fa-9b3c-f81392459249 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.611338 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95b6ab-7617-4e49-bf38-7491f799ab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:05.611985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95b6ab-7617-4e49-bf38-7491f799ab52 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.612397 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95b6ab-7617-4e49-bf38-7491f799ab52 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.612683 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95b6ab-7617-4e49-bf38-7491f799ab52 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.613340 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95b6ab-7617-4e49-bf38-7491f799ab52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:05.613645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95b6ab-7617-4e49-bf38-7491f799ab52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:05.615011 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95b6ab-7617-4e49-bf38-7491f799ab52 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:05.618724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b5120-c45b-47ff-abb1-36810e7bcbfd None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.628863 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 471/963] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:05.629509 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95b6ab-7617-4e49-bf38-7491f799ab52 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.661659 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a7984-e6e4-4019-a811-61e4f16fe48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:05.662319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a7984-e6e4-4019-a811-61e4f16fe48e None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.662598 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a7984-e6e4-4019-a811-61e4f16fe48e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.662867 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a7984-e6e4-4019-a811-61e4f16fe48e None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.663492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a7984-e6e4-4019-a811-61e4f16fe48e None admin] RBAC: Adding query filter params (name=compute) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:05.663789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a7984-e6e4-4019-a811-61e4f16fe48e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:05.665189 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a7984-e6e4-4019-a811-61e4f16fe48e None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:05.670399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 493/964] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Aug 29 22:39:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:05.671199 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a7984-e6e4-4019-a811-61e4f16fe48e None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.696909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:05.706888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:05.751449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95b6ab-7617-4e49-bf38-7491f799ab52 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.789016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe60a3a-246b-42b1-8c56-42f01ec006b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:05.789655 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe60a3a-246b-42b1-8c56-42f01ec006b1 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.789916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe60a3a-246b-42b1-8c56-42f01ec006b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.790198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe60a3a-246b-42b1-8c56-42f01ec006b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.790908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe60a3a-246b-42b1-8c56-42f01ec006b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:05.792531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a7984-e6e4-4019-a811-61e4f16fe48e None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.792660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe60a3a-246b-42b1-8c56-42f01ec006b1 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:05.830647 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29b5dc-1de2-41e3-b213-3d68306c292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:05.831282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b5dc-1de2-41e3-b213-3d68306c292b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.831617 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b5dc-1de2-41e3-b213-3d68306c292b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.831876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b5dc-1de2-41e3-b213-3d68306c292b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.841053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29b5dc-1de2-41e3-b213-3d68306c292b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:05.842513 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29b5dc-1de2-41e3-b213-3d68306c292b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-0f29b5dc-1de2-41e3-b213-3d68306c292b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:39:05.855012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:05.856434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:05.857726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:05.857726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:05.857726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:39:05.857726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:39:05.857726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:39:05.857726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:39:05.857726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:39:05.857726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:39:05.857726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:39:05.857726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:05.861169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 494/965] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Aug 29 22:39:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:05.863785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29b5dc-1de2-41e3-b213-3d68306c292b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.868251 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 472/966] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:39:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:05.869906 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe60a3a-246b-42b1-8c56-42f01ec006b1 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.960892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:05.988959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29b5dc-1de2-41e3-b213-3d68306c292b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.035417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe60a3a-246b-42b1-8c56-42f01ec006b1 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.040300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29665d-b34c-4dec-b72b-d2a49fdeb2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.041212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29665d-b34c-4dec-b72b-d2a49fdeb2dd None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.041842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29665d-b34c-4dec-b72b-d2a49fdeb2dd None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.042407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29665d-b34c-4dec-b72b-d2a49fdeb2dd None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.043221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29665d-b34c-4dec-b72b-d2a49fdeb2dd None admin] RBAC: Adding query filter params (type=compute) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:06.043794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29665d-b34c-4dec-b72b-d2a49fdeb2dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.045441 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29665d-b34c-4dec-b72b-d2a49fdeb2dd None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.051959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 495/967] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Aug 29 22:39:05 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:06.052578 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:06.085989 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a96d49-c1d8-43e0-b2fa-2fadf91118bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.087193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a96d49-c1d8-43e0-b2fa-2fadf91118bf None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.087678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a96d49-c1d8-43e0-b2fa-2fadf91118bf None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.087957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a96d49-c1d8-43e0-b2fa-2fadf91118bf None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.088926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a96d49-c1d8-43e0-b2fa-2fadf91118bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:06.089235 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a96d49-c1d8-43e0-b2fa-2fadf91118bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.090704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a96d49-c1d8-43e0-b2fa-2fadf91118bf None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.118751 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 473/968] 10.222.0.72 () {56 vars in 1149 bytes} [Mon Aug 29 22:39:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:06.126230 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29665d-b34c-4dec-b72b-d2a49fdeb2dd None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.246216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f40729-61bd-4a29-a67d-091ada32e9c0 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.246569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f40729-61bd-4a29-a67d-091ada32e9c0 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.246794 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f40729-61bd-4a29-a67d-091ada32e9c0 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.248405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 474/969] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:06.254383 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c394c-dbd7-4da4-b476-479425a10ac8 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.255231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c394c-dbd7-4da4-b476-479425a10ac8 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.255709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c394c-dbd7-4da4-b476-479425a10ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.256955 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29665d-b34c-4dec-b72b-d2a49fdeb2dd None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.276380 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-d08c394c-dbd7-4da4-b476-479425a10ac8 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:06.277741 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d08c394c-dbd7-4da4-b476-479425a10ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:06.297526 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b3f6f-ee69-4e24-a527-7c1c34910e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.298648 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b3f6f-ee69-4e24-a527-7c1c34910e69 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.299258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b3f6f-ee69-4e24-a527-7c1c34910e69 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.299540 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b3f6f-ee69-4e24-a527-7c1c34910e69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.303749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:06.368791 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 475/970] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:06.386734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b3f6f-ee69-4e24-a527-7c1c34910e69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.388226 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b3f6f-ee69-4e24-a527-7c1c34910e69 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.508808 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 496/971] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:39:06 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:39:06.517321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c394c-dbd7-4da4-b476-479425a10ac8 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.628582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:06.633142 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c394c-dbd7-4da4-b476-479425a10ac8 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.650940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b3f6f-ee69-4e24-a527-7c1c34910e69 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.673288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4686dc-1a42-47d8-80e3-c1eb9cc767c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.674319 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4686dc-1a42-47d8-80e3-c1eb9cc767c9 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.674826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4686dc-1a42-47d8-80e3-c1eb9cc767c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.675306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4686dc-1a42-47d8-80e3-c1eb9cc767c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.687126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4686dc-1a42-47d8-80e3-c1eb9cc767c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.688965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4686dc-1a42-47d8-80e3-c1eb9cc767c9 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.691612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-1e4686dc-1a42-47d8-80e3-c1eb9cc767c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:39:06.705884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:06.706909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:39:06.707797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:39:06.707797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:06.707797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:06.709979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 476/972] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:06.717345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4686dc-1a42-47d8-80e3-c1eb9cc767c9 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.768963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b3f6f-ee69-4e24-a527-7c1c34910e69 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.811220 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68372b19-a92b-478b-b51f-dc2ea65020e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.811890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372b19-a92b-478b-b51f-dc2ea65020e0 None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.812178 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372b19-a92b-478b-b51f-dc2ea65020e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.812495 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372b19-a92b-478b-b51f-dc2ea65020e0 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.813164 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68372b19-a92b-478b-b51f-dc2ea65020e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.814676 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68372b19-a92b-478b-b51f-dc2ea65020e0 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.817687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: WARNING keystone.server.flask.common [None req-68372b19-a92b-478b-b51f-dc2ea65020e0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 22:39:06.845061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4686dc-1a42-47d8-80e3-c1eb9cc767c9 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:06.862180 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.sql.core [None req-68372b19-a92b-478b-b51f-dc2ea65020e0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 22:39:06.862180 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 22:39:06.862180 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [parameters: {'user_id': 'dc6f57f6464e4e94a878262b776ff329', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 22:39:06.862180 dv-cinder-854271-4-smb devstack@keystone.service[88552]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88552) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 22:39:06.882324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87690f44-23f9-4dcb-b45b-3fa72344f0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.882945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87690f44-23f9-4dcb-b45b-3fa72344f0c6 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.883320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87690f44-23f9-4dcb-b45b-3fa72344f0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.883599 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87690f44-23f9-4dcb-b45b-3fa72344f0c6 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.884317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87690f44-23f9-4dcb-b45b-3fa72344f0c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:06.884638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87690f44-23f9-4dcb-b45b-3fa72344f0c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-68372b19-a92b-478b-b51f-dc2ea65020e0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 22:39:06.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:06.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:39:06.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:39:06.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:39:06.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:39:06.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:39:06.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:39:06.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:39:06.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:39:06.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:39:06.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:39:06.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:39:06.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application result.read() Aug 29 22:39:06.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:39:06.886855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application yield resource Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise self.value Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application session.commit() Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 22:39:06.887774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self.session.flush() Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application compat.raise_( Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 22:39:06.901498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:39:06.902414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application result.read() Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:39:06.903255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:39:06.904102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:39:06.904102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:39:06.904102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:39:06.904102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:39:06.904102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 22:39:06.904102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 22:39:06.904102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [parameters: {'user_id': 'dc6f57f6464e4e94a878262b776ff329', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 22:39:06.904102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 22:39:06.904102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:06.904102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:06.904102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:06.904102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:06.904102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:06.904102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:06.904102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 22:39:06.904957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 22:39:06.905916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 22:39:06.905916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 22:39:06.905916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 22:39:06.905916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 22:39:06.905916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 22:39:06.905916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:06.906254 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87690f44-23f9-4dcb-b45b-3fa72344f0c6 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.906329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 497/973] 10.222.0.72 () {60 vars in 1131 bytes} [Mon Aug 29 22:39:06 2022] POST /identity/v3/users => generated 160 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:06.906329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68372b19-a92b-478b-b51f-dc2ea65020e0 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.920651 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 477/974] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:06.921950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87690f44-23f9-4dcb-b45b-3fa72344f0c6 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:06.936725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:07.035414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:07.039264 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68372b19-a92b-478b-b51f-dc2ea65020e0 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:07.061230 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87690f44-23f9-4dcb-b45b-3fa72344f0c6 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:07.095367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644187ad-1ca4-4e73-8cab-470635ed9768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:07.096022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644187ad-1ca4-4e73-8cab-470635ed9768 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.096610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644187ad-1ca4-4e73-8cab-470635ed9768 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.096886 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644187ad-1ca4-4e73-8cab-470635ed9768 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.108624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644187ad-1ca4-4e73-8cab-470635ed9768 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:07.109275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acfdc0-51a5-46b9-a289-b157bb10ea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:07.110154 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acfdc0-51a5-46b9-a289-b157bb10ea65 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.110356 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644187ad-1ca4-4e73-8cab-470635ed9768 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:07.110918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acfdc0-51a5-46b9-a289-b157bb10ea65 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.111398 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acfdc0-51a5-46b9-a289-b157bb10ea65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.119942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acfdc0-51a5-46b9-a289-b157bb10ea65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:07.121728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acfdc0-51a5-46b9-a289-b157bb10ea65 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-644187ad-1ca4-4e73-8cab-470635ed9768 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:39:07.125727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:07.126696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:07.127652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:07.127652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:07.127652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:39:07.127652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:39:07.127652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:39:07.127652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:39:07.127652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:39:07.127652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:39:07.127652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:39:07.127652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:07.127652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 498/975] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:39:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:07.134143 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644187ad-1ca4-4e73-8cab-470635ed9768 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:07.141099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-79acfdc0-51a5-46b9-a289-b157bb10ea65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:39:07.141099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:07.141099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:07.141099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:07.141099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:07.141099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:07.141099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:07.141099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:07.141099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:07.141099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:07.141099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:07.141099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:07.141099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:39:07.141099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:39:07.141099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:07.142050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:07.142949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:39:07.142949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:39:07.142949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:39:07.142949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:39:07.142949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:39:07.142949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:39:07.142949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:39:07.142949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:07.147079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 478/976] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:39:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:07.149027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acfdc0-51a5-46b9-a289-b157bb10ea65 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:07.252393 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:07.273738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644187ad-1ca4-4e73-8cab-470635ed9768 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:07.294868 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acfdc0-51a5-46b9-a289-b157bb10ea65 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:07.324501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751d2de-09fe-4fb2-9d53-b41f50caa515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:07.325266 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751d2de-09fe-4fb2-9d53-b41f50caa515 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.325582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751d2de-09fe-4fb2-9d53-b41f50caa515 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.326141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751d2de-09fe-4fb2-9d53-b41f50caa515 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.326875 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751d2de-09fe-4fb2-9d53-b41f50caa515 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:07.327622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751d2de-09fe-4fb2-9d53-b41f50caa515 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:07.329473 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751d2de-09fe-4fb2-9d53-b41f50caa515 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:07.336464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cd039-9699-44a1-8721-2b4f222624f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:07.337411 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cd039-9699-44a1-8721-2b4f222624f0 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.338016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cd039-9699-44a1-8721-2b4f222624f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.339130 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cd039-9699-44a1-8721-2b4f222624f0 None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.340296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cd039-9699-44a1-8721-2b4f222624f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:07.340818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cd039-9699-44a1-8721-2b4f222624f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:07.342647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cd039-9699-44a1-8721-2b4f222624f0 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:07.358519 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 479/977] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:39:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:07.364715 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cd039-9699-44a1-8721-2b4f222624f0 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:07.394773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 499/978] 10.222.0.72 () {56 vars in 1101 bytes} [Mon Aug 29 22:39:07 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:07.501167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cd039-9699-44a1-8721-2b4f222624f0 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:07.535958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:07.543422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f4f83-1725-4d54-9fa1-20697a56b184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:07.544049 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f4f83-1725-4d54-9fa1-20697a56b184 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.544383 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f4f83-1725-4d54-9fa1-20697a56b184 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.544765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f4f83-1725-4d54-9fa1-20697a56b184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.551481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f4f83-1725-4d54-9fa1-20697a56b184 None admin] RBAC: Adding query filter params (role.id=136e6370b0c7476f898673d4d697ed28, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=e7b1650890fe409091ddbc881ee28973) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:07.551481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f4f83-1725-4d54-9fa1-20697a56b184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:07.551481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f4f83-1725-4d54-9fa1-20697a56b184 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:07.558893 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 480/979] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:39:07 2022] GET /identity/v3/role_assignments?user.id=e7b1650890fe409091ddbc881ee28973&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=136e6370b0c7476f898673d4d697ed28 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:08.039927 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc970-8a3f-4282-972e-115836254b00 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:08.040532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc970-8a3f-4282-972e-115836254b00 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:08.040532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc970-8a3f-4282-972e-115836254b00 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:08.042081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 500/980] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:08.047222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10e5c-6f94-4729-abf4-023e1ba3ed18 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:08.047506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10e5c-6f94-4729-abf4-023e1ba3ed18 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:08.047780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10e5c-6f94-4729-abf4-023e1ba3ed18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:08.069378 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-bfd10e5c-6f94-4729-abf4-023e1ba3ed18 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:08.070625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-bfd10e5c-6f94-4729-abf4-023e1ba3ed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:08.144945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 481/981] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:39:08.155252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2a475-b707-4b80-8e24-594c9ffae593 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:08.155536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2a475-b707-4b80-8e24-594c9ffae593 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:08.155816 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2a475-b707-4b80-8e24-594c9ffae593 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:08.157347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 501/982] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:39:08.162413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc4dce-19bb-4960-bacb-cb3b528888d4 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:08.162698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc4dce-19bb-4960-bacb-cb3b528888d4 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:08.162972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc4dce-19bb-4960-bacb-cb3b528888d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:08.183133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-8ecc4dce-19bb-4960-bacb-cb3b528888d4 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:08.184362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8ecc4dce-19bb-4960-bacb-cb3b528888d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:08.259132 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 482/983] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:08.414829 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2a475-b707-4b80-8e24-594c9ffae593 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:08.439523 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:08.530698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc4dce-19bb-4960-bacb-cb3b528888d4 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:08.533198 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2a475-b707-4b80-8e24-594c9ffae593 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:08.578164 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd97de7-9213-4d16-8a6e-a1ceb06bf136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:08.578792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd97de7-9213-4d16-8a6e-a1ceb06bf136 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:08.579074 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd97de7-9213-4d16-8a6e-a1ceb06bf136 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:08.579610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd97de7-9213-4d16-8a6e-a1ceb06bf136 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:08.580748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd97de7-9213-4d16-8a6e-a1ceb06bf136 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:08.582402 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd97de7-9213-4d16-8a6e-a1ceb06bf136 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:08.589840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-8dd97de7-9213-4d16-8a6e-a1ceb06bf136 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:08.594558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:08.595562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:08.597480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:08.597480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:08.597480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:08.597480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:08.597480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:08.597480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:08.597480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:08.597480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:08.597480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:08.597480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:08.597480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:39:08.597480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:08.597480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:39:08.597480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:08.601226 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 502/984] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Aug 29 22:39:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:08.601953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd97de7-9213-4d16-8a6e-a1ceb06bf136 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:08.641231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc4dce-19bb-4960-bacb-cb3b528888d4 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:08.678711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ff318-f3a1-4a93-8be0-809e3e973e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:08.679459 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ff318-f3a1-4a93-8be0-809e3e973e13 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:08.679459 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ff318-f3a1-4a93-8be0-809e3e973e13 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:08.679780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ff318-f3a1-4a93-8be0-809e3e973e13 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:08.680476 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ff318-f3a1-4a93-8be0-809e3e973e13 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:08.682590 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ff318-f3a1-4a93-8be0-809e3e973e13 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:08.701978 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:08.723884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd97de7-9213-4d16-8a6e-a1ceb06bf136 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:08.755886 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 483/985] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Aug 29 22:39:08 2022] POST /identity/v3/services => generated 242 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:39:08.773063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81181f30-0839-4561-9084-c24c55d5ea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:08.773603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81181f30-0839-4561-9084-c24c55d5ea72 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:08.773603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81181f30-0839-4561-9084-c24c55d5ea72 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:08.773939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81181f30-0839-4561-9084-c24c55d5ea72 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:08.776284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81181f30-0839-4561-9084-c24c55d5ea72 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:08.776284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81181f30-0839-4561-9084-c24c55d5ea72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:08.777232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81181f30-0839-4561-9084-c24c55d5ea72 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:08.783866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 503/986] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Aug 29 22:39:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:08.789987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ff318-f3a1-4a93-8be0-809e3e973e13 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:08.914118 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ff318-f3a1-4a93-8be0-809e3e973e13 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:08.931204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:08.953446 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c6c03-3254-4280-b1b2-c2d6cb85ed5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:08.954091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c6c03-3254-4280-b1b2-c2d6cb85ed5a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:08.954367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c6c03-3254-4280-b1b2-c2d6cb85ed5a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:08.954640 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c6c03-3254-4280-b1b2-c2d6cb85ed5a None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:08.955281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c6c03-3254-4280-b1b2-c2d6cb85ed5a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:08.955583 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c6c03-3254-4280-b1b2-c2d6cb85ed5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:08.957036 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c6c03-3254-4280-b1b2-c2d6cb85ed5a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:08.963561 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 484/987] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Aug 29 22:39:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:08.969700 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81181f30-0839-4561-9084-c24c55d5ea72 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:09.079903 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81181f30-0839-4561-9084-c24c55d5ea72 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:09.121456 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72909ec-a20d-49bd-9931-1e257685cf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:09.122262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72909ec-a20d-49bd-9931-1e257685cf47 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:09.122551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72909ec-a20d-49bd-9931-1e257685cf47 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:09.122832 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72909ec-a20d-49bd-9931-1e257685cf47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:09.123558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72909ec-a20d-49bd-9931-1e257685cf47 None admin] RBAC: Adding query filter params (interface=admin, service_id=6fd5db7fbd8342e68981bf1cd82d3307, region_id=RegionOne) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:09.123874 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72909ec-a20d-49bd-9931-1e257685cf47 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:09.125296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72909ec-a20d-49bd-9931-1e257685cf47 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:09.136238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 504/988] 10.222.0.72 () {56 vars in 1249 bytes} [Mon Aug 29 22:39:08 2022] GET /identity/v3/endpoints?service_id=6fd5db7fbd8342e68981bf1cd82d3307&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:09.137826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c6c03-3254-4280-b1b2-c2d6cb85ed5a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:09.248172 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c6c03-3254-4280-b1b2-c2d6cb85ed5a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:09.285789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af29ce-1b20-4512-85b9-1f72466e1036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:09.286409 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af29ce-1b20-4512-85b9-1f72466e1036 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:09.286694 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af29ce-1b20-4512-85b9-1f72466e1036 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:09.286969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af29ce-1b20-4512-85b9-1f72466e1036 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:09.287581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af29ce-1b20-4512-85b9-1f72466e1036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:09.289019 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af29ce-1b20-4512-85b9-1f72466e1036 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:09.296463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 485/989] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Aug 29 22:39:09 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:39:09.553380 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc927c-f4db-4882-a21b-b8e00db34849 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:09.553590 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc927c-f4db-4882-a21b-b8e00db34849 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:09.553846 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc927c-f4db-4882-a21b-b8e00db34849 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:09.555385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 505/990] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:09.560663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7334b7-fc13-4da4-bbed-6d8031b3ce70 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:09.560951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7334b7-fc13-4da4-bbed-6d8031b3ce70 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:09.561228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7334b7-fc13-4da4-bbed-6d8031b3ce70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:09.580463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-9d7334b7-fc13-4da4-bbed-6d8031b3ce70 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:09.581647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9d7334b7-fc13-4da4-bbed-6d8031b3ce70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:09.623829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:09.660359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 486/991] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:09.924353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc927c-f4db-4882-a21b-b8e00db34849 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:09.928626 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:10.037996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc927c-f4db-4882-a21b-b8e00db34849 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:10.082668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcff13-3fde-47d9-a6a3-8d5b246f8500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:10.083772 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcff13-3fde-47d9-a6a3-8d5b246f8500 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:10.084235 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcff13-3fde-47d9-a6a3-8d5b246f8500 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:10.084630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcff13-3fde-47d9-a6a3-8d5b246f8500 None admin] PATH_INFO: `/v3/services/image` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:10.085614 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcff13-3fde-47d9-a6a3-8d5b246f8500 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:10.088081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcff13-3fde-47d9-a6a3-8d5b246f8500 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-5efcff13-3fde-47d9-a6a3-8d5b246f8500 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:10.097787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:10.098878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:10.099706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:10.099706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:10.099706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:10.099706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:10.099706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:10.099706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:10.099706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:10.099706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:10.099706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:10.099706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:10.099706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:39:10.099706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:10.099706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:39:10.099706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:10.107872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 506/992] 10.222.0.72 () {56 vars in 1105 bytes} [Mon Aug 29 22:39:09 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:10.108144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7334b7-fc13-4da4-bbed-6d8031b3ce70 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:10.213223 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7334b7-fc13-4da4-bbed-6d8031b3ce70 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:10.251517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb233aa-4356-4d20-b298-911c29a58b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:10.252562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb233aa-4356-4d20-b298-911c29a58b5d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:10.253043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb233aa-4356-4d20-b298-911c29a58b5d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:10.253525 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb233aa-4356-4d20-b298-911c29a58b5d None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:10.254344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb233aa-4356-4d20-b298-911c29a58b5d None admin] RBAC: Adding query filter params (name=image) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:10.254840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb233aa-4356-4d20-b298-911c29a58b5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:10.256420 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb233aa-4356-4d20-b298-911c29a58b5d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:10.262155 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 487/993] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:10.267547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcff13-3fde-47d9-a6a3-8d5b246f8500 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:10.342112 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:10.377679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcff13-3fde-47d9-a6a3-8d5b246f8500 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:10.421284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cd0d2-d4dd-4f82-b291-083bef766981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:10.422429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cd0d2-d4dd-4f82-b291-083bef766981 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:10.422892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cd0d2-d4dd-4f82-b291-083bef766981 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:10.423429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cd0d2-d4dd-4f82-b291-083bef766981 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:10.428145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cd0d2-d4dd-4f82-b291-083bef766981 None admin] RBAC: Adding query filter params (type=image) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:10.428145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cd0d2-d4dd-4f82-b291-083bef766981 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:10.428145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cd0d2-d4dd-4f82-b291-083bef766981 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:10.433762 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 507/994] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:10.796778 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab33865-09b5-4610-bc76-de1744ecba33 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:10.797315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab33865-09b5-4610-bc76-de1744ecba33 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:10.797315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab33865-09b5-4610-bc76-de1744ecba33 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:10.798677 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 488/995] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:10.804363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58676d1e-628f-4bec-b833-6e3143e644a6 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:10.804658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58676d1e-628f-4bec-b833-6e3143e644a6 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:10.804943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58676d1e-628f-4bec-b833-6e3143e644a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:10.824709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-58676d1e-628f-4bec-b833-6e3143e644a6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:10.826278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-58676d1e-628f-4bec-b833-6e3143e644a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:10.903542 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 508/996] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:11.178594 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab33865-09b5-4610-bc76-de1744ecba33 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:11.219540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:11.294925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab33865-09b5-4610-bc76-de1744ecba33 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:11.299584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866df68-8942-4590-ba9a-bb7b33e25176 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:11.300070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866df68-8942-4590-ba9a-bb7b33e25176 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:11.300149 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866df68-8942-4590-ba9a-bb7b33e25176 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:11.304259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 509/997] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:39:11.308108 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9804c32-3784-43ac-9c0b-09a7bfb4f6ed None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:11.308680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9804c32-3784-43ac-9c0b-09a7bfb4f6ed None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:11.309155 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9804c32-3784-43ac-9c0b-09a7bfb4f6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:11.328503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-b9804c32-3784-43ac-9c0b-09a7bfb4f6ed None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:11.329985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b9804c32-3784-43ac-9c0b-09a7bfb4f6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:11.334785 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16975123-b26e-4e5f-ab93-08b471ec0ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:11.335426 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16975123-b26e-4e5f-ab93-08b471ec0ec0 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:11.335705 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16975123-b26e-4e5f-ab93-08b471ec0ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:11.335977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16975123-b26e-4e5f-ab93-08b471ec0ec0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:11.336587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16975123-b26e-4e5f-ab93-08b471ec0ec0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:11.338200 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16975123-b26e-4e5f-ab93-08b471ec0ec0 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-16975123-b26e-4e5f-ab93-08b471ec0ec0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:11.348095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:11.349148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:11.349986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:11.349986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:11.349986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:11.349986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:11.349986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:11.349986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:11.349986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:11.349986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:11.349986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:11.349986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:11.349986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:39:11.349986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:11.349986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:39:11.349986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:11.349986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 489/998] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:39:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:11.355484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16975123-b26e-4e5f-ab93-08b471ec0ec0 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:11.405852 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:11.421063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 510/999] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:11.492775 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:11.496584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16975123-b26e-4e5f-ab93-08b471ec0ec0 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:11.537834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e11b7a-a87b-430b-afb3-b8139d1e4011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:11.538882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e11b7a-a87b-430b-afb3-b8139d1e4011 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:11.539366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e11b7a-a87b-430b-afb3-b8139d1e4011 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:11.539839 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e11b7a-a87b-430b-afb3-b8139d1e4011 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:11.541235 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e11b7a-a87b-430b-afb3-b8139d1e4011 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:11.541901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e11b7a-a87b-430b-afb3-b8139d1e4011 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:11.543584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e11b7a-a87b-430b-afb3-b8139d1e4011 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:11.553826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 490/1000] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Aug 29 22:39:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:11.554946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9804c32-3784-43ac-9c0b-09a7bfb4f6ed None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:11.661127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9804c32-3784-43ac-9c0b-09a7bfb4f6ed None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:11.693992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e11b7a-a87b-430b-afb3-b8139d1e4011 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:11.698446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e2cdd-47e6-454e-ac78-f6c04f66f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:11.699080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e2cdd-47e6-454e-ac78-f6c04f66f1a3 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:11.699364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e2cdd-47e6-454e-ac78-f6c04f66f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:11.699642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e2cdd-47e6-454e-ac78-f6c04f66f1a3 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:11.700315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e2cdd-47e6-454e-ac78-f6c04f66f1a3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:11.700627 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e2cdd-47e6-454e-ac78-f6c04f66f1a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:11.702022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e2cdd-47e6-454e-ac78-f6c04f66f1a3 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:11.707689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 511/1001] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Aug 29 22:39:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:11.715296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e2cdd-47e6-454e-ac78-f6c04f66f1a3 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:11.780977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:11.811059 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e11b7a-a87b-430b-afb3-b8139d1e4011 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:11.832340 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e2cdd-47e6-454e-ac78-f6c04f66f1a3 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:11.851190 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4176e-6dbb-45c4-baa1-fcb0b3377dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:11.851834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4176e-6dbb-45c4-baa1-fcb0b3377dcd None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:11.852119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4176e-6dbb-45c4-baa1-fcb0b3377dcd None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:11.852437 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4176e-6dbb-45c4-baa1-fcb0b3377dcd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:11.853115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4176e-6dbb-45c4-baa1-fcb0b3377dcd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:11.855298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4176e-6dbb-45c4-baa1-fcb0b3377dcd None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-e2a4176e-6dbb-45c4-baa1-fcb0b3377dcd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:11.865357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:11.866401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:11.867284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:11.867284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:11.867284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:11.867284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:11.867284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:11.867284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:11.867284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:11.867284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:11.867284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:11.867284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:11.867284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:39:11.867284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:11.867284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:39:11.867284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:11.867284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 491/1002] 10.222.0.72 () {56 vars in 1126 bytes} [Mon Aug 29 22:39:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:11.873108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4176e-6dbb-45c4-baa1-fcb0b3377dcd None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:11.876775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec89f40-8bf5-40b3-8b34-82c7a7569aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:11.877690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec89f40-8bf5-40b3-8b34-82c7a7569aea None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:11.877690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec89f40-8bf5-40b3-8b34-82c7a7569aea None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:11.877995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec89f40-8bf5-40b3-8b34-82c7a7569aea None admin] PATH_INFO: `/v3/endpoints` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:11.878770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec89f40-8bf5-40b3-8b34-82c7a7569aea None admin] RBAC: Adding query filter params (interface=public, service_id=36cb817daadf47bb90547401651a9c33, region_id=RegionOne) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:11.878981 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec89f40-8bf5-40b3-8b34-82c7a7569aea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:11.880438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec89f40-8bf5-40b3-8b34-82c7a7569aea None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:11.890958 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 512/1003] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Aug 29 22:39:11 2022] GET /identity/v3/endpoints?service_id=36cb817daadf47bb90547401651a9c33&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:11.892344 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec89f40-8bf5-40b3-8b34-82c7a7569aea None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:11.907040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:12.007047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4176e-6dbb-45c4-baa1-fcb0b3377dcd None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:12.033476 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec89f40-8bf5-40b3-8b34-82c7a7569aea None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:12.047256 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d7dd0-03ff-4f4c-abfb-a05193e68fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:12.047874 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7dd0-03ff-4f4c-abfb-a05193e68fa7 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:12.048151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7dd0-03ff-4f4c-abfb-a05193e68fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:12.048453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7dd0-03ff-4f4c-abfb-a05193e68fa7 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:12.049087 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d7dd0-03ff-4f4c-abfb-a05193e68fa7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:12.049392 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d7dd0-03ff-4f4c-abfb-a05193e68fa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:12.050774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d7dd0-03ff-4f4c-abfb-a05193e68fa7 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:12.060540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 492/1004] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Aug 29 22:39:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:12.061332 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:12.061770 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d7dd0-03ff-4f4c-abfb-a05193e68fa7 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:12.077868 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6956a-b06e-4a07-9f17-4ca9a4d94d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:12.078698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6956a-b06e-4a07-9f17-4ca9a4d94d0e None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:12.078969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6956a-b06e-4a07-9f17-4ca9a4d94d0e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:12.079061 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6956a-b06e-4a07-9f17-4ca9a4d94d0e None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:12.079678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6956a-b06e-4a07-9f17-4ca9a4d94d0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:12.081549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6956a-b06e-4a07-9f17-4ca9a4d94d0e None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:12.091546 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 513/1005] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Aug 29 22:39:11 2022] GET /identity/v3/services => generated 1727 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:39:12.186876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:12.198050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d7dd0-03ff-4f4c-abfb-a05193e68fa7 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:12.239231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f28f6-f1ee-4ef3-b69a-5eb647501966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:12.239844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f28f6-f1ee-4ef3-b69a-5eb647501966 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:12.240127 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f28f6-f1ee-4ef3-b69a-5eb647501966 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:12.240423 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f28f6-f1ee-4ef3-b69a-5eb647501966 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:12.241055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f28f6-f1ee-4ef3-b69a-5eb647501966 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:12.241358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f28f6-f1ee-4ef3-b69a-5eb647501966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:12.242718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f28f6-f1ee-4ef3-b69a-5eb647501966 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:12.249843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 493/1006] 10.222.0.72 () {56 vars in 1122 bytes} [Mon Aug 29 22:39:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:12.255381 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6956a-b06e-4a07-9f17-4ca9a4d94d0e None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:12.361065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6956a-b06e-4a07-9f17-4ca9a4d94d0e None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:12.371010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83252d-1723-468e-93ad-d3666464574a None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:12.371317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83252d-1723-468e-93ad-d3666464574a None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:12.371552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83252d-1723-468e-93ad-d3666464574a None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:12.373103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 494/1007] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:12.378074 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a3a9f-bca6-482d-b97b-8c35614d0dc0 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:12.378357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a3a9f-bca6-482d-b97b-8c35614d0dc0 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:12.378638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a3a9f-bca6-482d-b97b-8c35614d0dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:12.400942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-305a3a9f-bca6-482d-b97b-8c35614d0dc0 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:12.402150 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-305a3a9f-bca6-482d-b97b-8c35614d0dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:12.407754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd7bed-3eb1-4965-b05f-0aec74168fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:12.408672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd7bed-3eb1-4965-b05f-0aec74168fb1 None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:12.409131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd7bed-3eb1-4965-b05f-0aec74168fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:12.409583 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd7bed-3eb1-4965-b05f-0aec74168fb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:12.410922 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd7bed-3eb1-4965-b05f-0aec74168fb1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:12.412934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd7bed-3eb1-4965-b05f-0aec74168fb1 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:12.475226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 495/1008] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:39:12.584231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 514/1009] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:39:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:39:12.750240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a3a9f-bca6-482d-b97b-8c35614d0dc0 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:12.858487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:12.876820 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a3a9f-bca6-482d-b97b-8c35614d0dc0 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:12.926499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd2fad-72f8-426d-9ad7-c17af4fd5cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:12.927134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd2fad-72f8-426d-9ad7-c17af4fd5cdd None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:12.927416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd2fad-72f8-426d-9ad7-c17af4fd5cdd None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:12.927689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd2fad-72f8-426d-9ad7-c17af4fd5cdd None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:12.928388 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd2fad-72f8-426d-9ad7-c17af4fd5cdd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:12.929811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd2fad-72f8-426d-9ad7-c17af4fd5cdd None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:13.023888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 496/1010] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Aug 29 22:39:12 2022] POST /identity/v3/services => generated 242 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:39:14.097793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14f32c-64c3-4674-b96e-c469838f5797 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:14.098366 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14f32c-64c3-4674-b96e-c469838f5797 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:14.098366 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14f32c-64c3-4674-b96e-c469838f5797 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:14.100009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 515/1011] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:14.105407 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca173f-9082-4023-816a-6852ababc03e None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:14.105869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca173f-9082-4023-816a-6852ababc03e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:14.105944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca173f-9082-4023-816a-6852ababc03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:14.126272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-bdca173f-9082-4023-816a-6852ababc03e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:14.127489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-bdca173f-9082-4023-816a-6852ababc03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:14.211325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 497/1012] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:14 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:14.489891 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14f32c-64c3-4674-b96e-c469838f5797 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:14.542204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:14.602339 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14f32c-64c3-4674-b96e-c469838f5797 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:14.609280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54413dfe-8d3f-4524-8468-f9d0889a3460 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:14.609586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54413dfe-8d3f-4524-8468-f9d0889a3460 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:14.609816 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54413dfe-8d3f-4524-8468-f9d0889a3460 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:14.611306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 498/1013] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:39:14.616511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dfe3f-c7e2-4959-ac3d-d3deedea158e None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:14.616799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dfe3f-c7e2-4959-ac3d-d3deedea158e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:14.617084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dfe3f-c7e2-4959-ac3d-d3deedea158e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:14.636139 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-d67dfe3f-c7e2-4959-ac3d-d3deedea158e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:14.637374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d67dfe3f-c7e2-4959-ac3d-d3deedea158e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:14.641830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779f5d-42cd-4b8c-b522-b2350e0a8bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:14.642737 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779f5d-42cd-4b8c-b522-b2350e0a8bac None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:14.643206 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779f5d-42cd-4b8c-b522-b2350e0a8bac None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:14.643665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779f5d-42cd-4b8c-b522-b2350e0a8bac None admin] PATH_INFO: `/v3/services/compute` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:14.644477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3779f5d-42cd-4b8c-b522-b2350e0a8bac None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:14.646175 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3779f5d-42cd-4b8c-b522-b2350e0a8bac None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-f3779f5d-42cd-4b8c-b522-b2350e0a8bac None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:14.658442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:14.659492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:14.660376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:14.660376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:14.660376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:14.660376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:14.660376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:14.660376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:14.660376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:14.660376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:14.660376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:14.660376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:14.660376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:39:14.660376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:14.660376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:39:14.660376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:14.661285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 516/1014] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:39:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:14.667751 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779f5d-42cd-4b8c-b522-b2350e0a8bac None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:14.711627 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:14.718907 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 499/1015] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:14 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:14.791053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779f5d-42cd-4b8c-b522-b2350e0a8bac None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:14.802384 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:14.843936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb23714-0331-43f5-a533-2c3f48857f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:14.844727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb23714-0331-43f5-a533-2c3f48857f97 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:14.845012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb23714-0331-43f5-a533-2c3f48857f97 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:14.845285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb23714-0331-43f5-a533-2c3f48857f97 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:14.846184 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb23714-0331-43f5-a533-2c3f48857f97 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:14.846491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb23714-0331-43f5-a533-2c3f48857f97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:14.847873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb23714-0331-43f5-a533-2c3f48857f97 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:14.854027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 517/1016] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Aug 29 22:39:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:14.862538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dfe3f-c7e2-4959-ac3d-d3deedea158e None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:15.001607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dfe3f-c7e2-4959-ac3d-d3deedea158e None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:15.001948 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bec77a-a8e8-4ca7-a9ee-d7a059bb46cb None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:15.002239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bec77a-a8e8-4ca7-a9ee-d7a059bb46cb None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:15.002515 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bec77a-a8e8-4ca7-a9ee-d7a059bb46cb None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:15.004024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 518/1017] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:39:15.008879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8607e49-e8ec-4595-b3a6-62609391388f None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:15.009189 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8607e49-e8ec-4595-b3a6-62609391388f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:15.009493 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8607e49-e8ec-4595-b3a6-62609391388f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:15.029199 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f8607e49-e8ec-4595-b3a6-62609391388f None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:15.030383 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f8607e49-e8ec-4595-b3a6-62609391388f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:15.044874 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7de667-f3d6-408b-992d-55e533b203e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:15.045495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7de667-f3d6-408b-992d-55e533b203e4 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:15.045772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7de667-f3d6-408b-992d-55e533b203e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:15.046045 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7de667-f3d6-408b-992d-55e533b203e4 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:15.046675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7de667-f3d6-408b-992d-55e533b203e4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:15.046978 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7de667-f3d6-408b-992d-55e533b203e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:15.048366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7de667-f3d6-408b-992d-55e533b203e4 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:15.053436 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 500/1018] 10.222.0.72 () {56 vars in 1112 bytes} [Mon Aug 29 22:39:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:15.054225 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7de667-f3d6-408b-992d-55e533b203e4 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:15.108864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 519/1019] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:15 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:39:15.109712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8607e49-e8ec-4595-b3a6-62609391388f None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:15.128280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:15.171437 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7de667-f3d6-408b-992d-55e533b203e4 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:15.207817 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9754fa4-c8c1-41ac-8a00-84b2353a78e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:15.208531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9754fa4-c8c1-41ac-8a00-84b2353a78e2 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:15.208763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9754fa4-c8c1-41ac-8a00-84b2353a78e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:15.209031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9754fa4-c8c1-41ac-8a00-84b2353a78e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:15.210159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9754fa4-c8c1-41ac-8a00-84b2353a78e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:15.211569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9754fa4-c8c1-41ac-8a00-84b2353a78e2 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:15.213220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 501/1020] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:15.218797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9754fa4-c8c1-41ac-8a00-84b2353a78e2 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:15.226844 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8607e49-e8ec-4595-b3a6-62609391388f None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:15.229347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:15.270846 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a93ce8-18e8-4f7e-b1d9-69a284853cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:15.271498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a93ce8-18e8-4f7e-b1d9-69a284853cda None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:15.271782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a93ce8-18e8-4f7e-b1d9-69a284853cda None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:15.272056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a93ce8-18e8-4f7e-b1d9-69a284853cda None admin] PATH_INFO: `/v3/endpoints` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:15.272893 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a93ce8-18e8-4f7e-b1d9-69a284853cda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:15.274395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a93ce8-18e8-4f7e-b1d9-69a284853cda None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:15.352224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 520/1021] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:39:15 2022] POST /identity/v3/endpoints => generated 334 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:15.352454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9754fa4-c8c1-41ac-8a00-84b2353a78e2 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:15.385564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a93ce8-18e8-4f7e-b1d9-69a284853cda None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:15.390735 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:15.408636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78cfcd-5ced-4cf0-ab9d-f4f14bd47fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:15.411634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78cfcd-5ced-4cf0-ab9d-f4f14bd47fb5 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:15.411634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78cfcd-5ced-4cf0-ab9d-f4f14bd47fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:15.411634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78cfcd-5ced-4cf0-ab9d-f4f14bd47fb5 None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:15.411634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78cfcd-5ced-4cf0-ab9d-f4f14bd47fb5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:15.412004 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78cfcd-5ced-4cf0-ab9d-f4f14bd47fb5 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:15.522238 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 502/1022] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Aug 29 22:39:15 2022] POST /identity/v3/projects => generated 311 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:39:15.562110 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a93ce8-18e8-4f7e-b1d9-69a284853cda None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:15.606614 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cba31-fcc4-4bb3-ba88-ddd64eb2bed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:15.607278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cba31-fcc4-4bb3-ba88-ddd64eb2bed0 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:15.607566 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cba31-fcc4-4bb3-ba88-ddd64eb2bed0 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:15.607849 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cba31-fcc4-4bb3-ba88-ddd64eb2bed0 None admin] PATH_INFO: `/v3/services/image` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:15.608530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cba31-fcc4-4bb3-ba88-ddd64eb2bed0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:15.609974 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cba31-fcc4-4bb3-ba88-ddd64eb2bed0 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-ca7cba31-fcc4-4bb3-ba88-ddd64eb2bed0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:15.621550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:15.622631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:15.623484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:15.623484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:15.623484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:15.623484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:15.623484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:15.623484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:15.623484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:15.623484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:15.623484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:15.623484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:15.623484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:39:15.623484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:15.623484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:39:15.623484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:15.623484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 521/1023] 10.222.0.72 () {56 vars in 1105 bytes} [Mon Aug 29 22:39:15 2022] GET /identity/v3/services/image => generated 86 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:15.630522 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78cfcd-5ced-4cf0-ab9d-f4f14bd47fb5 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:15.746529 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78cfcd-5ced-4cf0-ab9d-f4f14bd47fb5 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:15.791635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22320140-2e3a-4296-b108-983ffb2c9df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:15.792576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22320140-2e3a-4296-b108-983ffb2c9df6 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:15.793044 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22320140-2e3a-4296-b108-983ffb2c9df6 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:15.793497 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22320140-2e3a-4296-b108-983ffb2c9df6 None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:15.794581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22320140-2e3a-4296-b108-983ffb2c9df6 None admin] RBAC: Adding query filter params (name=image) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:15.795109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22320140-2e3a-4296-b108-983ffb2c9df6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:15.797704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22320140-2e3a-4296-b108-983ffb2c9df6 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:15.806536 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 503/1024] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:15.815836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cba31-fcc4-4bb3-ba88-ddd64eb2bed0 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:15.864951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:15.995846 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cba31-fcc4-4bb3-ba88-ddd64eb2bed0 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:16.033997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488ea8d-029b-4ea6-98a8-4a17d12805ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:16.034604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488ea8d-029b-4ea6-98a8-4a17d12805ac None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:16.034879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488ea8d-029b-4ea6-98a8-4a17d12805ac None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:16.035145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488ea8d-029b-4ea6-98a8-4a17d12805ac None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:16.035783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488ea8d-029b-4ea6-98a8-4a17d12805ac None admin] RBAC: Adding query filter params (type=image) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:16.036082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488ea8d-029b-4ea6-98a8-4a17d12805ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:16.037469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488ea8d-029b-4ea6-98a8-4a17d12805ac None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:16.042989 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 522/1025] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:16.048758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22320140-2e3a-4296-b108-983ffb2c9df6 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:16.096668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:16.160118 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22320140-2e3a-4296-b108-983ffb2c9df6 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:16.196930 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf0993-fc62-42f6-bce5-c055f66c625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:16.197734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf0993-fc62-42f6-bce5-c055f66c625c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:16.198020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf0993-fc62-42f6-bce5-c055f66c625c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:16.198299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf0993-fc62-42f6-bce5-c055f66c625c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:16.199006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf0993-fc62-42f6-bce5-c055f66c625c None admin] RBAC: Adding query filter params (interface=public, service_id=02995672b0e742b18bbdf0d46e2e19a2, region_id=RegionOne) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:16.199314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf0993-fc62-42f6-bce5-c055f66c625c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:16.200720 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf0993-fc62-42f6-bce5-c055f66c625c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:16.210882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 504/1026] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Aug 29 22:39:16 2022] GET /identity/v3/endpoints?service_id=02995672b0e742b18bbdf0d46e2e19a2&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:16.212728 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488ea8d-029b-4ea6-98a8-4a17d12805ac None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:16.350043 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:16.375520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488ea8d-029b-4ea6-98a8-4a17d12805ac None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:16.430276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91e18a-2925-4d4d-bf71-f56e851ea82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:16.430890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91e18a-2925-4d4d-bf71-f56e851ea82f None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:16.431201 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91e18a-2925-4d4d-bf71-f56e851ea82f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:16.431645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91e18a-2925-4d4d-bf71-f56e851ea82f None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:16.431645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91e18a-2925-4d4d-bf71-f56e851ea82f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:16.433588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91e18a-2925-4d4d-bf71-f56e851ea82f None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:16.441047 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 523/1027] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Aug 29 22:39:16 2022] GET /identity/v3/services => generated 1957 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:39:17.637148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600555e-4241-47dd-b6d8-e50da0fc5250 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:17.637675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600555e-4241-47dd-b6d8-e50da0fc5250 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:17.637675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600555e-4241-47dd-b6d8-e50da0fc5250 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:17.639047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 505/1028] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:17.644937 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416b775-8798-4fe5-9890-e5c3152bc724 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:17.645411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416b775-8798-4fe5-9890-e5c3152bc724 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:17.645506 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416b775-8798-4fe5-9890-e5c3152bc724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:17.664957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-2416b775-8798-4fe5-9890-e5c3152bc724 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:17.667148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-2416b775-8798-4fe5-9890-e5c3152bc724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:17.740035 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59811ce6-1ade-4c67-aea4-911463f26ca9 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:17.740281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59811ce6-1ade-4c67-aea4-911463f26ca9 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:17.740512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59811ce6-1ade-4c67-aea4-911463f26ca9 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:17.742096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 506/1029] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:39:17.747990 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 524/1030] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:17.748153 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c5e44-21ab-42da-8215-68bbdfaf6577 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:17.748530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c5e44-21ab-42da-8215-68bbdfaf6577 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:17.748878 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c5e44-21ab-42da-8215-68bbdfaf6577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:17.767456 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-543c5e44-21ab-42da-8215-68bbdfaf6577 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:17.768758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-543c5e44-21ab-42da-8215-68bbdfaf6577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:17.846019 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 507/1031] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:39:18.053431 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416b775-8798-4fe5-9890-e5c3152bc724 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:18.123319 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c5e44-21ab-42da-8215-68bbdfaf6577 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:18.147992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:18.162181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:18.171342 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416b775-8798-4fe5-9890-e5c3152bc724 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:18.209567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea2836-4f0d-4458-bc22-d5a500e20d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:18.210500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea2836-4f0d-4458-bc22-d5a500e20d45 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:18.210939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea2836-4f0d-4458-bc22-d5a500e20d45 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:18.211364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea2836-4f0d-4458-bc22-d5a500e20d45 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:18.223167 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea2836-4f0d-4458-bc22-d5a500e20d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-08ea2836-4f0d-4458-bc22-d5a500e20d45 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:39:18.228629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:18.232472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:18.233600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:18.233600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:18.233600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:18.233600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:18.233600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:39:18.233600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:39:18.233600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:39:18.233600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:39:18.233600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:39:18.233600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:39:18.233600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:39:18.233600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:18.233600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 525/1032] 10.222.0.72 () {56 vars in 1120 bytes} [Mon Aug 29 22:39:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:18.235929 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea2836-4f0d-4458-bc22-d5a500e20d45 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:18.240900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c5e44-21ab-42da-8215-68bbdfaf6577 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:18.278156 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dcd1f-9495-42f6-8cfe-73b92be4b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:18.278796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dcd1f-9495-42f6-8cfe-73b92be4b687 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:18.279075 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dcd1f-9495-42f6-8cfe-73b92be4b687 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:18.279349 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dcd1f-9495-42f6-8cfe-73b92be4b687 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:18.280501 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25dcd1f-9495-42f6-8cfe-73b92be4b687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:18.281938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25dcd1f-9495-42f6-8cfe-73b92be4b687 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:18.283524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 508/1033] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:18.289063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dcd1f-9495-42f6-8cfe-73b92be4b687 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:18.349366 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea2836-4f0d-4458-bc22-d5a500e20d45 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:18.390370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d291a-f15e-4230-b11a-7c483a0aa2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:18.390993 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d291a-f15e-4230-b11a-7c483a0aa2a2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:18.391275 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d291a-f15e-4230-b11a-7c483a0aa2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:18.391550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d291a-f15e-4230-b11a-7c483a0aa2a2 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:18.392288 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d291a-f15e-4230-b11a-7c483a0aa2a2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:18.392610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d291a-f15e-4230-b11a-7c483a0aa2a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:18.393955 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d291a-f15e-4230-b11a-7c483a0aa2a2 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:18.403633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 526/1034] 10.222.0.72 () {56 vars in 1115 bytes} [Mon Aug 29 22:39:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:18.409266 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d291a-f15e-4230-b11a-7c483a0aa2a2 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:18.411410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dcd1f-9495-42f6-8cfe-73b92be4b687 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:18.412221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:18.415180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:18.452083 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef66c14-5df5-4d08-a2c7-b5deb1ec1328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:18.452735 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef66c14-5df5-4d08-a2c7-b5deb1ec1328 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:18.453019 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef66c14-5df5-4d08-a2c7-b5deb1ec1328 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:18.453297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef66c14-5df5-4d08-a2c7-b5deb1ec1328 None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:18.453977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef66c14-5df5-4d08-a2c7-b5deb1ec1328 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:18.455419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef66c14-5df5-4d08-a2c7-b5deb1ec1328 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:18.517427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d291a-f15e-4230-b11a-7c483a0aa2a2 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:18.552796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 509/1035] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:39:18 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:39:18.554122 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e271f0-2880-4947-8b5f-0efd8d494407 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:18.554413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e271f0-2880-4947-8b5f-0efd8d494407 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:18.554884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e271f0-2880-4947-8b5f-0efd8d494407 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:18.555976 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 510/1036] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:18.560461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8cc42-936c-4271-a17b-eb271bb22890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:18.561282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8cc42-936c-4271-a17b-eb271bb22890 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:18.561568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8cc42-936c-4271-a17b-eb271bb22890 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:18.561896 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8cc42-936c-4271-a17b-eb271bb22890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:18.565885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c138c3e-1c4c-4ae1-8405-83304d64befd None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:18.566216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c138c3e-1c4c-4ae1-8405-83304d64befd None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:18.566440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c138c3e-1c4c-4ae1-8405-83304d64befd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:18.576508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8cc42-936c-4271-a17b-eb271bb22890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:18.578014 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8cc42-936c-4271-a17b-eb271bb22890 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:18.586386 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-0c138c3e-1c4c-4ae1-8405-83304d64befd None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:18.588441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0c138c3e-1c4c-4ae1-8405-83304d64befd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-d7b8cc42-936c-4271-a17b-eb271bb22890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:39:18.597119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:18.598176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:39:18.599097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:39:18.599097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:18.599097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:18.599097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 527/1037] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:18.605564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8cc42-936c-4271-a17b-eb271bb22890 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:18.670659 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:18.686268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 511/1038] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:39:18.735570 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8cc42-936c-4271-a17b-eb271bb22890 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:18.780498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169691bd-75b9-43c3-8f7f-67823d09ba2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:18.781445 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169691bd-75b9-43c3-8f7f-67823d09ba2f None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:18.781723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169691bd-75b9-43c3-8f7f-67823d09ba2f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:18.781993 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169691bd-75b9-43c3-8f7f-67823d09ba2f None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:18.782637 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169691bd-75b9-43c3-8f7f-67823d09ba2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:18.782935 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169691bd-75b9-43c3-8f7f-67823d09ba2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:18.785182 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169691bd-75b9-43c3-8f7f-67823d09ba2f None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:18.799940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 528/1039] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:18.807244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c138c3e-1c4c-4ae1-8405-83304d64befd None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:18.930008 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:18.941479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c138c3e-1c4c-4ae1-8405-83304d64befd None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:18.977385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169691bd-75b9-43c3-8f7f-67823d09ba2f None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:18.982365 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe61b71-1744-4473-98f9-996dccd79beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:18.983082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe61b71-1744-4473-98f9-996dccd79beb None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:18.983434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe61b71-1744-4473-98f9-996dccd79beb None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:18.983712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe61b71-1744-4473-98f9-996dccd79beb None admin] PATH_INFO: `/v3/users/nova` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:18.992117 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe61b71-1744-4473-98f9-996dccd79beb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:18.994448 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe61b71-1744-4473-98f9-996dccd79beb None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-ebe61b71-1744-4473-98f9-996dccd79beb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:39:19.008613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:19.010204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:19.013068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:19.013068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:19.013068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:39:19.013068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:39:19.013068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:39:19.013068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:39:19.013068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:39:19.013068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:39:19.013068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:39:19.013068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:19.013068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 512/1040] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Aug 29 22:39:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:19.017043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe61b71-1744-4473-98f9-996dccd79beb None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:19.126532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169691bd-75b9-43c3-8f7f-67823d09ba2f None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:19.146281 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:19.148077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe61b71-1744-4473-98f9-996dccd79beb None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:19.172210 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc178773-d9de-43bf-8ef3-bd4ed2366b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:19.172855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc178773-d9de-43bf-8ef3-bd4ed2366b77 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:19.173136 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc178773-d9de-43bf-8ef3-bd4ed2366b77 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:19.173408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc178773-d9de-43bf-8ef3-bd4ed2366b77 None admin] PATH_INFO: `/v3/services/image` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:19.173998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc178773-d9de-43bf-8ef3-bd4ed2366b77 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:19.175426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc178773-d9de-43bf-8ef3-bd4ed2366b77 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-dc178773-d9de-43bf-8ef3-bd4ed2366b77 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:19.185461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:19.186568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:19.187685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:19.187685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:19.187685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:19.187685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:19.187685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:19.187685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:19.187685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:19.187685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:19.187685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:19.187685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:19.187685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:39:19.187685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:39:19.187685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:39:19.187685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:19.187685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 529/1041] 10.222.0.72 () {56 vars in 1105 bytes} [Mon Aug 29 22:39:18 2022] GET /identity/v3/services/image => generated 86 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:19.192025 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be619e3-9b93-41f3-847f-d094ce436ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:19.192677 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be619e3-9b93-41f3-847f-d094ce436ad4 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:19.192959 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be619e3-9b93-41f3-847f-d094ce436ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:19.193236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be619e3-9b93-41f3-847f-d094ce436ad4 None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:19.193981 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be619e3-9b93-41f3-847f-d094ce436ad4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:19.194282 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be619e3-9b93-41f3-847f-d094ce436ad4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:19.195717 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be619e3-9b93-41f3-847f-d094ce436ad4 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:19.198369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc178773-d9de-43bf-8ef3-bd4ed2366b77 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:19.219134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 513/1042] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Aug 29 22:39:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:19.224970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be619e3-9b93-41f3-847f-d094ce436ad4 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:19.236283 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:19.310408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc178773-d9de-43bf-8ef3-bd4ed2366b77 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:19.338386 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be619e3-9b93-41f3-847f-d094ce436ad4 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:19.350701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f83d2-a88b-4e69-b6c3-3037ed022393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:19.351966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f83d2-a88b-4e69-b6c3-3037ed022393 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:19.352491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f83d2-a88b-4e69-b6c3-3037ed022393 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:19.353258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f83d2-a88b-4e69-b6c3-3037ed022393 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:19.354703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f83d2-a88b-4e69-b6c3-3037ed022393 None admin] RBAC: Adding query filter params (name=image) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:19.355492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f83d2-a88b-4e69-b6c3-3037ed022393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:19.357757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f83d2-a88b-4e69-b6c3-3037ed022393 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:19.365948 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 530/1043] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:19.371947 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f83d2-a88b-4e69-b6c3-3037ed022393 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:19.379254 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9e01f-706d-4515-a527-cbbc307a6e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:19.379962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9e01f-706d-4515-a527-cbbc307a6e34 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:19.380345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9e01f-706d-4515-a527-cbbc307a6e34 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:19.380725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9e01f-706d-4515-a527-cbbc307a6e34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:19.423657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:19.465025 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9e01f-706d-4515-a527-cbbc307a6e34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:19.466854 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9e01f-706d-4515-a527-cbbc307a6e34 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:19.478776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:19.487978 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f83d2-a88b-4e69-b6c3-3037ed022393 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:19.527472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e15e99-68da-4107-8f0c-3e0f25099ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:19.528424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e15e99-68da-4107-8f0c-3e0f25099ce7 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:19.528857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e15e99-68da-4107-8f0c-3e0f25099ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:19.529292 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e15e99-68da-4107-8f0c-3e0f25099ce7 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:19.530151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e15e99-68da-4107-8f0c-3e0f25099ce7 None admin] RBAC: Adding query filter params (type=image) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:19.530612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e15e99-68da-4107-8f0c-3e0f25099ce7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:19.532153 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e15e99-68da-4107-8f0c-3e0f25099ce7 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:19.538402 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 531/1044] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:19.544371 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e15e99-68da-4107-8f0c-3e0f25099ce7 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:19.579127 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 514/1045] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:39:19 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:39:19.584932 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9e01f-706d-4515-a527-cbbc307a6e34 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:19.658856 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e15e99-68da-4107-8f0c-3e0f25099ce7 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:19.666171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:19.701489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9e01f-706d-4515-a527-cbbc307a6e34 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:19.703470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85050d80-bfce-4334-baf9-692d5c901791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:19.704106 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85050d80-bfce-4334-baf9-692d5c901791 None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:19.705213 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85050d80-bfce-4334-baf9-692d5c901791 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:19.705213 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85050d80-bfce-4334-baf9-692d5c901791 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:19.705402 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85050d80-bfce-4334-baf9-692d5c901791 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:19.706865 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85050d80-bfce-4334-baf9-692d5c901791 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:19.713617 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:19.742742 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467059b8-41c7-4e55-b363-d6d200b2f850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:19.743965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467059b8-41c7-4e55-b363-d6d200b2f850 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:19.744478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467059b8-41c7-4e55-b363-d6d200b2f850 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:19.744913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467059b8-41c7-4e55-b363-d6d200b2f850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:19.757224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467059b8-41c7-4e55-b363-d6d200b2f850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:19.759028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467059b8-41c7-4e55-b363-d6d200b2f850 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:19.768502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 532/1046] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:39:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-467059b8-41c7-4e55-b363-d6d200b2f850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:39:19.785484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:19.786609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:39:19.788177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:39:19.788177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:19.788177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:19.788177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 515/1047] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:19.794202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85050d80-bfce-4334-baf9-692d5c901791 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:19.940048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85050d80-bfce-4334-baf9-692d5c901791 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:19.979582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8f8e8-3228-4f6d-8963-948c2481b36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:19.980129 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8f8e8-3228-4f6d-8963-948c2481b36a None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:19.980436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8f8e8-3228-4f6d-8963-948c2481b36a None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:19.980707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8f8e8-3228-4f6d-8963-948c2481b36a None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:19.981365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8f8e8-3228-4f6d-8963-948c2481b36a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:19.981666 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8f8e8-3228-4f6d-8963-948c2481b36a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:19.983046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8f8e8-3228-4f6d-8963-948c2481b36a None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:19.996565 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 533/1048] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:20.002015 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467059b8-41c7-4e55-b363-d6d200b2f850 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:20.110777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467059b8-41c7-4e55-b363-d6d200b2f850 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:20.152321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a49d3-4bbb-4a56-9461-8f80c3e1adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:20.152958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a49d3-4bbb-4a56-9461-8f80c3e1adf2 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:20.153233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a49d3-4bbb-4a56-9461-8f80c3e1adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:20.153501 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a49d3-4bbb-4a56-9461-8f80c3e1adf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:20.160644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a49d3-4bbb-4a56-9461-8f80c3e1adf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:20.162094 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a49d3-4bbb-4a56-9461-8f80c3e1adf2 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:20.173834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-852a49d3-4bbb-4a56-9461-8f80c3e1adf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:39:20.173834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:20.173834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:20.173834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:20.173834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:20.173834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:20.173834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:20.173834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:20.173834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:20.173834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:20.173834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:20.173834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:20.173834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:39:20.173834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:39:20.173834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:20.174871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:20.176403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:39:20.176403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:39:20.176403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:39:20.176403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:39:20.176403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:39:20.176403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:39:20.176403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:39:20.176403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:20.177551 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 516/1049] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:20.181825 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8f8e8-3228-4f6d-8963-948c2481b36a None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:20.201951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:20.288101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8f8e8-3228-4f6d-8963-948c2481b36a None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:20.326143 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaa223-960b-470c-a0dd-4c4b40a217fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:20.326759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaa223-960b-470c-a0dd-4c4b40a217fd None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:20.327050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaa223-960b-470c-a0dd-4c4b40a217fd None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:20.327306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaa223-960b-470c-a0dd-4c4b40a217fd None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:20.328005 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaa223-960b-470c-a0dd-4c4b40a217fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:20.328340 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaa223-960b-470c-a0dd-4c4b40a217fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:20.329774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaa223-960b-470c-a0dd-4c4b40a217fd None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:20.342613 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 534/1050] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:20.348959 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a49d3-4bbb-4a56-9461-8f80c3e1adf2 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:20.373852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:20.471428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a49d3-4bbb-4a56-9461-8f80c3e1adf2 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:20.514239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f2e29-bd78-4be7-9c65-3133d07d613e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:20.514864 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f2e29-bd78-4be7-9c65-3133d07d613e None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:20.515145 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f2e29-bd78-4be7-9c65-3133d07d613e None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:20.515416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f2e29-bd78-4be7-9c65-3133d07d613e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:20.516169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f2e29-bd78-4be7-9c65-3133d07d613e None admin] RBAC: Adding query filter params (role.id=136e6370b0c7476f898673d4d697ed28, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=0be09bd9ba7443aaa31879f56ca4aad1) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:20.516507 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f2e29-bd78-4be7-9c65-3133d07d613e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:20.517981 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f2e29-bd78-4be7-9c65-3133d07d613e None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:20.525425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 517/1051] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:39:20 2022] GET /identity/v3/role_assignments?user.id=0be09bd9ba7443aaa31879f56ca4aad1&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=136e6370b0c7476f898673d4d697ed28 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:20.780118 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a4b27-e145-465e-95d6-97fb5e115624 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:20.780870 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a4b27-e145-465e-95d6-97fb5e115624 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:20.780870 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a4b27-e145-465e-95d6-97fb5e115624 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:20.782058 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 535/1052] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:20.787533 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ceb99-2bd4-4e7b-b10d-ebd0c3c5931c None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:20.788028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ceb99-2bd4-4e7b-b10d-ebd0c3c5931c None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:20.788117 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ceb99-2bd4-4e7b-b10d-ebd0c3c5931c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:20.808881 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-d25ceb99-2bd4-4e7b-b10d-ebd0c3c5931c None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:20.810085 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d25ceb99-2bd4-4e7b-b10d-ebd0c3c5931c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:20.885921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 518/1053] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:21.162314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a4b27-e145-465e-95d6-97fb5e115624 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:21.251085 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:21.274130 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a4b27-e145-465e-95d6-97fb5e115624 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:21.311196 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7045df9-5ef3-4d0b-bdae-2257dcaeab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:21.311822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7045df9-5ef3-4d0b-bdae-2257dcaeab30 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:21.312146 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7045df9-5ef3-4d0b-bdae-2257dcaeab30 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:21.312534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7045df9-5ef3-4d0b-bdae-2257dcaeab30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:21.324329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7045df9-5ef3-4d0b-bdae-2257dcaeab30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-e7045df9-5ef3-4d0b-bdae-2257dcaeab30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:39:21.329128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:21.330040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:21.333079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:21.333079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:21.333079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:21.333079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:21.333079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:39:21.333079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:39:21.333079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:39:21.333079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:39:21.333079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:39:21.333079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:39:21.333079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:39:21.333079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:21.333079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 536/1054] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:39:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:21.336794 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ceb99-2bd4-4e7b-b10d-ebd0c3c5931c None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:21.357311 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:21.460281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ceb99-2bd4-4e7b-b10d-ebd0c3c5931c None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:21.500169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd8059-8cfc-4be6-b4f5-7c9fad4e2a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:21.500821 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd8059-8cfc-4be6-b4f5-7c9fad4e2a1c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:21.501092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd8059-8cfc-4be6-b4f5-7c9fad4e2a1c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:21.501363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd8059-8cfc-4be6-b4f5-7c9fad4e2a1c None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:21.502099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd8059-8cfc-4be6-b4f5-7c9fad4e2a1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:21.502406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd8059-8cfc-4be6-b4f5-7c9fad4e2a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:21.503771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd8059-8cfc-4be6-b4f5-7c9fad4e2a1c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:21.517950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 519/1055] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:39:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:21.519497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7045df9-5ef3-4d0b-bdae-2257dcaeab30 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:21.632564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7045df9-5ef3-4d0b-bdae-2257dcaeab30 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:21.668643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5dce5-66f3-453e-b078-5f7edc59d164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:21.669281 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5dce5-66f3-453e-b078-5f7edc59d164 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:21.669567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5dce5-66f3-453e-b078-5f7edc59d164 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:21.669843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5dce5-66f3-453e-b078-5f7edc59d164 None admin] PATH_INFO: `/v3/users/73675186db284ce89a84e8b2f9c21e25` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:21.680285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:21.686812 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5dce5-66f3-453e-b078-5f7edc59d164 None admin] RBAC: Authorizing `identity:get_user(user_id=73675186db284ce89a84e8b2f9c21e25)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:21.688322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5dce5-66f3-453e-b078-5f7edc59d164 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:21.690314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 537/1056] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:39:21 2022] GET /identity/v3/users/73675186db284ce89a84e8b2f9c21e25 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:21.695971 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd8059-8cfc-4be6-b4f5-7c9fad4e2a1c None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:21.780008 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:21.804968 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd8059-8cfc-4be6-b4f5-7c9fad4e2a1c None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:21.846421 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cf136-7f52-4f3c-b850-84ef4e2df6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:21.847411 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cf136-7f52-4f3c-b850-84ef4e2df6c0 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:21.847934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cf136-7f52-4f3c-b850-84ef4e2df6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:21.848466 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cf136-7f52-4f3c-b850-84ef4e2df6c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:21.863995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1eeed-6797-43a1-8e0c-382e7d777c1e None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:21.864574 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1eeed-6797-43a1-8e0c-382e7d777c1e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:21.864665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1eeed-6797-43a1-8e0c-382e7d777c1e None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:21.865997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 538/1057] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:39:21.872692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a6a9b-c441-46ce-bcde-654b64fa0c7a None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:21.873199 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a6a9b-c441-46ce-bcde-654b64fa0c7a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:21.873618 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a6a9b-c441-46ce-bcde-654b64fa0c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:21.892444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-708a6a9b-c441-46ce-bcde-654b64fa0c7a None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:21.893886 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-708a6a9b-c441-46ce-bcde-654b64fa0c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:21.937885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cf136-7f52-4f3c-b850-84ef4e2df6c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:21.939264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cf136-7f52-4f3c-b850-84ef4e2df6c0 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:21.979860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 539/1058] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:39:22.035962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:22.069020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 520/1059] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:39:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:39:22.078074 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a6a9b-c441-46ce-bcde-654b64fa0c7a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:22.208654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a6a9b-c441-46ce-bcde-654b64fa0c7a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:22.239303 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:22.249593 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d3ae1-797d-489d-b12a-185902181498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:22.250237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d3ae1-797d-489d-b12a-185902181498 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:22.252175 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d3ae1-797d-489d-b12a-185902181498 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:22.252175 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d3ae1-797d-489d-b12a-185902181498 None admin] PATH_INFO: `/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:22.252175 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d3ae1-797d-489d-b12a-185902181498 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0ccdc1eb754979b2cdc3637e18740b)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:22.253930 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d3ae1-797d-489d-b12a-185902181498 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:22.255940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 540/1060] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:39:22 2022] GET /identity/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:22.263026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cf136-7f52-4f3c-b850-84ef4e2df6c0 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:22.289766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d3ae1-797d-489d-b12a-185902181498 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:22.383574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cf136-7f52-4f3c-b850-84ef4e2df6c0 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:22.413612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d3ae1-797d-489d-b12a-185902181498 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:22.428963 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52d007-76ee-40d8-8742-34cf9da60a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:22.429378 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52d007-76ee-40d8-8742-34cf9da60a7b None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:22.429555 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52d007-76ee-40d8-8742-34cf9da60a7b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:22.429795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52d007-76ee-40d8-8742-34cf9da60a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:22.431127 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52d007-76ee-40d8-8742-34cf9da60a7b None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=8e0ccdc1eb754979b2cdc3637e18740b, user.id=73675186db284ce89a84e8b2f9c21e25) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:22.431470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52d007-76ee-40d8-8742-34cf9da60a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:22.433104 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52d007-76ee-40d8-8742-34cf9da60a7b None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:22.448227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 521/1061] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:39:22 2022] GET /identity/v3/role_assignments?user.id=73675186db284ce89a84e8b2f9c21e25&scope.project.id=8e0ccdc1eb754979b2cdc3637e18740b&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:22.469027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aefcfc-f451-4b98-b57b-501d7e744bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:22.469027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aefcfc-f451-4b98-b57b-501d7e744bb6 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:22.469027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aefcfc-f451-4b98-b57b-501d7e744bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:22.469027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aefcfc-f451-4b98-b57b-501d7e744bb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:22.497255 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8fb73-448a-4985-a925-bc05d2006011 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:22.497539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8fb73-448a-4985-a925-bc05d2006011 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:22.497814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8fb73-448a-4985-a925-bc05d2006011 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:22.499701 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 522/1062] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:39:22.505574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fa76c-26d4-4034-8540-a9f98c1ee851 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:22.505988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fa76c-26d4-4034-8540-a9f98c1ee851 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:22.506339 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fa76c-26d4-4034-8540-a9f98c1ee851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:22.526287 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-163fa76c-26d4-4034-8540-a9f98c1ee851 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:22.527541 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-163fa76c-26d4-4034-8540-a9f98c1ee851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:22.547961 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:22.557506 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aefcfc-f451-4b98-b57b-501d7e744bb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:22.558994 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aefcfc-f451-4b98-b57b-501d7e744bb6 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:22.569744 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:22.616163 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 523/1063] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:39:22.676834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 541/1064] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:39:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:39:22.683210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fa76c-26d4-4034-8540-a9f98c1ee851 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:22.798782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fa76c-26d4-4034-8540-a9f98c1ee851 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:22.840499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267571cb-8839-405d-b78e-21e937fbf4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:22.841170 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267571cb-8839-405d-b78e-21e937fbf4d6 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:22.841413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267571cb-8839-405d-b78e-21e937fbf4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:22.841675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267571cb-8839-405d-b78e-21e937fbf4d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:22.853402 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267571cb-8839-405d-b78e-21e937fbf4d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:22.854861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267571cb-8839-405d-b78e-21e937fbf4d6 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-267571cb-8839-405d-b78e-21e937fbf4d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:39:22.871645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:22.873299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:39:22.874201 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:39:22.874201 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:22.874201 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:22.874201 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 524/1065] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:22.879142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aefcfc-f451-4b98-b57b-501d7e744bb6 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:22.911097 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267571cb-8839-405d-b78e-21e937fbf4d6 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:22.956502 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:23.010325 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:23.018160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aefcfc-f451-4b98-b57b-501d7e744bb6 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:23.048664 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267571cb-8839-405d-b78e-21e937fbf4d6 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:23.058484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdab48d-2d5a-4bc3-b7b2-69b7c16ad79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:23.059382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdab48d-2d5a-4bc3-b7b2-69b7c16ad79e None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:23.059661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdab48d-2d5a-4bc3-b7b2-69b7c16ad79e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:23.059941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdab48d-2d5a-4bc3-b7b2-69b7c16ad79e None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:23.060623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdab48d-2d5a-4bc3-b7b2-69b7c16ad79e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:23.060936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdab48d-2d5a-4bc3-b7b2-69b7c16ad79e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:23.062306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdab48d-2d5a-4bc3-b7b2-69b7c16ad79e None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:23.077680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 542/1066] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:23.088387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6eada-595b-428f-865a-f5df691b48b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:23.089329 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6eada-595b-428f-865a-f5df691b48b1 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:23.089758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6eada-595b-428f-865a-f5df691b48b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:23.090173 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6eada-595b-428f-865a-f5df691b48b1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:23.105218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6eada-595b-428f-865a-f5df691b48b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-2ae6eada-595b-428f-865a-f5df691b48b1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:39:23.110508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:23.111573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:23.113506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:23.113506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:23.113506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:23.113506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:23.113506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:39:23.113506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:39:23.113506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:39:23.113506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:39:23.113506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:39:23.113506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:39:23.113506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:39:23.113506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:23.113506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 525/1067] 10.222.0.72 () {56 vars in 1120 bytes} [Mon Aug 29 22:39:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:23.118630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdab48d-2d5a-4bc3-b7b2-69b7c16ad79e None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:23.261812 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdab48d-2d5a-4bc3-b7b2-69b7c16ad79e None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:23.303758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968bd64-0450-4665-96bd-d6f420bd016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:23.304416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968bd64-0450-4665-96bd-d6f420bd016a None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:23.304697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968bd64-0450-4665-96bd-d6f420bd016a None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:23.304966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968bd64-0450-4665-96bd-d6f420bd016a None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:23.305721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968bd64-0450-4665-96bd-d6f420bd016a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:23.306183 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968bd64-0450-4665-96bd-d6f420bd016a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:23.307569 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968bd64-0450-4665-96bd-d6f420bd016a None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:23.316554 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 543/1068] 10.222.0.72 () {56 vars in 1115 bytes} [Mon Aug 29 22:39:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:23.322868 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6eada-595b-428f-865a-f5df691b48b1 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:23.426178 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:23.445683 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6eada-595b-428f-865a-f5df691b48b1 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:23.483594 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3ae5f-021e-46b5-8b9c-36543d1ff139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:23.484259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3ae5f-021e-46b5-8b9c-36543d1ff139 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:23.484543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3ae5f-021e-46b5-8b9c-36543d1ff139 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:23.484816 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3ae5f-021e-46b5-8b9c-36543d1ff139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:23.497379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3ae5f-021e-46b5-8b9c-36543d1ff139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:23.498849 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3ae5f-021e-46b5-8b9c-36543d1ff139 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-43d3ae5f-021e-46b5-8b9c-36543d1ff139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:39:23.514942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:23.515970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:39:23.516901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:39:23.516901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:23.516901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:23.516901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 526/1069] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:23.521904 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968bd64-0450-4665-96bd-d6f420bd016a None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:23.543474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:23.630624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968bd64-0450-4665-96bd-d6f420bd016a None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:23.666432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23185c01-b8b3-4f30-99d6-552aa051fadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:23.667046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185c01-b8b3-4f30-99d6-552aa051fadf None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:23.667325 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185c01-b8b3-4f30-99d6-552aa051fadf None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:23.667597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185c01-b8b3-4f30-99d6-552aa051fadf None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:23.668278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23185c01-b8b3-4f30-99d6-552aa051fadf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:23.668585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23185c01-b8b3-4f30-99d6-552aa051fadf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:23.669952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23185c01-b8b3-4f30-99d6-552aa051fadf None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:23.682333 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 544/1070] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:23.688135 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3ae5f-021e-46b5-8b9c-36543d1ff139 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:23.791611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3ae5f-021e-46b5-8b9c-36543d1ff139 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:23.827331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b51d74-bd68-452d-932d-90d5acc2bd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:23.827966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b51d74-bd68-452d-932d-90d5acc2bd15 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:23.828278 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b51d74-bd68-452d-932d-90d5acc2bd15 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:23.828555 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b51d74-bd68-452d-932d-90d5acc2bd15 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:23.830698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:23.838637 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b51d74-bd68-452d-932d-90d5acc2bd15 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:23.842309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b51d74-bd68-452d-932d-90d5acc2bd15 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-78b51d74-bd68-452d-932d-90d5acc2bd15 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:39:23.857202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:23.858404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:23.859668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:23.859668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:23.859668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:39:23.859668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:39:23.859668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:39:23.859668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:39:23.859668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:39:23.859668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:39:23.859668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:39:23.859668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:23.860556 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 527/1071] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Aug 29 22:39:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:23.864757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23185c01-b8b3-4f30-99d6-552aa051fadf None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:23.952557 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:23.978103 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23185c01-b8b3-4f30-99d6-552aa051fadf None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:24.015427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777a5fb-c6f0-4ce9-aeb1-8230415f877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:24.016043 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777a5fb-c6f0-4ce9-aeb1-8230415f877f None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:24.016358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777a5fb-c6f0-4ce9-aeb1-8230415f877f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:24.016647 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777a5fb-c6f0-4ce9-aeb1-8230415f877f None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:24.017392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777a5fb-c6f0-4ce9-aeb1-8230415f877f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:24.017698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777a5fb-c6f0-4ce9-aeb1-8230415f877f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:24.019184 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777a5fb-c6f0-4ce9-aeb1-8230415f877f None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:24.036917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 545/1072] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Aug 29 22:39:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:24.044295 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b51d74-bd68-452d-932d-90d5acc2bd15 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:24.154594 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b51d74-bd68-452d-932d-90d5acc2bd15 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:24.189494 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb47e7-8639-48be-8fc7-e4f427947c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:24.190143 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb47e7-8639-48be-8fc7-e4f427947c54 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:24.190407 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb47e7-8639-48be-8fc7-e4f427947c54 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:24.190679 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb47e7-8639-48be-8fc7-e4f427947c54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:24.201924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb47e7-8639-48be-8fc7-e4f427947c54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:24.203441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb47e7-8639-48be-8fc7-e4f427947c54 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-38eb47e7-8639-48be-8fc7-e4f427947c54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:39:24.217813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:24.219001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:39:24.219931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:39:24.219931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:24.219931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:24.219931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 528/1073] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:24.225108 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777a5fb-c6f0-4ce9-aeb1-8230415f877f None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:24.328689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777a5fb-c6f0-4ce9-aeb1-8230415f877f None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:24.364304 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895f7a6-69ae-4667-81a3-a0fa485d3547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:24.364919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895f7a6-69ae-4667-81a3-a0fa485d3547 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:24.365202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895f7a6-69ae-4667-81a3-a0fa485d3547 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:24.365479 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895f7a6-69ae-4667-81a3-a0fa485d3547 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:24.366127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895f7a6-69ae-4667-81a3-a0fa485d3547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:24.366434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895f7a6-69ae-4667-81a3-a0fa485d3547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:24.367820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895f7a6-69ae-4667-81a3-a0fa485d3547 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:24.370124 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:24.380992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 546/1074] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:24.387021 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb47e7-8639-48be-8fc7-e4f427947c54 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:24.428777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed18a80-7b5e-44fa-adad-6687583f9139 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:24.429069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed18a80-7b5e-44fa-adad-6687583f9139 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:24.429348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed18a80-7b5e-44fa-adad-6687583f9139 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:24.431406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 547/1075] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:39:24.436725 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8758d-bc56-4012-88a0-9e41fcae35f6 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:24.437025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8758d-bc56-4012-88a0-9e41fcae35f6 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:24.437311 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8758d-bc56-4012-88a0-9e41fcae35f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:24.440427 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:24.457072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-01c8758d-bc56-4012-88a0-9e41fcae35f6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:24.458210 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-01c8758d-bc56-4012-88a0-9e41fcae35f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:24.497938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb47e7-8639-48be-8fc7-e4f427947c54 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:24.529201 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 548/1076] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:39:24.532073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cca070-a829-4404-9055-99a7b940c4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:24.532750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cca070-a829-4404-9055-99a7b940c4c4 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:24.533037 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cca070-a829-4404-9055-99a7b940c4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:24.533307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cca070-a829-4404-9055-99a7b940c4c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:24.540751 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cca070-a829-4404-9055-99a7b940c4c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:24.542203 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cca070-a829-4404-9055-99a7b940c4c4 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:24.553652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-f4cca070-a829-4404-9055-99a7b940c4c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:39:24.553652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:24.553652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:24.553652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:24.553652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:24.553652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:24.553652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:24.553652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:24.553652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:24.553652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:24.553652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:24.553652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:24.553652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:39:24.553652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:39:24.553652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:24.554681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:24.557220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:39:24.557220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:39:24.557220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:39:24.557220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:39:24.557220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:39:24.557220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:39:24.557220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:39:24.557220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:24.557220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 529/1077] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:24.561362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8758d-bc56-4012-88a0-9e41fcae35f6 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:24.663710 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8758d-bc56-4012-88a0-9e41fcae35f6 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:24.688218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:24.699101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f63ce-12a7-42a0-b183-59b5906289df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:24.700868 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f63ce-12a7-42a0-b183-59b5906289df None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:24.700868 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f63ce-12a7-42a0-b183-59b5906289df None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:24.700868 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f63ce-12a7-42a0-b183-59b5906289df None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:24.701116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f63ce-12a7-42a0-b183-59b5906289df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:24.701234 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f63ce-12a7-42a0-b183-59b5906289df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:24.702653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f63ce-12a7-42a0-b183-59b5906289df None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:24.715127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 549/1078] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:24.721826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cca070-a829-4404-9055-99a7b940c4c4 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:24.804366 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f63ce-12a7-42a0-b183-59b5906289df None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:24.827073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cca070-a829-4404-9055-99a7b940c4c4 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:24.834043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:24.863024 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f46160-b8b5-444f-820a-530a5ceb3994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:24.863691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f46160-b8b5-444f-820a-530a5ceb3994 None admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:24.863950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f46160-b8b5-444f-820a-530a5ceb3994 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:24.864243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f46160-b8b5-444f-820a-530a5ceb3994 None admin] PATH_INFO: `/v3/projects/7abc4d6c6e004b15abff7738164175db/users/0be09bd9ba7443aaa31879f56ca4aad1/roles/136e6370b0c7476f898673d4d697ed28` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:24.866543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f46160-b8b5-444f-820a-530a5ceb3994 None admin] RBAC: Authorizing `identity:create_grant(project_id=7abc4d6c6e004b15abff7738164175db, user_id=0be09bd9ba7443aaa31879f56ca4aad1, role_id=136e6370b0c7476f898673d4d697ed28)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:24.868999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f46160-b8b5-444f-820a-530a5ceb3994 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:24.911421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f63ce-12a7-42a0-b183-59b5906289df None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:24.936205 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 530/1079] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:39:24 2022] PUT /identity/v3/projects/7abc4d6c6e004b15abff7738164175db/users/0be09bd9ba7443aaa31879f56ca4aad1/roles/136e6370b0c7476f898673d4d697ed28 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:39:24.952505 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bab71-4ac2-49ae-bb03-8b6c941f3e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:24.953176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bab71-4ac2-49ae-bb03-8b6c941f3e7d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:24.953714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bab71-4ac2-49ae-bb03-8b6c941f3e7d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:24.953714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bab71-4ac2-49ae-bb03-8b6c941f3e7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:24.968974 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bab71-4ac2-49ae-bb03-8b6c941f3e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-2d3bab71-4ac2-49ae-bb03-8b6c941f3e7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:39:24.974204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:24.975436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:24.976481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:24.976481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:24.976481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:24.976481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:24.976481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:39:24.976481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:39:24.976481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:39:24.976481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:39:24.976481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:39:24.976481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:39:24.976481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:39:24.976481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:24.976481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 550/1080] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:39:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:24.982241 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f46160-b8b5-444f-820a-530a5ceb3994 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:25.100127 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f46160-b8b5-444f-820a-530a5ceb3994 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:25.135721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7f40d-7a67-4e5e-b0af-1a86d45709b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:25.136383 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7f40d-7a67-4e5e-b0af-1a86d45709b2 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:25.136668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7f40d-7a67-4e5e-b0af-1a86d45709b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:25.136941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7f40d-7a67-4e5e-b0af-1a86d45709b2 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:25.137606 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7f40d-7a67-4e5e-b0af-1a86d45709b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:25.137911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7f40d-7a67-4e5e-b0af-1a86d45709b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:25.139279 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7f40d-7a67-4e5e-b0af-1a86d45709b2 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:25.148328 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 531/1081] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:39:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:25.155119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bab71-4ac2-49ae-bb03-8b6c941f3e7d None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:25.203450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:25.262007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bab71-4ac2-49ae-bb03-8b6c941f3e7d None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:25.297067 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb2bed-928e-4d43-a883-8af15f9c5280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:25.297697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb2bed-928e-4d43-a883-8af15f9c5280 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:25.297983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb2bed-928e-4d43-a883-8af15f9c5280 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:25.298251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb2bed-928e-4d43-a883-8af15f9c5280 None admin] PATH_INFO: `/v3/users/73675186db284ce89a84e8b2f9c21e25` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:25.299742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb2bed-928e-4d43-a883-8af15f9c5280 None admin] RBAC: Authorizing `identity:get_user(user_id=73675186db284ce89a84e8b2f9c21e25)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:25.300871 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb2bed-928e-4d43-a883-8af15f9c5280 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:25.302478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 551/1082] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:39:25 2022] GET /identity/v3/users/73675186db284ce89a84e8b2f9c21e25 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:25.309040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7f40d-7a67-4e5e-b0af-1a86d45709b2 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:25.338386 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:25.416922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7f40d-7a67-4e5e-b0af-1a86d45709b2 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:25.453158 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989979f-2eb4-48d3-b9f6-627ae0750924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:25.453843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989979f-2eb4-48d3-b9f6-627ae0750924 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:25.454124 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989979f-2eb4-48d3-b9f6-627ae0750924 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:25.454435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989979f-2eb4-48d3-b9f6-627ae0750924 None admin] PATH_INFO: `/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:25.455574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989979f-2eb4-48d3-b9f6-627ae0750924 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0ccdc1eb754979b2cdc3637e18740b)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:25.457224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989979f-2eb4-48d3-b9f6-627ae0750924 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:25.458932 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 532/1083] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:39:25 2022] GET /identity/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:25.465447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb2bed-928e-4d43-a883-8af15f9c5280 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:25.568303 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb2bed-928e-4d43-a883-8af15f9c5280 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:25.581841 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:25.604595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec47c9-e7ce-4055-bba9-96aaf9c6eea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:25.605261 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec47c9-e7ce-4055-bba9-96aaf9c6eea4 None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:25.605542 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec47c9-e7ce-4055-bba9-96aaf9c6eea4 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:25.605817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec47c9-e7ce-4055-bba9-96aaf9c6eea4 None admin] PATH_INFO: `/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b/users/73675186db284ce89a84e8b2f9c21e25/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:25.607712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec47c9-e7ce-4055-bba9-96aaf9c6eea4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e0ccdc1eb754979b2cdc3637e18740b, user_id=73675186db284ce89a84e8b2f9c21e25, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:25.609223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec47c9-e7ce-4055-bba9-96aaf9c6eea4 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:25.678609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 552/1084] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:39:25 2022] PUT /identity/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b/users/73675186db284ce89a84e8b2f9c21e25/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:39:26.912617 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd9f3d-94c1-4d20-8dd5-6942682d2e9d None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:26.913176 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd9f3d-94c1-4d20-8dd5-6942682d2e9d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:26.913176 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd9f3d-94c1-4d20-8dd5-6942682d2e9d None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:26.914533 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 533/1085] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:26.920678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a86f90-7a45-4475-982b-b98c616adfb6 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:26.921168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a86f90-7a45-4475-982b-b98c616adfb6 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:26.921378 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a86f90-7a45-4475-982b-b98c616adfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:26.941787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-47a86f90-7a45-4475-982b-b98c616adfb6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:26.942020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-47a86f90-7a45-4475-982b-b98c616adfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:27.013439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 553/1086] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:27.292832 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd9f3d-94c1-4d20-8dd5-6942682d2e9d None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:27.402970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:27.409744 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd9f3d-94c1-4d20-8dd5-6942682d2e9d None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:27.448025 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea117bb0-35d6-4c16-bd03-6308108af4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:27.448704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea117bb0-35d6-4c16-bd03-6308108af4d4 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:27.449064 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea117bb0-35d6-4c16-bd03-6308108af4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:27.449338 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea117bb0-35d6-4c16-bd03-6308108af4d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:27.460073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea117bb0-35d6-4c16-bd03-6308108af4d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-ea117bb0-35d6-4c16-bd03-6308108af4d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:39:27.465018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:27.467050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:27.467950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:27.467950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:27.467950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:27.467950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:27.467950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:39:27.467950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:39:27.467950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:39:27.467950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:39:27.467950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:39:27.467950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:39:27.467950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:39:27.467950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:27.467950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 534/1087] 10.222.0.72 () {56 vars in 1120 bytes} [Mon Aug 29 22:39:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:27.472798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a86f90-7a45-4475-982b-b98c616adfb6 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:27.596153 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a86f90-7a45-4475-982b-b98c616adfb6 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:27.597699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:27.601566 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbab95-a279-4602-8c51-c018b3b0ceec None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:27.601847 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbab95-a279-4602-8c51-c018b3b0ceec None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:27.602675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbab95-a279-4602-8c51-c018b3b0ceec None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:27.604106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 535/1088] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:39:27.609721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f81706-cefa-4b8f-9e09-615e7452bafb None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:27.610002 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f81706-cefa-4b8f-9e09-615e7452bafb None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:27.610285 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f81706-cefa-4b8f-9e09-615e7452bafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:27.629416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-53f81706-cefa-4b8f-9e09-615e7452bafb None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:27.630630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-53f81706-cefa-4b8f-9e09-615e7452bafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:27.635800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58f9bf-f399-4df1-8fb1-6ac6bf777ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:27.636592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58f9bf-f399-4df1-8fb1-6ac6bf777ab8 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:27.636881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58f9bf-f399-4df1-8fb1-6ac6bf777ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:27.637153 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58f9bf-f399-4df1-8fb1-6ac6bf777ab8 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:27.637838 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58f9bf-f399-4df1-8fb1-6ac6bf777ab8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:27.638125 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58f9bf-f399-4df1-8fb1-6ac6bf777ab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:27.639557 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58f9bf-f399-4df1-8fb1-6ac6bf777ab8 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:27.647889 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 554/1089] 10.222.0.72 () {56 vars in 1115 bytes} [Mon Aug 29 22:39:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:27.654291 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58f9bf-f399-4df1-8fb1-6ac6bf777ab8 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:27.701180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 536/1090] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:39:27.757994 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58f9bf-f399-4df1-8fb1-6ac6bf777ab8 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:27.792843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a262460-df3e-4fc0-a4d4-4e2785e86a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:27.793473 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a262460-df3e-4fc0-a4d4-4e2785e86a3c None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:27.793750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a262460-df3e-4fc0-a4d4-4e2785e86a3c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:27.794020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a262460-df3e-4fc0-a4d4-4e2785e86a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:27.806053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a262460-df3e-4fc0-a4d4-4e2785e86a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:27.807511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a262460-df3e-4fc0-a4d4-4e2785e86a3c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-5a262460-df3e-4fc0-a4d4-4e2785e86a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:39:27.822669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:27.823792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:39:27.826313 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:39:27.826313 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:27.826313 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:27.826313 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 555/1091] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:27.830070 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f81706-cefa-4b8f-9e09-615e7452bafb None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:27.918382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:27.934592 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f81706-cefa-4b8f-9e09-615e7452bafb None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:27.969381 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a262460-df3e-4fc0-a4d4-4e2785e86a3c None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:27.972004 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf2994-bc89-4acc-8c2e-2f472af392ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:27.972699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf2994-bc89-4acc-8c2e-2f472af392ab None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:27.972980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf2994-bc89-4acc-8c2e-2f472af392ab None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:27.973245 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf2994-bc89-4acc-8c2e-2f472af392ab None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:27.973900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf2994-bc89-4acc-8c2e-2f472af392ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:27.974203 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf2994-bc89-4acc-8c2e-2f472af392ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:27.975573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf2994-bc89-4acc-8c2e-2f472af392ab None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:27.988735 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 537/1092] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:27.989077 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:27.994956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf2994-bc89-4acc-8c2e-2f472af392ab None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:28.079781 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a262460-df3e-4fc0-a4d4-4e2785e86a3c None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:28.102184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf2994-bc89-4acc-8c2e-2f472af392ab None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:28.117363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5be82-01c3-425a-a072-2dd36b285e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:28.118324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5be82-01c3-425a-a072-2dd36b285e96 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:28.118818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5be82-01c3-425a-a072-2dd36b285e96 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:28.119168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5be82-01c3-425a-a072-2dd36b285e96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:28.131001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5be82-01c3-425a-a072-2dd36b285e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-46c5be82-01c3-425a-a072-2dd36b285e96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:39:28.136821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:28.137858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:28.139035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:28.139035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:28.139035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:28.139035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:28.139035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:39:28.139035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:39:28.139035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:39:28.139035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:39:28.139035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:39:28.139035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:39:28.139035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:39:28.139035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:28.139035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 556/1093] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:39:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:28.140914 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d1a45-ab8c-427e-aafa-261c29a707cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:28.141571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d1a45-ab8c-427e-aafa-261c29a707cf None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:28.141854 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d1a45-ab8c-427e-aafa-261c29a707cf None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:28.142128 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d1a45-ab8c-427e-aafa-261c29a707cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:28.144177 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5be82-01c3-425a-a072-2dd36b285e96 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:28.151616 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d1a45-ab8c-427e-aafa-261c29a707cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:28.153104 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d1a45-ab8c-427e-aafa-261c29a707cf None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-1f3d1a45-ab8c-427e-aafa-261c29a707cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:39:28.165696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:28.166795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:28.167814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:28.167814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:28.167814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:39:28.167814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:39:28.167814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:39:28.167814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:39:28.167814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:39:28.167814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:39:28.167814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:39:28.167814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:28.167814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 538/1094] 10.222.0.72 () {56 vars in 1093 bytes} [Mon Aug 29 22:39:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:28.172989 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d1a45-ab8c-427e-aafa-261c29a707cf None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:28.182359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:28.226618 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:28.257768 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5be82-01c3-425a-a072-2dd36b285e96 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:28.290185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d1a45-ab8c-427e-aafa-261c29a707cf None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:28.292506 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba227e-cdbd-4fb4-9046-032bc3c07ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:28.293124 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba227e-cdbd-4fb4-9046-032bc3c07ad2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:28.293402 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba227e-cdbd-4fb4-9046-032bc3c07ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:28.293676 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba227e-cdbd-4fb4-9046-032bc3c07ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:28.294339 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba227e-cdbd-4fb4-9046-032bc3c07ad2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:28.294635 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba227e-cdbd-4fb4-9046-032bc3c07ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:28.296014 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba227e-cdbd-4fb4-9046-032bc3c07ad2 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:28.304920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 557/1095] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:39:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:28.311713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba227e-cdbd-4fb4-9046-032bc3c07ad2 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:28.327193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e2a98-52c9-416e-bba9-cccfd6d1ecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:28.327813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e2a98-52c9-416e-bba9-cccfd6d1ecd8 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:28.328093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e2a98-52c9-416e-bba9-cccfd6d1ecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:28.328402 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e2a98-52c9-416e-bba9-cccfd6d1ecd8 None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:28.329141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e2a98-52c9-416e-bba9-cccfd6d1ecd8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:28.329446 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e2a98-52c9-416e-bba9-cccfd6d1ecd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:28.330879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e2a98-52c9-416e-bba9-cccfd6d1ecd8 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:28.350488 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 539/1096] 10.222.0.72 () {56 vars in 1133 bytes} [Mon Aug 29 22:39:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:28.357396 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e2a98-52c9-416e-bba9-cccfd6d1ecd8 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:28.421032 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba227e-cdbd-4fb4-9046-032bc3c07ad2 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:28.427214 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:28.458397 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05288f-2576-4de3-a9f5-1de990610ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:28.459050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05288f-2576-4de3-a9f5-1de990610ccb None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:28.459329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05288f-2576-4de3-a9f5-1de990610ccb None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:28.459602 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05288f-2576-4de3-a9f5-1de990610ccb None admin] PATH_INFO: `/v3/users/73675186db284ce89a84e8b2f9c21e25` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:28.460875 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05288f-2576-4de3-a9f5-1de990610ccb None admin] RBAC: Authorizing `identity:get_user(user_id=73675186db284ce89a84e8b2f9c21e25)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:28.462812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e2a98-52c9-416e-bba9-cccfd6d1ecd8 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:28.462925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05288f-2576-4de3-a9f5-1de990610ccb None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:28.464476 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 558/1097] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:39:28 2022] GET /identity/v3/users/73675186db284ce89a84e8b2f9c21e25 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:28.470797 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05288f-2576-4de3-a9f5-1de990610ccb None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:28.481558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:28.500907 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ad5db-f0fe-4c2e-b6dc-e70852c25e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:28.501527 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ad5db-f0fe-4c2e-b6dc-e70852c25e10 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:28.501805 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ad5db-f0fe-4c2e-b6dc-e70852c25e10 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:28.502222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ad5db-f0fe-4c2e-b6dc-e70852c25e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:28.574969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ad5db-f0fe-4c2e-b6dc-e70852c25e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:28.576447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ad5db-f0fe-4c2e-b6dc-e70852c25e10 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:28.578074 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05288f-2576-4de3-a9f5-1de990610ccb None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:28.613669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13936a-0822-4099-b814-c774741ae8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:28.614266 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13936a-0822-4099-b814-c774741ae8c9 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:28.614541 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13936a-0822-4099-b814-c774741ae8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:28.614808 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13936a-0822-4099-b814-c774741ae8c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:28.640146 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:28.683226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 540/1098] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:39:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:39:28.684858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13936a-0822-4099-b814-c774741ae8c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:28.686319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13936a-0822-4099-b814-c774741ae8c9 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:28.688929 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ad5db-f0fe-4c2e-b6dc-e70852c25e10 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:28.694694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:28.791678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 559/1099] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:39:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:39:28.794066 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ad5db-f0fe-4c2e-b6dc-e70852c25e10 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:28.797630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13936a-0822-4099-b814-c774741ae8c9 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:28.831382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e7dc0-26e4-42db-b8b3-9e21af4c2dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:28.832016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e7dc0-26e4-42db-b8b3-9e21af4c2dd1 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:28.832325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e7dc0-26e4-42db-b8b3-9e21af4c2dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:28.832597 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e7dc0-26e4-42db-b8b3-9e21af4c2dd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:28.843231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e7dc0-26e4-42db-b8b3-9e21af4c2dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:28.844761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e7dc0-26e4-42db-b8b3-9e21af4c2dd1 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-1f9e7dc0-26e4-42db-b8b3-9e21af4c2dd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:39:28.861353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:28.862451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:39:28.863369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:39:28.863369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:39:28.863369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:28.863369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 541/1100] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:28.869644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e7dc0-26e4-42db-b8b3-9e21af4c2dd1 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:28.890278 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:28.906886 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13936a-0822-4099-b814-c774741ae8c9 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:28.916168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:28.947477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f1151-f872-4b69-b582-63cefb923f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:28.948033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f1151-f872-4b69-b582-63cefb923f23 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:28.948441 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f1151-f872-4b69-b582-63cefb923f23 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:28.948717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f1151-f872-4b69-b582-63cefb923f23 None admin] PATH_INFO: `/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:28.949934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f1151-f872-4b69-b582-63cefb923f23 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0ccdc1eb754979b2cdc3637e18740b)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:28.951433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f1151-f872-4b69-b582-63cefb923f23 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:28.953220 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 560/1101] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:39:28 2022] GET /identity/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:28.959471 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f1151-f872-4b69-b582-63cefb923f23 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:28.977633 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e7dc0-26e4-42db-b8b3-9e21af4c2dd1 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:29.014525 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13062347-63b5-4b83-be83-34f2e060bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:29.015139 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13062347-63b5-4b83-be83-34f2e060bd1f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:29.015419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13062347-63b5-4b83-be83-34f2e060bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:29.015693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13062347-63b5-4b83-be83-34f2e060bd1f None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:29.016369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13062347-63b5-4b83-be83-34f2e060bd1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:29.016671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13062347-63b5-4b83-be83-34f2e060bd1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:29.018040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13062347-63b5-4b83-be83-34f2e060bd1f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:29.031265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 542/1102] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:29.037292 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13062347-63b5-4b83-be83-34f2e060bd1f None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:29.069050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f1151-f872-4b69-b582-63cefb923f23 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:29.105863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794cdb2-7eef-4c7a-9fd1-a36a7efd4484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:29.106441 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794cdb2-7eef-4c7a-9fd1-a36a7efd4484 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:29.106724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794cdb2-7eef-4c7a-9fd1-a36a7efd4484 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:29.106998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794cdb2-7eef-4c7a-9fd1-a36a7efd4484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:29.107733 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794cdb2-7eef-4c7a-9fd1-a36a7efd4484 None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=8e0ccdc1eb754979b2cdc3637e18740b, user.id=73675186db284ce89a84e8b2f9c21e25) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:29.108044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794cdb2-7eef-4c7a-9fd1-a36a7efd4484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:29.109539 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794cdb2-7eef-4c7a-9fd1-a36a7efd4484 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:29.128232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 561/1103] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:39:28 2022] GET /identity/v3/role_assignments?user.id=73675186db284ce89a84e8b2f9c21e25&scope.project.id=8e0ccdc1eb754979b2cdc3637e18740b&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:29.128523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:29.156889 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13062347-63b5-4b83-be83-34f2e060bd1f None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:29.218550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb6f1e-0310-4352-84d7-8ebe318e060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:29.219430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6f1e-0310-4352-84d7-8ebe318e060d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:29.219851 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6f1e-0310-4352-84d7-8ebe318e060d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:29.220548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6f1e-0310-4352-84d7-8ebe318e060d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:29.233498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb6f1e-0310-4352-84d7-8ebe318e060d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:29.236399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb6f1e-0310-4352-84d7-8ebe318e060d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:29.256924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-7bcb6f1e-0310-4352-84d7-8ebe318e060d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:39:29.256924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:29.256924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:29.256924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:29.256924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:29.256924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:29.256924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:29.256924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:29.256924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:29.256924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:29.256924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:29.256924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:29.256924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:39:29.256924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:39:29.256924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:29.257927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:29.258837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:39:29.258837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:39:29.258837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:39:29.258837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:39:29.258837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:39:29.258837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:39:29.258837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:39:29.258837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:29.259818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 543/1104] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:39:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:29.265562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794cdb2-7eef-4c7a-9fd1-a36a7efd4484 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:29.319229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:29.387777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794cdb2-7eef-4c7a-9fd1-a36a7efd4484 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:29.426104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c478fa-dcc7-4b63-a560-b73566bb0206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:29.426793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c478fa-dcc7-4b63-a560-b73566bb0206 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:29.427071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c478fa-dcc7-4b63-a560-b73566bb0206 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:29.427345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c478fa-dcc7-4b63-a560-b73566bb0206 None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:29.432536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c478fa-dcc7-4b63-a560-b73566bb0206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:29.432536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c478fa-dcc7-4b63-a560-b73566bb0206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:29.432536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c478fa-dcc7-4b63-a560-b73566bb0206 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:29.442896 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 562/1105] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:39:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:29.450139 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb6f1e-0310-4352-84d7-8ebe318e060d None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:29.557203 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb6f1e-0310-4352-84d7-8ebe318e060d None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:29.591754 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef28a31-4951-44a7-99d8-9bdab0fbe11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:29.592391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef28a31-4951-44a7-99d8-9bdab0fbe11b None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:29.592673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef28a31-4951-44a7-99d8-9bdab0fbe11b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:29.592944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef28a31-4951-44a7-99d8-9bdab0fbe11b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:29.593667 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef28a31-4951-44a7-99d8-9bdab0fbe11b None admin] RBAC: Adding query filter params (role.id=136e6370b0c7476f898673d4d697ed28, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=0be09bd9ba7443aaa31879f56ca4aad1) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:29.593968 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef28a31-4951-44a7-99d8-9bdab0fbe11b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:29.595670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef28a31-4951-44a7-99d8-9bdab0fbe11b None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:29.598539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:29.602610 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 544/1106] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:39:29 2022] GET /identity/v3/role_assignments?user.id=0be09bd9ba7443aaa31879f56ca4aad1&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=136e6370b0c7476f898673d4d697ed28 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:31.163818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7d409-e09f-4be7-9e38-fba3144884c1 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:31.164384 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7d409-e09f-4be7-9e38-fba3144884c1 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:31.164474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7d409-e09f-4be7-9e38-fba3144884c1 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:31.165938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 563/1107] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:31.171258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e6fd3-667b-4263-ad80-fd79800396e4 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:31.171685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e6fd3-667b-4263-ad80-fd79800396e4 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:31.171794 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e6fd3-667b-4263-ad80-fd79800396e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:31.190023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-7d4e6fd3-667b-4263-ad80-fd79800396e4 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:31.191221 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7d4e6fd3-667b-4263-ad80-fd79800396e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:31.260000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 545/1108] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:31.533084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7d409-e09f-4be7-9e38-fba3144884c1 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:31.630715 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:31.636550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7d409-e09f-4be7-9e38-fba3144884c1 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:31.672450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c1ef3-4b0a-4022-beab-9fd26d99bd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:31.673136 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c1ef3-4b0a-4022-beab-9fd26d99bd07 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:31.673365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c1ef3-4b0a-4022-beab-9fd26d99bd07 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:31.673637 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c1ef3-4b0a-4022-beab-9fd26d99bd07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:31.674843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c1ef3-4b0a-4022-beab-9fd26d99bd07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:31.676299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c1ef3-4b0a-4022-beab-9fd26d99bd07 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:31.678053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 564/1109] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:31.684169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e6fd3-667b-4263-ad80-fd79800396e4 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:31.782964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e6fd3-667b-4263-ad80-fd79800396e4 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:31.812061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:31.817944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa6426-a951-45e3-9b6f-6b32fc8a70a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:31.818552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa6426-a951-45e3-9b6f-6b32fc8a70a3 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:31.818832 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa6426-a951-45e3-9b6f-6b32fc8a70a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:31.819104 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa6426-a951-45e3-9b6f-6b32fc8a70a3 None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:31.819753 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa6426-a951-45e3-9b6f-6b32fc8a70a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:31.821352 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa6426-a951-45e3-9b6f-6b32fc8a70a3 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:31.902157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 546/1110] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:39:31 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:33.902220 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76176ff5-feb2-4660-8237-e0fce7348a1c None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:33.902753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76176ff5-feb2-4660-8237-e0fce7348a1c None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:33.902753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76176ff5-feb2-4660-8237-e0fce7348a1c None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:33.904095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 565/1111] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:33.909449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5863205-898e-4077-b4ef-3b7b794ac189 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:33.909919 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5863205-898e-4077-b4ef-3b7b794ac189 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:33.910010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5863205-898e-4077-b4ef-3b7b794ac189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:33.930863 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-e5863205-898e-4077-b4ef-3b7b794ac189 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:33.932107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e5863205-898e-4077-b4ef-3b7b794ac189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:34.001565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 547/1112] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:34.303722 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76176ff5-feb2-4660-8237-e0fce7348a1c None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:34.406737 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76176ff5-feb2-4660-8237-e0fce7348a1c None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:34.447915 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663270bc-a814-4d8b-b4b8-e9ea6e3b5061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:34.448606 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663270bc-a814-4d8b-b4b8-e9ea6e3b5061 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:34.448890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663270bc-a814-4d8b-b4b8-e9ea6e3b5061 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:34.449164 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663270bc-a814-4d8b-b4b8-e9ea6e3b5061 None admin] PATH_INFO: `/v3/roles/da30366a448b4b1f902c8160690d366e` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:34.450610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663270bc-a814-4d8b-b4b8-e9ea6e3b5061 None admin] RBAC: Authorizing `identity:get_role(role_id=da30366a448b4b1f902c8160690d366e)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:34.452005 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663270bc-a814-4d8b-b4b8-e9ea6e3b5061 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:34.453382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 566/1113] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:39:34 2022] GET /identity/v3/roles/da30366a448b4b1f902c8160690d366e => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:34.459245 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5863205-898e-4077-b4ef-3b7b794ac189 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:34.655213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5863205-898e-4077-b4ef-3b7b794ac189 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:34.671649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:34.690290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a93b1-c71a-4021-ac58-ce37724aa1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:34.694401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a93b1-c71a-4021-ac58-ce37724aa1c2 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:34.694401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a93b1-c71a-4021-ac58-ce37724aa1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:34.694401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a93b1-c71a-4021-ac58-ce37724aa1c2 None admin] PATH_INFO: `/v3/users/afe4d6fa331d4d78add29ee265d59f78` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:34.707052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a93b1-c71a-4021-ac58-ce37724aa1c2 None admin] RBAC: Authorizing `identity:get_user(user_id=afe4d6fa331d4d78add29ee265d59f78)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:34.708512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a93b1-c71a-4021-ac58-ce37724aa1c2 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:34.710157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 548/1114] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:39:34 2022] GET /identity/v3/users/afe4d6fa331d4d78add29ee265d59f78 => generated 286 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:34.716069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663270bc-a814-4d8b-b4b8-e9ea6e3b5061 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:34.752683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:34.822422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663270bc-a814-4d8b-b4b8-e9ea6e3b5061 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:34.858187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de0afe-a042-4e1c-b8a4-ffba84c6b59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:34.858799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de0afe-a042-4e1c-b8a4-ffba84c6b59b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:34.859075 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de0afe-a042-4e1c-b8a4-ffba84c6b59b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:34.859377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de0afe-a042-4e1c-b8a4-ffba84c6b59b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:34.935052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de0afe-a042-4e1c-b8a4-ffba84c6b59b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:34.936448 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de0afe-a042-4e1c-b8a4-ffba84c6b59b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:34.970836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:35.037608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 567/1115] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:39:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:39:35.043542 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a93b1-c71a-4021-ac58-ce37724aa1c2 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:35.144205 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a93b1-c71a-4021-ac58-ce37724aa1c2 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:35.176988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629f477-eb50-44e0-a3fe-4b536d02da9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:35.177604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629f477-eb50-44e0-a3fe-4b536d02da9d None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:35.177879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629f477-eb50-44e0-a3fe-4b536d02da9d None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:35.178149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629f477-eb50-44e0-a3fe-4b536d02da9d None admin] PATH_INFO: `/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:35.179269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629f477-eb50-44e0-a3fe-4b536d02da9d None admin] RBAC: Authorizing `identity:get_project(project_id=8e0ccdc1eb754979b2cdc3637e18740b)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:35.181332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629f477-eb50-44e0-a3fe-4b536d02da9d None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:35.182954 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 549/1116] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:39:35 2022] GET /identity/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:35.189191 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de0afe-a042-4e1c-b8a4-ffba84c6b59b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:35.287205 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de0afe-a042-4e1c-b8a4-ffba84c6b59b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:35.321130 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff0067-b6a8-4187-9161-8ce4a7dd4075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:35.321728 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff0067-b6a8-4187-9161-8ce4a7dd4075 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:35.322002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff0067-b6a8-4187-9161-8ce4a7dd4075 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:35.322272 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff0067-b6a8-4187-9161-8ce4a7dd4075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:35.322991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff0067-b6a8-4187-9161-8ce4a7dd4075 None admin] RBAC: Adding query filter params (role.id=da30366a448b4b1f902c8160690d366e, scope.project.id=8e0ccdc1eb754979b2cdc3637e18740b, user.id=afe4d6fa331d4d78add29ee265d59f78) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:35.323294 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff0067-b6a8-4187-9161-8ce4a7dd4075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:35.324744 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff0067-b6a8-4187-9161-8ce4a7dd4075 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:35.326492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:35.330553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 568/1117] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:39:35 2022] GET /identity/v3/role_assignments?user.id=afe4d6fa331d4d78add29ee265d59f78&scope.project.id=8e0ccdc1eb754979b2cdc3637e18740b&role.id=da30366a448b4b1f902c8160690d366e => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:37.304143 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80493b57-4654-4972-94c0-17d5172692d1 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:37.304759 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80493b57-4654-4972-94c0-17d5172692d1 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:37.304867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80493b57-4654-4972-94c0-17d5172692d1 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:37.306296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 550/1118] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:37.311529 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aecce-7717-4ad3-afdd-4cf6497b5cb1 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:37.311946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aecce-7717-4ad3-afdd-4cf6497b5cb1 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:37.312083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aecce-7717-4ad3-afdd-4cf6497b5cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:37.331470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-394aecce-7717-4ad3-afdd-4cf6497b5cb1 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:37.332693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-394aecce-7717-4ad3-afdd-4cf6497b5cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:37.401648 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 569/1119] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:37.671326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80493b57-4654-4972-94c0-17d5172692d1 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:37.716059 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:37.772110 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80493b57-4654-4972-94c0-17d5172692d1 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:37.806752 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42267d1b-031c-46a2-ae34-c8690c477a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:37.807387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42267d1b-031c-46a2-ae34-c8690c477a2a None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:37.807663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42267d1b-031c-46a2-ae34-c8690c477a2a None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:37.807934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42267d1b-031c-46a2-ae34-c8690c477a2a None admin] PATH_INFO: `/v3/roles/da30366a448b4b1f902c8160690d366e` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:37.809399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42267d1b-031c-46a2-ae34-c8690c477a2a None admin] RBAC: Authorizing `identity:get_role(role_id=da30366a448b4b1f902c8160690d366e)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:37.810756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42267d1b-031c-46a2-ae34-c8690c477a2a None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:37.812096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 551/1120] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:39:37 2022] GET /identity/v3/roles/da30366a448b4b1f902c8160690d366e => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:37.817965 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394aecce-7717-4ad3-afdd-4cf6497b5cb1 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:37.918891 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394aecce-7717-4ad3-afdd-4cf6497b5cb1 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:37.946596 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:37.954099 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83561c4-c4a9-4d8f-bf91-7b07e3641d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:37.954741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83561c4-c4a9-4d8f-bf91-7b07e3641d96 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:37.955006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83561c4-c4a9-4d8f-bf91-7b07e3641d96 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:37.955271 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83561c4-c4a9-4d8f-bf91-7b07e3641d96 None admin] PATH_INFO: `/v3/users/afe4d6fa331d4d78add29ee265d59f78` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:37.957576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83561c4-c4a9-4d8f-bf91-7b07e3641d96 None admin] RBAC: Authorizing `identity:get_user(user_id=afe4d6fa331d4d78add29ee265d59f78)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:37.957824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83561c4-c4a9-4d8f-bf91-7b07e3641d96 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:37.959412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 570/1121] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:39:37 2022] GET /identity/v3/users/afe4d6fa331d4d78add29ee265d59f78 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:37.965921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42267d1b-031c-46a2-ae34-c8690c477a2a None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:38.068892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42267d1b-031c-46a2-ae34-c8690c477a2a None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:38.081779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:38.108080 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252e4be-9624-431d-b570-3416ac06924c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:38.108766 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252e4be-9624-431d-b570-3416ac06924c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:38.109041 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252e4be-9624-431d-b570-3416ac06924c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:38.109321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252e4be-9624-431d-b570-3416ac06924c None admin] PATH_INFO: `/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:38.110612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252e4be-9624-431d-b570-3416ac06924c None admin] RBAC: Authorizing `identity:get_project(project_id=8e0ccdc1eb754979b2cdc3637e18740b)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:38.112288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252e4be-9624-431d-b570-3416ac06924c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:38.114242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 552/1122] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:39:37 2022] GET /identity/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:38.121377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83561c4-c4a9-4d8f-bf91-7b07e3641d96 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:38.221818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83561c4-c4a9-4d8f-bf91-7b07e3641d96 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:38.255324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7e7f6-3c4e-4e76-b5c2-8831e7ce52df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:38.255984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e7f6-3c4e-4e76-b5c2-8831e7ce52df None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:38.256289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e7f6-3c4e-4e76-b5c2-8831e7ce52df None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:38.256563 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e7f6-3c4e-4e76-b5c2-8831e7ce52df None admin] PATH_INFO: `/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b/users/afe4d6fa331d4d78add29ee265d59f78/roles/da30366a448b4b1f902c8160690d366e` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:38.259481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7e7f6-3c4e-4e76-b5c2-8831e7ce52df None admin] RBAC: Authorizing `identity:create_grant(project_id=8e0ccdc1eb754979b2cdc3637e18740b, user_id=afe4d6fa331d4d78add29ee265d59f78, role_id=da30366a448b4b1f902c8160690d366e)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:38.260952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7e7f6-3c4e-4e76-b5c2-8831e7ce52df None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:38.313403 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 571/1123] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:39:38 2022] PUT /identity/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b/users/afe4d6fa331d4d78add29ee265d59f78/roles/da30366a448b4b1f902c8160690d366e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:40.232031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23f1c2-d0a3-4941-8d8d-afdfbc38844a None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:40.232641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23f1c2-d0a3-4941-8d8d-afdfbc38844a None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:40.232641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23f1c2-d0a3-4941-8d8d-afdfbc38844a None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:40.233955 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 553/1124] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:40.239113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d514d4-f784-431d-b826-6d90cbca278b None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:40.239546 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d514d4-f784-431d-b826-6d90cbca278b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:40.239663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d514d4-f784-431d-b826-6d90cbca278b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:40.259085 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-44d514d4-f784-431d-b826-6d90cbca278b None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:40.260355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-44d514d4-f784-431d-b826-6d90cbca278b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:40.311234 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:40.328048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 572/1125] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:40.603035 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23f1c2-d0a3-4941-8d8d-afdfbc38844a None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:40.707109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23f1c2-d0a3-4941-8d8d-afdfbc38844a None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:40.742422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f061a-8995-44ad-906d-ab5a440a1abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:40.743016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f061a-8995-44ad-906d-ab5a440a1abf None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:40.743300 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f061a-8995-44ad-906d-ab5a440a1abf None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:40.743577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f061a-8995-44ad-906d-ab5a440a1abf None admin] PATH_INFO: `/v3/roles/da30366a448b4b1f902c8160690d366e` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:40.745011 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f061a-8995-44ad-906d-ab5a440a1abf None admin] RBAC: Authorizing `identity:get_role(role_id=da30366a448b4b1f902c8160690d366e)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:40.746380 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f061a-8995-44ad-906d-ab5a440a1abf None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:40.747710 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 554/1126] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:39:40 2022] GET /identity/v3/roles/da30366a448b4b1f902c8160690d366e => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:40.753588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d514d4-f784-431d-b826-6d90cbca278b None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:40.857061 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d514d4-f784-431d-b826-6d90cbca278b None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:40.895009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec022c1-dc0e-479c-821f-17f1e76a5b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:40.895651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec022c1-dc0e-479c-821f-17f1e76a5b51 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:40.895931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec022c1-dc0e-479c-821f-17f1e76a5b51 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:40.896225 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec022c1-dc0e-479c-821f-17f1e76a5b51 None admin] PATH_INFO: `/v3/users/afe4d6fa331d4d78add29ee265d59f78` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:40.897420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec022c1-dc0e-479c-821f-17f1e76a5b51 None admin] RBAC: Authorizing `identity:get_user(user_id=afe4d6fa331d4d78add29ee265d59f78)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:40.900057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec022c1-dc0e-479c-821f-17f1e76a5b51 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:40.901696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 573/1127] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:39:40 2022] GET /identity/v3/users/afe4d6fa331d4d78add29ee265d59f78 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:40.907682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f061a-8995-44ad-906d-ab5a440a1abf None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:40.957500 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:41.012655 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f061a-8995-44ad-906d-ab5a440a1abf None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:41.045957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f8023-a7bf-4db7-9ce3-5b76307cada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:41.046592 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f8023-a7bf-4db7-9ce3-5b76307cada4 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:41.046831 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f8023-a7bf-4db7-9ce3-5b76307cada4 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:41.047103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f8023-a7bf-4db7-9ce3-5b76307cada4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:41.114607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f8023-a7bf-4db7-9ce3-5b76307cada4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:41.115958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f8023-a7bf-4db7-9ce3-5b76307cada4 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:41.160771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:41.217573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 555/1128] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:39:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:39:41.223986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec022c1-dc0e-479c-821f-17f1e76a5b51 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:41.282061 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:41.331347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec022c1-dc0e-479c-821f-17f1e76a5b51 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:41.367672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34548e86-41e7-4e25-b2d0-5551905bb2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:41.368227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34548e86-41e7-4e25-b2d0-5551905bb2d5 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:41.368519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34548e86-41e7-4e25-b2d0-5551905bb2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:41.368794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34548e86-41e7-4e25-b2d0-5551905bb2d5 None admin] PATH_INFO: `/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:41.369930 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34548e86-41e7-4e25-b2d0-5551905bb2d5 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0ccdc1eb754979b2cdc3637e18740b)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:41.371377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34548e86-41e7-4e25-b2d0-5551905bb2d5 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:41.373057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 574/1129] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:39:41 2022] GET /identity/v3/projects/8e0ccdc1eb754979b2cdc3637e18740b => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:41.379463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f8023-a7bf-4db7-9ce3-5b76307cada4 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:41.480612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f8023-a7bf-4db7-9ce3-5b76307cada4 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:41.514799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc4f34-2fc8-47f5-9723-2066333cbf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:41.515409 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc4f34-2fc8-47f5-9723-2066333cbf99 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:41.515687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc4f34-2fc8-47f5-9723-2066333cbf99 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:41.515964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc4f34-2fc8-47f5-9723-2066333cbf99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:41.516716 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc4f34-2fc8-47f5-9723-2066333cbf99 None admin] RBAC: Adding query filter params (role.id=da30366a448b4b1f902c8160690d366e, scope.project.id=8e0ccdc1eb754979b2cdc3637e18740b, user.id=afe4d6fa331d4d78add29ee265d59f78) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:41.517025 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc4f34-2fc8-47f5-9723-2066333cbf99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:41.518442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc4f34-2fc8-47f5-9723-2066333cbf99 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:41.524938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 556/1130] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:39:41 2022] GET /identity/v3/role_assignments?user.id=afe4d6fa331d4d78add29ee265d59f78&scope.project.id=8e0ccdc1eb754979b2cdc3637e18740b&role.id=da30366a448b4b1f902c8160690d366e => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:43.472848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cd006-318e-4526-af98-5a84b22c178e None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:43.473361 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cd006-318e-4526-af98-5a84b22c178e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:43.473448 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cd006-318e-4526-af98-5a84b22c178e None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:43.474800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 575/1131] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:43.481007 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fe1fa-c580-4a92-84c6-3fa3c95b5d19 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:43.481416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fe1fa-c580-4a92-84c6-3fa3c95b5d19 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:43.481556 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fe1fa-c580-4a92-84c6-3fa3c95b5d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:43.500149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-fb3fe1fa-c580-4a92-84c6-3fa3c95b5d19 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:43.501398 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-fb3fe1fa-c580-4a92-84c6-3fa3c95b5d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:43.504170 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:43.572675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 557/1132] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:43.846536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cd006-318e-4526-af98-5a84b22c178e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:43.951470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cd006-318e-4526-af98-5a84b22c178e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:43.974695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:43.986934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750c370-2702-445c-9e33-b9325e084c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:43.987562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750c370-2702-445c-9e33-b9325e084c96 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:43.990580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750c370-2702-445c-9e33-b9325e084c96 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:43.990580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750c370-2702-445c-9e33-b9325e084c96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:43.990580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750c370-2702-445c-9e33-b9325e084c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:43.990826 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750c370-2702-445c-9e33-b9325e084c96 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:43.992791 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 576/1133] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:43.998643 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fe1fa-c580-4a92-84c6-3fa3c95b5d19 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:44.097349 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fe1fa-c580-4a92-84c6-3fa3c95b5d19 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:44.131579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92d7ce-ec2a-4a49-a894-e3da2a88e900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:44.132401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92d7ce-ec2a-4a49-a894-e3da2a88e900 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:44.132718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92d7ce-ec2a-4a49-a894-e3da2a88e900 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:44.132994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92d7ce-ec2a-4a49-a894-e3da2a88e900 None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:44.133639 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92d7ce-ec2a-4a49-a894-e3da2a88e900 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:44.135058 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92d7ce-ec2a-4a49-a894-e3da2a88e900 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:44.146184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:44.222751 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 558/1134] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Aug 29 22:39:43 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:46.206727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8f90e-5daf-4efa-803f-a48046657d84 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:46.207291 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8f90e-5daf-4efa-803f-a48046657d84 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:46.207394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8f90e-5daf-4efa-803f-a48046657d84 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:46.208749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 577/1135] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:46.214113 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5215cae-2f6a-4172-b091-a5fd871850ce None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:46.214536 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5215cae-2f6a-4172-b091-a5fd871850ce None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:46.214653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5215cae-2f6a-4172-b091-a5fd871850ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:46.233884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-d5215cae-2f6a-4172-b091-a5fd871850ce None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:46.235082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d5215cae-2f6a-4172-b091-a5fd871850ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:46.303504 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 559/1136] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:46.582212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8f90e-5daf-4efa-803f-a48046657d84 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:46.683879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8f90e-5daf-4efa-803f-a48046657d84 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:46.717655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2daa7c-3739-4a22-8f5b-5ece2bec7b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:46.718279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2daa7c-3739-4a22-8f5b-5ece2bec7b82 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:46.718556 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2daa7c-3739-4a22-8f5b-5ece2bec7b82 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:46.718823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2daa7c-3739-4a22-8f5b-5ece2bec7b82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:46.720179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2daa7c-3739-4a22-8f5b-5ece2bec7b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:46.721634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2daa7c-3739-4a22-8f5b-5ece2bec7b82 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:46.723222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 578/1137] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:39:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:46.729670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5215cae-2f6a-4172-b091-a5fd871850ce None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:46.828912 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5215cae-2f6a-4172-b091-a5fd871850ce None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:46.854511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:46.866275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8c400-b748-4eec-913d-6981c1311829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:46.867516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8c400-b748-4eec-913d-6981c1311829 None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:46.867932 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8c400-b748-4eec-913d-6981c1311829 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:46.868073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8c400-b748-4eec-913d-6981c1311829 None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:46.868780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8c400-b748-4eec-913d-6981c1311829 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:46.870228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8c400-b748-4eec-913d-6981c1311829 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:46.941968 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 560/1138] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:39:46 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:39:48.953487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31272b39-735a-40fc-a194-67a4a41b7e51 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:48.954139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31272b39-735a-40fc-a194-67a4a41b7e51 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:48.954139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31272b39-735a-40fc-a194-67a4a41b7e51 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:48.955524 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 579/1139] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:39:48.961960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1db9b-f86c-4ab5-a5a8-986bec681d6e None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:48.962468 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1db9b-f86c-4ab5-a5a8-986bec681d6e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:48.962569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1db9b-f86c-4ab5-a5a8-986bec681d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:48.981102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-eee1db9b-f86c-4ab5-a5a8-986bec681d6e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:48.982302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-eee1db9b-f86c-4ab5-a5a8-986bec681d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:49.051148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 561/1140] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:49.317761 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31272b39-735a-40fc-a194-67a4a41b7e51 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:49.379613 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:49.423484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31272b39-735a-40fc-a194-67a4a41b7e51 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:49.458261 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663302ec-12ef-4656-b53c-ca7b0215da43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:49.458881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663302ec-12ef-4656-b53c-ca7b0215da43 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:49.459165 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663302ec-12ef-4656-b53c-ca7b0215da43 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:49.459429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663302ec-12ef-4656-b53c-ca7b0215da43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:49.470052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663302ec-12ef-4656-b53c-ca7b0215da43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-663302ec-12ef-4656-b53c-ca7b0215da43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:39:49.474805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:49.478959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:49.480081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:49.480081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:49.480081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:49.480081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:49.480081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:39:49.480081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:39:49.480081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:39:49.480081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:39:49.480081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:39:49.480081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:39:49.480081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:39:49.480081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:49.480081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 580/1141] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:39:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:49.482202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1db9b-f86c-4ab5-a5a8-986bec681d6e None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:49.583689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1db9b-f86c-4ab5-a5a8-986bec681d6e None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:49.593978 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:49.619363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b4f45-323d-4ce0-a43a-58eee29fd4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:49.620038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b4f45-323d-4ce0-a43a-58eee29fd4ae None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:49.620354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b4f45-323d-4ce0-a43a-58eee29fd4ae None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:49.620624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b4f45-323d-4ce0-a43a-58eee29fd4ae None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:49.621289 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b4f45-323d-4ce0-a43a-58eee29fd4ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:49.621612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b4f45-323d-4ce0-a43a-58eee29fd4ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:49.622974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b4f45-323d-4ce0-a43a-58eee29fd4ae None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:49.631662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 562/1142] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:39:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:49.638080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663302ec-12ef-4656-b53c-ca7b0215da43 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:49.742097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663302ec-12ef-4656-b53c-ca7b0215da43 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:49.759427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:49.777135 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e05723-4f18-47c7-a878-375b1682642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:49.779999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e05723-4f18-47c7-a878-375b1682642f None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:49.779999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e05723-4f18-47c7-a878-375b1682642f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:49.779999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e05723-4f18-47c7-a878-375b1682642f None admin] PATH_INFO: `/v3/users/dc5d70344a304f74b571b0baabea1cdc` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:49.793984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e05723-4f18-47c7-a878-375b1682642f None admin] RBAC: Authorizing `identity:get_user(user_id=dc5d70344a304f74b571b0baabea1cdc)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:49.795456 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e05723-4f18-47c7-a878-375b1682642f None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:49.797633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 581/1143] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:39:49 2022] GET /identity/v3/users/dc5d70344a304f74b571b0baabea1cdc => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:39:49.803307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b4f45-323d-4ce0-a43a-58eee29fd4ae None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:49.907869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b4f45-323d-4ce0-a43a-58eee29fd4ae None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:49.945530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e19f6-e6d3-417f-9623-7c6b583b6af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:49.946152 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e19f6-e6d3-417f-9623-7c6b583b6af4 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:49.946435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e19f6-e6d3-417f-9623-7c6b583b6af4 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:49.946713 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e19f6-e6d3-417f-9623-7c6b583b6af4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:49.986635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:50.014194 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e19f6-e6d3-417f-9623-7c6b583b6af4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:50.015635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e19f6-e6d3-417f-9623-7c6b583b6af4 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:50.116567 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 563/1144] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:39:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:39:50.122712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e05723-4f18-47c7-a878-375b1682642f None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:50.222072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e05723-4f18-47c7-a878-375b1682642f None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:50.255965 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97997c3-5f3a-42fb-add4-32be138cd2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:50.257207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97997c3-5f3a-42fb-add4-32be138cd2de None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:50.257492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97997c3-5f3a-42fb-add4-32be138cd2de None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:50.257900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97997c3-5f3a-42fb-add4-32be138cd2de None admin] PATH_INFO: `/v3/projects/d0475e28c99c4d468a300dc04c5ab1cb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:50.259059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97997c3-5f3a-42fb-add4-32be138cd2de None admin] RBAC: Authorizing `identity:get_project(project_id=d0475e28c99c4d468a300dc04c5ab1cb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:50.260522 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97997c3-5f3a-42fb-add4-32be138cd2de None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:50.262141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 582/1145] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:39:50 2022] GET /identity/v3/projects/d0475e28c99c4d468a300dc04c5ab1cb => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:50.268423 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e19f6-e6d3-417f-9623-7c6b583b6af4 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:50.338657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:50.371675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e19f6-e6d3-417f-9623-7c6b583b6af4 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:50.406894 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dc904-9901-4126-ae44-81f6d6e3e8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:50.407508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dc904-9901-4126-ae44-81f6d6e3e8c0 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:50.407783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dc904-9901-4126-ae44-81f6d6e3e8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:50.408054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dc904-9901-4126-ae44-81f6d6e3e8c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:50.408806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dc904-9901-4126-ae44-81f6d6e3e8c0 None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=d0475e28c99c4d468a300dc04c5ab1cb, user.id=dc5d70344a304f74b571b0baabea1cdc) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:50.409114 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dc904-9901-4126-ae44-81f6d6e3e8c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:50.410528 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dc904-9901-4126-ae44-81f6d6e3e8c0 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:50.416064 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 564/1146] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:39:50 2022] GET /identity/v3/role_assignments?user.id=dc5d70344a304f74b571b0baabea1cdc&scope.project.id=d0475e28c99c4d468a300dc04c5ab1cb&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:52.321220 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f9233-4661-451f-ac1e-5b1cab5ca150 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:52.321757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f9233-4661-451f-ac1e-5b1cab5ca150 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:52.321757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f9233-4661-451f-ac1e-5b1cab5ca150 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:52.323105 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 583/1147] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:52.328655 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ca05f-41eb-44f3-8d99-cab75d4d3695 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:52.329072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ca05f-41eb-44f3-8d99-cab75d4d3695 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:52.329197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ca05f-41eb-44f3-8d99-cab75d4d3695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:52.348859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-b60ca05f-41eb-44f3-8d99-cab75d4d3695 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:52.350052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b60ca05f-41eb-44f3-8d99-cab75d4d3695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:52.420237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 565/1148] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:52.689089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f9233-4661-451f-ac1e-5b1cab5ca150 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:52.738191 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:52.797209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f9233-4661-451f-ac1e-5b1cab5ca150 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:52.834445 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd364a83-2a75-4316-92c8-86586cea77bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:52.835626 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd364a83-2a75-4316-92c8-86586cea77bb None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:52.835902 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd364a83-2a75-4316-92c8-86586cea77bb None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:52.836244 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd364a83-2a75-4316-92c8-86586cea77bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:52.847290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd364a83-2a75-4316-92c8-86586cea77bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-dd364a83-2a75-4316-92c8-86586cea77bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:39:52.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:52.854415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:52.856347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:52.856347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:52.856347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:52.856347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:52.856347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:39:52.856347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:39:52.856347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:39:52.856347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:39:52.856347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:39:52.856347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:39:52.856347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:39:52.856347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:52.856347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 584/1149] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:39:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:52.861377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ca05f-41eb-44f3-8d99-cab75d4d3695 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:52.928212 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:52.967181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ca05f-41eb-44f3-8d99-cab75d4d3695 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:53.004338 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23351567-e87f-48e3-80df-53f880e71f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:53.004953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23351567-e87f-48e3-80df-53f880e71f86 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:53.005233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23351567-e87f-48e3-80df-53f880e71f86 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:53.005508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23351567-e87f-48e3-80df-53f880e71f86 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:53.006172 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23351567-e87f-48e3-80df-53f880e71f86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:53.007208 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23351567-e87f-48e3-80df-53f880e71f86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:53.009467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23351567-e87f-48e3-80df-53f880e71f86 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:53.018629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 566/1150] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:39:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:53.025340 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd364a83-2a75-4316-92c8-86586cea77bb None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:53.129708 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd364a83-2a75-4316-92c8-86586cea77bb None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:53.133023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:53.165725 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e865a-667a-409e-bf4d-d243abfe2657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:53.166346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e865a-667a-409e-bf4d-d243abfe2657 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:53.166624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e865a-667a-409e-bf4d-d243abfe2657 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:53.166897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e865a-667a-409e-bf4d-d243abfe2657 None admin] PATH_INFO: `/v3/users/dc5d70344a304f74b571b0baabea1cdc` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:53.168024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e865a-667a-409e-bf4d-d243abfe2657 None admin] RBAC: Authorizing `identity:get_user(user_id=dc5d70344a304f74b571b0baabea1cdc)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:53.169487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e865a-667a-409e-bf4d-d243abfe2657 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:53.171068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 585/1151] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:39:53 2022] GET /identity/v3/users/dc5d70344a304f74b571b0baabea1cdc => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:53.176871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23351567-e87f-48e3-80df-53f880e71f86 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:53.280112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23351567-e87f-48e3-80df-53f880e71f86 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:53.307307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:53.316234 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6affa61-0bce-425a-9920-83b2b667e2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:53.320940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6affa61-0bce-425a-9920-83b2b667e2e3 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:53.320940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6affa61-0bce-425a-9920-83b2b667e2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:53.320940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6affa61-0bce-425a-9920-83b2b667e2e3 None admin] PATH_INFO: `/v3/projects/d0475e28c99c4d468a300dc04c5ab1cb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:53.320940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6affa61-0bce-425a-9920-83b2b667e2e3 None admin] RBAC: Authorizing `identity:get_project(project_id=d0475e28c99c4d468a300dc04c5ab1cb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:53.320940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6affa61-0bce-425a-9920-83b2b667e2e3 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:53.321943 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 567/1152] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:39:53 2022] GET /identity/v3/projects/d0475e28c99c4d468a300dc04c5ab1cb => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:53.328078 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e865a-667a-409e-bf4d-d243abfe2657 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:53.435139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e865a-667a-409e-bf4d-d243abfe2657 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:53.471180 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b4a8f-f4f6-48de-8dab-4abd55e79ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:53.471841 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b4a8f-f4f6-48de-8dab-4abd55e79ff0 None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:53.472123 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b4a8f-f4f6-48de-8dab-4abd55e79ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:53.472421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b4a8f-f4f6-48de-8dab-4abd55e79ff0 None admin] PATH_INFO: `/v3/projects/d0475e28c99c4d468a300dc04c5ab1cb/users/dc5d70344a304f74b571b0baabea1cdc/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:53.474357 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b4a8f-f4f6-48de-8dab-4abd55e79ff0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0475e28c99c4d468a300dc04c5ab1cb, user_id=dc5d70344a304f74b571b0baabea1cdc, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:53.476326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b4a8f-f4f6-48de-8dab-4abd55e79ff0 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:53.576066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 586/1153] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:39:53 2022] PUT /identity/v3/projects/d0475e28c99c4d468a300dc04c5ab1cb/users/dc5d70344a304f74b571b0baabea1cdc/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:39:55.483486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71870c-4eff-46f6-9bfe-af2290927575 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:55.484053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71870c-4eff-46f6-9bfe-af2290927575 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:55.484053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71870c-4eff-46f6-9bfe-af2290927575 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:55.485514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 568/1154] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:55.491950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6b6a2-d0f3-46ab-8b00-4d24c1e34153 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:55.492543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6b6a2-d0f3-46ab-8b00-4d24c1e34153 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:55.492543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6b6a2-d0f3-46ab-8b00-4d24c1e34153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:55.511888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-92f6b6a2-d0f3-46ab-8b00-4d24c1e34153 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:55.513130 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-92f6b6a2-d0f3-46ab-8b00-4d24c1e34153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:55.539194 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:55.581478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 587/1155] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:55.852219 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71870c-4eff-46f6-9bfe-af2290927575 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:55.956893 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71870c-4eff-46f6-9bfe-af2290927575 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:55.992116 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bd958-91c8-4f7c-aa99-e5735d93022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:55.992782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bd958-91c8-4f7c-aa99-e5735d93022f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:55.993063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bd958-91c8-4f7c-aa99-e5735d93022f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:55.993336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bd958-91c8-4f7c-aa99-e5735d93022f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:56.004355 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bd958-91c8-4f7c-aa99-e5735d93022f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-095bd958-91c8-4f7c-aa99-e5735d93022f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:39:56.009604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:56.010709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:56.011657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:56.011657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:56.011657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:56.011657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:56.011657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:39:56.011657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:39:56.011657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:39:56.011657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:39:56.011657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:39:56.011657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:39:56.011657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:39:56.011657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:39:56.011657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 569/1156] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:39:56.016907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6b6a2-d0f3-46ab-8b00-4d24c1e34153 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:56.118347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6b6a2-d0f3-46ab-8b00-4d24c1e34153 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:56.152405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e037c01-a2a7-4157-bc13-32b908cb0e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:56.153014 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e037c01-a2a7-4157-bc13-32b908cb0e95 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:56.153297 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e037c01-a2a7-4157-bc13-32b908cb0e95 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:56.153571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e037c01-a2a7-4157-bc13-32b908cb0e95 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:56.154241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e037c01-a2a7-4157-bc13-32b908cb0e95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:56.154545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e037c01-a2a7-4157-bc13-32b908cb0e95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:56.155931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e037c01-a2a7-4157-bc13-32b908cb0e95 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:56.164899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 588/1157] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:39:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:56.170722 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bd958-91c8-4f7c-aa99-e5735d93022f None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:56.226415 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:56.271451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bd958-91c8-4f7c-aa99-e5735d93022f None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:56.305325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a09f1-cf9e-44a2-be4f-99980569981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:56.305949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a09f1-cf9e-44a2-be4f-99980569981c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:56.306225 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a09f1-cf9e-44a2-be4f-99980569981c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:56.306494 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a09f1-cf9e-44a2-be4f-99980569981c None admin] PATH_INFO: `/v3/users/dc5d70344a304f74b571b0baabea1cdc` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:56.307594 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a09f1-cf9e-44a2-be4f-99980569981c None admin] RBAC: Authorizing `identity:get_user(user_id=dc5d70344a304f74b571b0baabea1cdc)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:56.309036 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a09f1-cf9e-44a2-be4f-99980569981c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:56.310606 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 570/1158] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:39:56 2022] GET /identity/v3/users/dc5d70344a304f74b571b0baabea1cdc => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:56.316670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e037c01-a2a7-4157-bc13-32b908cb0e95 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:56.342592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:56.421335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e037c01-a2a7-4157-bc13-32b908cb0e95 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:56.456746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3aa4cf-3ad1-4078-aa42-c125de33f150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:56.457355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aa4cf-3ad1-4078-aa42-c125de33f150 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:56.457636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aa4cf-3ad1-4078-aa42-c125de33f150 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:56.457910 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aa4cf-3ad1-4078-aa42-c125de33f150 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:56.529829 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3aa4cf-3ad1-4078-aa42-c125de33f150 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:56.531286 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3aa4cf-3ad1-4078-aa42-c125de33f150 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:56.555538 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:56.632976 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 589/1159] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:39:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:39:56.639000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a09f1-cf9e-44a2-be4f-99980569981c None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:56.742258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a09f1-cf9e-44a2-be4f-99980569981c None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:56.765267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:56.777260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da332e9-c03e-46cd-b003-1ecdb0dbf8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:56.781281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da332e9-c03e-46cd-b003-1ecdb0dbf8ce None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:56.781281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da332e9-c03e-46cd-b003-1ecdb0dbf8ce None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:56.781281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da332e9-c03e-46cd-b003-1ecdb0dbf8ce None admin] PATH_INFO: `/v3/projects/d0475e28c99c4d468a300dc04c5ab1cb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:56.781281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da332e9-c03e-46cd-b003-1ecdb0dbf8ce None admin] RBAC: Authorizing `identity:get_project(project_id=d0475e28c99c4d468a300dc04c5ab1cb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:56.781281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da332e9-c03e-46cd-b003-1ecdb0dbf8ce None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:56.782722 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 571/1160] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:39:56 2022] GET /identity/v3/projects/d0475e28c99c4d468a300dc04c5ab1cb => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:56.790118 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3aa4cf-3ad1-4078-aa42-c125de33f150 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:56.889094 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3aa4cf-3ad1-4078-aa42-c125de33f150 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:56.914129 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:56.924835 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd5a6-fe74-47d6-bca1-a097f6a1ed1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:56.925869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd5a6-fe74-47d6-bca1-a097f6a1ed1f None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:56.925869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd5a6-fe74-47d6-bca1-a097f6a1ed1f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:56.926036 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd5a6-fe74-47d6-bca1-a097f6a1ed1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:56.926733 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfd5a6-fe74-47d6-bca1-a097f6a1ed1f None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=d0475e28c99c4d468a300dc04c5ab1cb, user.id=dc5d70344a304f74b571b0baabea1cdc) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:56.927035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfd5a6-fe74-47d6-bca1-a097f6a1ed1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:56.929149 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfd5a6-fe74-47d6-bca1-a097f6a1ed1f None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:56.935250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 590/1161] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:39:56 2022] GET /identity/v3/role_assignments?user.id=dc5d70344a304f74b571b0baabea1cdc&scope.project.id=d0475e28c99c4d468a300dc04c5ab1cb&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:39:58.882852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bcb73-d6cc-4dbc-948c-d384ee103990 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:58.883417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bcb73-d6cc-4dbc-948c-d384ee103990 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:58.883417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bcb73-d6cc-4dbc-948c-d384ee103990 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:58.884757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 572/1162] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:58.890121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fecc3-e09e-412d-88b9-16d29488e0e1 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:58.890580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fecc3-e09e-412d-88b9-16d29488e0e1 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:58.890661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fecc3-e09e-412d-88b9-16d29488e0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:58.909773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-aa0fecc3-e09e-412d-88b9-16d29488e0e1 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:58.910963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-aa0fecc3-e09e-412d-88b9-16d29488e0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:58.981081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 591/1163] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:39:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:39:59.251821 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903bcb73-d6cc-4dbc-948c-d384ee103990 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:59.356058 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903bcb73-d6cc-4dbc-948c-d384ee103990 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:59.389892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa609899-7869-4ba5-ad9a-ae3c848a5952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:59.390535 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa609899-7869-4ba5-ad9a-ae3c848a5952 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:59.390814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa609899-7869-4ba5-ad9a-ae3c848a5952 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:59.391089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa609899-7869-4ba5-ad9a-ae3c848a5952 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:59.454289 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:59.465445 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa609899-7869-4ba5-ad9a-ae3c848a5952 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:59.473010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa609899-7869-4ba5-ad9a-ae3c848a5952 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:59.566829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 573/1164] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:39:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:39:59.573365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fecc3-e09e-412d-88b9-16d29488e0e1 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:59.675860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fecc3-e09e-412d-88b9-16d29488e0e1 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:59.694085 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:59.711142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b7347-9649-455d-aef4-88606e82c13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:59.711779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b7347-9649-455d-aef4-88606e82c13b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:59.712062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b7347-9649-455d-aef4-88606e82c13b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:59.712377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b7347-9649-455d-aef4-88606e82c13b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:59.719562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b7347-9649-455d-aef4-88606e82c13b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:59.721050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b7347-9649-455d-aef4-88606e82c13b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-208b7347-9649-455d-aef4-88606e82c13b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:39:59.733739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:39:59.734946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:39:59.735789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:39:59.735789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:39:59.735789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:39:59.735789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:39:59.735789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:39:59.735789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:39:59.735789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:39:59.735789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:39:59.735789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:39:59.735789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:39:59.735789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 22:39:59.735789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:39:59.735789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 22:39:59.735789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:39:59.735789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 592/1165] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Aug 29 22:39:59 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:39:59.742482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa609899-7869-4ba5-ad9a-ae3c848a5952 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:59.835561 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:59.845590 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa609899-7869-4ba5-ad9a-ae3c848a5952 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:59.882346 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9801b-e8cf-4cff-af58-ed3b97a2b21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:59.882960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9801b-e8cf-4cff-af58-ed3b97a2b21f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:59.883503 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9801b-e8cf-4cff-af58-ed3b97a2b21f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:59.883503 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9801b-e8cf-4cff-af58-ed3b97a2b21f None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:59.884127 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9801b-e8cf-4cff-af58-ed3b97a2b21f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:39:59.884456 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9801b-e8cf-4cff-af58-ed3b97a2b21f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:59.885843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9801b-e8cf-4cff-af58-ed3b97a2b21f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:59.893306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 574/1166] 10.222.0.72 () {56 vars in 1115 bytes} [Mon Aug 29 22:39:59 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:40:01.851573 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eca64b-e9a0-4ac3-b14a-882aae3c62a4 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:01.852139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eca64b-e9a0-4ac3-b14a-882aae3c62a4 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:01.852139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eca64b-e9a0-4ac3-b14a-882aae3c62a4 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:01.853535 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 593/1167] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:40:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:40:01.859450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f962ff8-2384-4966-96a4-26924f8a9362 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:01.860007 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f962ff8-2384-4966-96a4-26924f8a9362 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:01.860007 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f962ff8-2384-4966-96a4-26924f8a9362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:01.880090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-4f962ff8-2384-4966-96a4-26924f8a9362 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:01.882072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4f962ff8-2384-4966-96a4-26924f8a9362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:01.956695 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 575/1168] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:40:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:40:02.232265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eca64b-e9a0-4ac3-b14a-882aae3c62a4 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:02.334420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eca64b-e9a0-4ac3-b14a-882aae3c62a4 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:02.367942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc459427-ffbd-4675-8f5b-27ce07f4c94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:02.368592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc459427-ffbd-4675-8f5b-27ce07f4c94a None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:02.368870 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc459427-ffbd-4675-8f5b-27ce07f4c94a None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:02.369140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc459427-ffbd-4675-8f5b-27ce07f4c94a None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:02.369804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc459427-ffbd-4675-8f5b-27ce07f4c94a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:02.371164 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc459427-ffbd-4675-8f5b-27ce07f4c94a None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:02.513906 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 594/1169] 10.222.0.72 () {60 vars in 1138 bytes} [Mon Aug 29 22:40:02 2022] POST /identity/v3/domains => generated 267 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:40:04.464051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f82b56-98fc-4b18-a18d-84baa95e60ce None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:04.464642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f82b56-98fc-4b18-a18d-84baa95e60ce None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:04.464642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f82b56-98fc-4b18-a18d-84baa95e60ce None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:04.465964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 576/1170] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:40:04.471369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baf484-8e0f-4a6a-b2f2-bff756fa1dce None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:04.471758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baf484-8e0f-4a6a-b2f2-bff756fa1dce None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:04.471921 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baf484-8e0f-4a6a-b2f2-bff756fa1dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:04.490521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-e0baf484-8e0f-4a6a-b2f2-bff756fa1dce None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:04.491710 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e0baf484-8e0f-4a6a-b2f2-bff756fa1dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:04.522679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:04.560206 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 595/1171] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:40:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:40:04.842761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f82b56-98fc-4b18-a18d-84baa95e60ce None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:04.935075 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:04.952537 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f82b56-98fc-4b18-a18d-84baa95e60ce None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:04.987714 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7943a5-14a3-4dbb-b784-f4cf80fc4301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:04.988364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7943a5-14a3-4dbb-b784-f4cf80fc4301 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:04.988647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7943a5-14a3-4dbb-b784-f4cf80fc4301 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:04.989061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7943a5-14a3-4dbb-b784-f4cf80fc4301 None admin] PATH_INFO: `/v3/domains/447825b8fecd448f9d6def57ac028719` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:04.999869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7943a5-14a3-4dbb-b784-f4cf80fc4301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=447825b8fecd448f9d6def57ac028719)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:05.001342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7943a5-14a3-4dbb-b784-f4cf80fc4301 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:05.002951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 577/1172] 10.222.0.72 () {56 vars in 1183 bytes} [Mon Aug 29 22:40:04 2022] GET /identity/v3/domains/447825b8fecd448f9d6def57ac028719 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:40:05.009993 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baf484-8e0f-4a6a-b2f2-bff756fa1dce None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:05.110689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baf484-8e0f-4a6a-b2f2-bff756fa1dce None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:05.144972 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fa472-ff08-4210-b6f0-d66824f6ce9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:05.145567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fa472-ff08-4210-b6f0-d66824f6ce9e None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:05.145848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fa472-ff08-4210-b6f0-d66824f6ce9e None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:05.146251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fa472-ff08-4210-b6f0-d66824f6ce9e None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:05.147098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fa472-ff08-4210-b6f0-d66824f6ce9e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:05.148632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fa472-ff08-4210-b6f0-d66824f6ce9e None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:05.249695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 596/1173] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Aug 29 22:40:05 2022] POST /identity/v3/projects => generated 361 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:40:07.188454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc9b30-8169-48f1-afc6-587c060fcc73 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:07.189010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc9b30-8169-48f1-afc6-587c060fcc73 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:07.189010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc9b30-8169-48f1-afc6-587c060fcc73 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:07.190367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 578/1174] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:40:07.196156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa0295-ec10-4b7e-942e-a0333ba60135 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:07.196659 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa0295-ec10-4b7e-942e-a0333ba60135 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:07.196761 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa0295-ec10-4b7e-942e-a0333ba60135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:07.215218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-6cfa0295-ec10-4b7e-942e-a0333ba60135 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:07.216438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-6cfa0295-ec10-4b7e-942e-a0333ba60135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:07.231523 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:07.288571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 597/1175] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:40:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:40:07.575325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc9b30-8169-48f1-afc6-587c060fcc73 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:07.679852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc9b30-8169-48f1-afc6-587c060fcc73 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:07.715782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee665d52-a437-4573-bab3-f6d2430eac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:07.716448 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee665d52-a437-4573-bab3-f6d2430eac23 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:07.716730 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee665d52-a437-4573-bab3-f6d2430eac23 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:07.717005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee665d52-a437-4573-bab3-f6d2430eac23 None admin] PATH_INFO: `/v3/domains/447825b8fecd448f9d6def57ac028719` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:07.718383 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee665d52-a437-4573-bab3-f6d2430eac23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=447825b8fecd448f9d6def57ac028719)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:07.719823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee665d52-a437-4573-bab3-f6d2430eac23 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:07.721449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 579/1176] 10.222.0.72 () {56 vars in 1183 bytes} [Mon Aug 29 22:40:07 2022] GET /identity/v3/domains/447825b8fecd448f9d6def57ac028719 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:40:07.727463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa0295-ec10-4b7e-942e-a0333ba60135 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:07.826237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa0295-ec10-4b7e-942e-a0333ba60135 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:07.862348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa385a-f929-4f86-9c11-0bd486a7f23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:07.863035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa385a-f929-4f86-9c11-0bd486a7f23a None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:07.863321 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa385a-f929-4f86-9c11-0bd486a7f23a None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:07.863592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa385a-f929-4f86-9c11-0bd486a7f23a None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:07.864295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa385a-f929-4f86-9c11-0bd486a7f23a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:07.866300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa385a-f929-4f86-9c11-0bd486a7f23a None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:07.968931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 598/1177] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:40:07 2022] POST /identity/v3/users => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:40:09.938198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69150084-8fbb-44de-ad78-3c0be0fef393 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:09.938785 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69150084-8fbb-44de-ad78-3c0be0fef393 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:09.938785 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69150084-8fbb-44de-ad78-3c0be0fef393 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:09.940052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 580/1178] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:40:09.946108 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378567a-7f48-40a1-9e33-db31ac564dbb None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:09.946591 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378567a-7f48-40a1-9e33-db31ac564dbb None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:09.946694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378567a-7f48-40a1-9e33-db31ac564dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:09.959580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:09.965207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-0378567a-7f48-40a1-9e33-db31ac564dbb None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:09.966413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-0378567a-7f48-40a1-9e33-db31ac564dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:10.035977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 599/1179] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:40:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:40:10.307154 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69150084-8fbb-44de-ad78-3c0be0fef393 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:10.322529 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:10.418732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69150084-8fbb-44de-ad78-3c0be0fef393 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:10.453915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72373f-1ef2-409d-b921-91a79b6b439b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:10.454583 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72373f-1ef2-409d-b921-91a79b6b439b None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:10.454849 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72373f-1ef2-409d-b921-91a79b6b439b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:10.455086 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72373f-1ef2-409d-b921-91a79b6b439b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:10.469862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72373f-1ef2-409d-b921-91a79b6b439b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-1e72373f-1ef2-409d-b921-91a79b6b439b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:40:10.475371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:40:10.477052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:40:10.477890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:40:10.477890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:40:10.477890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:40:10.477890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:40:10.477890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:40:10.477890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:40:10.477890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:40:10.477890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:40:10.477890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:40:10.477890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:40:10.477890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:40:10.477890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:40:10.477890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 581/1180] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:40:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:40:10.486453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378567a-7f48-40a1-9e33-db31ac564dbb None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:10.592409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378567a-7f48-40a1-9e33-db31ac564dbb None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:10.634065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09926071-c3b7-457c-800c-990bec947e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:10.634672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09926071-c3b7-457c-800c-990bec947e72 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:10.634952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09926071-c3b7-457c-800c-990bec947e72 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:10.635222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09926071-c3b7-457c-800c-990bec947e72 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:10.635890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09926071-c3b7-457c-800c-990bec947e72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:40:10.636221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09926071-c3b7-457c-800c-990bec947e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:10.637582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09926071-c3b7-457c-800c-990bec947e72 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:10.640016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:10.646677 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 600/1181] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:40:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:40:10.652737 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72373f-1ef2-409d-b921-91a79b6b439b None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:10.726017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:10.759566 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72373f-1ef2-409d-b921-91a79b6b439b None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:10.797580 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796c2cb-cfa0-4c87-aabf-dff7913275e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:10.797994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796c2cb-cfa0-4c87-aabf-dff7913275e1 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:10.798125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796c2cb-cfa0-4c87-aabf-dff7913275e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:10.798395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796c2cb-cfa0-4c87-aabf-dff7913275e1 None admin] PATH_INFO: `/v3/users/c960e31a3c2a40ac988566ee4c167b84` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:10.813196 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796c2cb-cfa0-4c87-aabf-dff7913275e1 None admin] RBAC: Authorizing `identity:get_user(user_id=c960e31a3c2a40ac988566ee4c167b84)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:10.814629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796c2cb-cfa0-4c87-aabf-dff7913275e1 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:10.816326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 582/1182] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:40:10 2022] GET /identity/v3/users/c960e31a3c2a40ac988566ee4c167b84 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:40:10.829319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09926071-c3b7-457c-800c-990bec947e72 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:10.932835 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09926071-c3b7-457c-800c-990bec947e72 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:10.968855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89085f-95f1-4229-8699-f3e91ab5a046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:10.969542 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89085f-95f1-4229-8699-f3e91ab5a046 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:10.969739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89085f-95f1-4229-8699-f3e91ab5a046 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:10.970007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89085f-95f1-4229-8699-f3e91ab5a046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:11.043504 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:11.047256 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89085f-95f1-4229-8699-f3e91ab5a046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:11.048747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89085f-95f1-4229-8699-f3e91ab5a046 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:11.160762 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 601/1183] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:40:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:40:11.167529 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796c2cb-cfa0-4c87-aabf-dff7913275e1 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:11.268037 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796c2cb-cfa0-4c87-aabf-dff7913275e1 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:11.305341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:11.311134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acc100-e2f5-49d5-855d-90186f596a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:11.311777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acc100-e2f5-49d5-855d-90186f596a68 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:11.312053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acc100-e2f5-49d5-855d-90186f596a68 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:11.312357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acc100-e2f5-49d5-855d-90186f596a68 None admin] PATH_INFO: `/v3/projects/33a019060c64450c8287c12e3ccc26bc` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:11.313599 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acc100-e2f5-49d5-855d-90186f596a68 None admin] RBAC: Authorizing `identity:get_project(project_id=33a019060c64450c8287c12e3ccc26bc)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:11.315033 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acc100-e2f5-49d5-855d-90186f596a68 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:11.316997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 583/1184] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:40:11 2022] GET /identity/v3/projects/33a019060c64450c8287c12e3ccc26bc => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:40:11.323484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89085f-95f1-4229-8699-f3e91ab5a046 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:11.423922 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:11.429457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89085f-95f1-4229-8699-f3e91ab5a046 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:11.466728 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6475b0-85f8-4c3f-a734-9f720db9e751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:11.467352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6475b0-85f8-4c3f-a734-9f720db9e751 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:11.467881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6475b0-85f8-4c3f-a734-9f720db9e751 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:11.468148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6475b0-85f8-4c3f-a734-9f720db9e751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:11.468908 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6475b0-85f8-4c3f-a734-9f720db9e751 None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=33a019060c64450c8287c12e3ccc26bc, user.id=c960e31a3c2a40ac988566ee4c167b84) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:40:11.469214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6475b0-85f8-4c3f-a734-9f720db9e751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:11.470643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6475b0-85f8-4c3f-a734-9f720db9e751 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:11.477678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 602/1185] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:40:11 2022] GET /identity/v3/role_assignments?user.id=c960e31a3c2a40ac988566ee4c167b84&scope.project.id=33a019060c64450c8287c12e3ccc26bc&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:40:13.426540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f140a-3b49-49d9-9952-b2babcebab57 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:13.427628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f140a-3b49-49d9-9952-b2babcebab57 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:13.427628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f140a-3b49-49d9-9952-b2babcebab57 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:13.429032 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 584/1186] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:40:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:40:13.434819 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f7ba5-cbde-4ce5-9284-a3cdb991a36d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:13.435315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f7ba5-cbde-4ce5-9284-a3cdb991a36d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:13.435401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f7ba5-cbde-4ce5-9284-a3cdb991a36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:13.455913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-0f8f7ba5-cbde-4ce5-9284-a3cdb991a36d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:13.457182 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-0f8f7ba5-cbde-4ce5-9284-a3cdb991a36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:13.535880 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 603/1187] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:40:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:40:13.812140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f140a-3b49-49d9-9952-b2babcebab57 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:13.915917 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f140a-3b49-49d9-9952-b2babcebab57 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:13.953532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61df9e-91fe-4f07-a5d9-026f7c46484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:13.954166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61df9e-91fe-4f07-a5d9-026f7c46484b None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:13.954471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61df9e-91fe-4f07-a5d9-026f7c46484b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:13.954736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61df9e-91fe-4f07-a5d9-026f7c46484b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:13.965964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61df9e-91fe-4f07-a5d9-026f7c46484b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-4e61df9e-91fe-4f07-a5d9-026f7c46484b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:40:13.972084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:40:13.973210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:40:13.975209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:40:13.975209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:40:13.975209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:40:13.975209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:40:13.975209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:40:13.975209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:40:13.975209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:40:13.975209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:40:13.975209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:40:13.975209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:40:13.975209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:40:13.975209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:40:13.975209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 585/1188] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:40:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:40:13.980172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f7ba5-cbde-4ce5-9284-a3cdb991a36d None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:14.073147 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:14.082046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f7ba5-cbde-4ce5-9284-a3cdb991a36d None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:14.117176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaab08-0e53-432d-b022-35508896dc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:14.117780 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaab08-0e53-432d-b022-35508896dc39 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:14.118057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaab08-0e53-432d-b022-35508896dc39 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:14.118328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaab08-0e53-432d-b022-35508896dc39 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:14.118989 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aaab08-0e53-432d-b022-35508896dc39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:40:14.119290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aaab08-0e53-432d-b022-35508896dc39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:14.120683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aaab08-0e53-432d-b022-35508896dc39 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:14.129094 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 604/1189] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:40:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:40:14.137030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61df9e-91fe-4f07-a5d9-026f7c46484b None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:14.197175 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:14.237512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61df9e-91fe-4f07-a5d9-026f7c46484b None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:14.272558 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e038a-a955-45c6-a393-7cfba18d622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:14.273194 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e038a-a955-45c6-a393-7cfba18d622c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:14.273468 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e038a-a955-45c6-a393-7cfba18d622c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:14.273736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e038a-a955-45c6-a393-7cfba18d622c None admin] PATH_INFO: `/v3/users/c960e31a3c2a40ac988566ee4c167b84` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:14.274856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e038a-a955-45c6-a393-7cfba18d622c None admin] RBAC: Authorizing `identity:get_user(user_id=c960e31a3c2a40ac988566ee4c167b84)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:14.276298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e038a-a955-45c6-a393-7cfba18d622c None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:14.277936 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 586/1190] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:40:14 2022] GET /identity/v3/users/c960e31a3c2a40ac988566ee4c167b84 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:40:14.283766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaab08-0e53-432d-b022-35508896dc39 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:14.386591 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaab08-0e53-432d-b022-35508896dc39 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:14.419998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382866a-3f71-460b-b7d5-581c992656bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:14.420671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382866a-3f71-460b-b7d5-581c992656bd None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:14.420951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382866a-3f71-460b-b7d5-581c992656bd None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:14.421247 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382866a-3f71-460b-b7d5-581c992656bd None admin] PATH_INFO: `/v3/projects/33a019060c64450c8287c12e3ccc26bc` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:14.425957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382866a-3f71-460b-b7d5-581c992656bd None admin] RBAC: Authorizing `identity:get_project(project_id=33a019060c64450c8287c12e3ccc26bc)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:14.425957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382866a-3f71-460b-b7d5-581c992656bd None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:14.425957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 605/1191] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:40:14 2022] GET /identity/v3/projects/33a019060c64450c8287c12e3ccc26bc => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:40:14.432985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e038a-a955-45c6-a393-7cfba18d622c None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:14.536862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e038a-a955-45c6-a393-7cfba18d622c None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:14.563167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:14.572041 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d188735-6b3d-4813-ad7f-1992fea13fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:14.572740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d188735-6b3d-4813-ad7f-1992fea13fa7 None admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:14.573014 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d188735-6b3d-4813-ad7f-1992fea13fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:14.573286 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d188735-6b3d-4813-ad7f-1992fea13fa7 None admin] PATH_INFO: `/v3/projects/33a019060c64450c8287c12e3ccc26bc/users/c960e31a3c2a40ac988566ee4c167b84/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:14.575236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d188735-6b3d-4813-ad7f-1992fea13fa7 None admin] RBAC: Authorizing `identity:create_grant(project_id=33a019060c64450c8287c12e3ccc26bc, user_id=c960e31a3c2a40ac988566ee4c167b84, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:14.576743 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d188735-6b3d-4813-ad7f-1992fea13fa7 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:14.625077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 587/1192] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:40:14 2022] PUT /identity/v3/projects/33a019060c64450c8287c12e3ccc26bc/users/c960e31a3c2a40ac988566ee4c167b84/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:40:16.551178 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee614afb-8e32-40f5-83db-f2793c1b3c37 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:16.552688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee614afb-8e32-40f5-83db-f2793c1b3c37 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:16.552986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee614afb-8e32-40f5-83db-f2793c1b3c37 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:16.554427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 606/1193] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:40:16.559638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f23a3e-f4c5-472f-8fd5-cbc1de7726f4 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:16.560113 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f23a3e-f4c5-472f-8fd5-cbc1de7726f4 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:16.560226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f23a3e-f4c5-472f-8fd5-cbc1de7726f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:16.578972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-c0f23a3e-f4c5-472f-8fd5-cbc1de7726f4 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:16.580184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c0f23a3e-f4c5-472f-8fd5-cbc1de7726f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:16.651122 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 588/1194] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:40:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:40:16.920877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee614afb-8e32-40f5-83db-f2793c1b3c37 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:16.947615 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:17.029892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee614afb-8e32-40f5-83db-f2793c1b3c37 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:17.063865 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190965a3-8bf7-4abc-baef-f760632b69a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:17.064519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190965a3-8bf7-4abc-baef-f760632b69a2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:17.064793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190965a3-8bf7-4abc-baef-f760632b69a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:17.065063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190965a3-8bf7-4abc-baef-f760632b69a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:17.076661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190965a3-8bf7-4abc-baef-f760632b69a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-190965a3-8bf7-4abc-baef-f760632b69a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:40:17.081500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:40:17.082644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:40:17.086730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:40:17.086730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:40:17.086730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:40:17.086730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:40:17.086730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:40:17.086730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:40:17.086730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:40:17.086730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:40:17.086730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:40:17.086730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:40:17.086730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:40:17.086730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:40:17.086730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 607/1195] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:40:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:40:17.089376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f23a3e-f4c5-472f-8fd5-cbc1de7726f4 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:17.189603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f23a3e-f4c5-472f-8fd5-cbc1de7726f4 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:17.206799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:17.226198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846223f9-cb5c-403a-a8db-ae66ef4d22d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:17.226810 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846223f9-cb5c-403a-a8db-ae66ef4d22d0 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:17.227089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846223f9-cb5c-403a-a8db-ae66ef4d22d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:17.227365 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846223f9-cb5c-403a-a8db-ae66ef4d22d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:17.228026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846223f9-cb5c-403a-a8db-ae66ef4d22d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:40:17.228455 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846223f9-cb5c-403a-a8db-ae66ef4d22d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:17.229827 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846223f9-cb5c-403a-a8db-ae66ef4d22d0 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:17.238139 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 589/1196] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:40:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:40:17.244063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190965a3-8bf7-4abc-baef-f760632b69a2 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:17.328123 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:17.346559 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190965a3-8bf7-4abc-baef-f760632b69a2 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:17.381626 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe83aba-b1b7-42f7-9719-e8407c7911be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:17.382252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe83aba-b1b7-42f7-9719-e8407c7911be None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:17.382525 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe83aba-b1b7-42f7-9719-e8407c7911be None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:17.382794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe83aba-b1b7-42f7-9719-e8407c7911be None admin] PATH_INFO: `/v3/users/c960e31a3c2a40ac988566ee4c167b84` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:17.383911 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe83aba-b1b7-42f7-9719-e8407c7911be None admin] RBAC: Authorizing `identity:get_user(user_id=c960e31a3c2a40ac988566ee4c167b84)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:17.385372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe83aba-b1b7-42f7-9719-e8407c7911be None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:17.386983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 608/1197] 10.222.0.72 () {56 vars in 1177 bytes} [Mon Aug 29 22:40:17 2022] GET /identity/v3/users/c960e31a3c2a40ac988566ee4c167b84 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:40:17.396365 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846223f9-cb5c-403a-a8db-ae66ef4d22d0 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:17.500520 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846223f9-cb5c-403a-a8db-ae66ef4d22d0 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:17.534583 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9525de-3027-4a98-8aee-7270db277079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:17.535186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9525de-3027-4a98-8aee-7270db277079 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:17.535463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9525de-3027-4a98-8aee-7270db277079 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:17.535816 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9525de-3027-4a98-8aee-7270db277079 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:17.582486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:17.604866 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9525de-3027-4a98-8aee-7270db277079 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:17.606393 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9525de-3027-4a98-8aee-7270db277079 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:17.704596 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 590/1198] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:40:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:40:17.711352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe83aba-b1b7-42f7-9719-e8407c7911be None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:17.812161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe83aba-b1b7-42f7-9719-e8407c7911be None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:17.846717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1ad42-ccf4-40e6-bce6-67486ce34146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:17.847346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1ad42-ccf4-40e6-bce6-67486ce34146 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:17.847629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1ad42-ccf4-40e6-bce6-67486ce34146 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:17.847905 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1ad42-ccf4-40e6-bce6-67486ce34146 None admin] PATH_INFO: `/v3/projects/33a019060c64450c8287c12e3ccc26bc` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:17.849235 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1ad42-ccf4-40e6-bce6-67486ce34146 None admin] RBAC: Authorizing `identity:get_project(project_id=33a019060c64450c8287c12e3ccc26bc)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:17.850676 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1ad42-ccf4-40e6-bce6-67486ce34146 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:17.852332 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 609/1199] 10.222.0.72 () {56 vars in 1186 bytes} [Mon Aug 29 22:40:17 2022] GET /identity/v3/projects/33a019060c64450c8287c12e3ccc26bc => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:40:17.858444 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9525de-3027-4a98-8aee-7270db277079 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:17.939011 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:17.963914 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9525de-3027-4a98-8aee-7270db277079 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:17.999181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffd05e-49e6-495c-ba5b-a6396a200480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:17.999785 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffd05e-49e6-495c-ba5b-a6396a200480 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:18.000086 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffd05e-49e6-495c-ba5b-a6396a200480 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:18.000381 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffd05e-49e6-495c-ba5b-a6396a200480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:18.001102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffd05e-49e6-495c-ba5b-a6396a200480 None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=33a019060c64450c8287c12e3ccc26bc, user.id=c960e31a3c2a40ac988566ee4c167b84) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:40:18.001406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffd05e-49e6-495c-ba5b-a6396a200480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:18.002820 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffd05e-49e6-495c-ba5b-a6396a200480 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:18.009725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 591/1200] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:40:17 2022] GET /identity/v3/role_assignments?user.id=c960e31a3c2a40ac988566ee4c167b84&scope.project.id=33a019060c64450c8287c12e3ccc26bc&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:40:27.842126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=91 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:28.006918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=29 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:31.304565 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa2aef-099a-4407-90f1-90e65090c50c None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:31.305171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa2aef-099a-4407-90f1-90e65090c50c None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:31.305171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa2aef-099a-4407-90f1-90e65090c50c None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:31.306454 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 610/1201] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:31.311623 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590db40-63f0-4af0-9171-d74f4aa184c1 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:31.312056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590db40-63f0-4af0-9171-d74f4aa184c1 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:31.312169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590db40-63f0-4af0-9171-d74f4aa184c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:31.330763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-f590db40-63f0-4af0-9171-d74f4aa184c1 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:31.332844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f590db40-63f0-4af0-9171-d74f4aa184c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:31.401329 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 592/1202] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:41:31.676137 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa2aef-099a-4407-90f1-90e65090c50c None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:31.779608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa2aef-099a-4407-90f1-90e65090c50c None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:31.813947 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2841dc-f373-4d91-992c-cbc47a89d066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:31.814573 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2841dc-f373-4d91-992c-cbc47a89d066 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:31.814855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2841dc-f373-4d91-992c-cbc47a89d066 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:31.815129 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2841dc-f373-4d91-992c-cbc47a89d066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:31.826113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2841dc-f373-4d91-992c-cbc47a89d066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:31.827562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2841dc-f373-4d91-992c-cbc47a89d066 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-ea2841dc-f373-4d91-992c-cbc47a89d066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:41:31.843088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:31.844341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:41:31.845544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:41:31.845544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:31.845544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:31.845544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 611/1203] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:31.851273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590db40-63f0-4af0-9171-d74f4aa184c1 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:31.954050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590db40-63f0-4af0-9171-d74f4aa184c1 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:31.985599 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:31.991965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23453b9-d39a-453c-8508-050e7be52618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:31.992646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23453b9-d39a-453c-8508-050e7be52618 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:31.992897 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23453b9-d39a-453c-8508-050e7be52618 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:31.993169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23453b9-d39a-453c-8508-050e7be52618 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:31.993812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23453b9-d39a-453c-8508-050e7be52618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:31.994112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23453b9-d39a-453c-8508-050e7be52618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:31.995497 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23453b9-d39a-453c-8508-050e7be52618 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:32.007685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 593/1204] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:32.014156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2841dc-f373-4d91-992c-cbc47a89d066 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:32.068774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:32.117050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2841dc-f373-4d91-992c-cbc47a89d066 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:32.149682 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce61b9a-91bd-4cfc-bdd2-d8675721af92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:32.150349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce61b9a-91bd-4cfc-bdd2-d8675721af92 None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:32.150630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce61b9a-91bd-4cfc-bdd2-d8675721af92 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:32.151163 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce61b9a-91bd-4cfc-bdd2-d8675721af92 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:32.152081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce61b9a-91bd-4cfc-bdd2-d8675721af92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:32.154042 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce61b9a-91bd-4cfc-bdd2-d8675721af92 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:32.249043 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 612/1205] 10.222.0.72 () {60 vars in 1132 bytes} [Mon Aug 29 22:41:32 2022] POST /identity/v3/users => generated 251 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:41:34.239926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b668e-dfbe-4b7d-9200-b83d9bfd7d29 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:34.240835 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b668e-dfbe-4b7d-9200-b83d9bfd7d29 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:34.240835 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b668e-dfbe-4b7d-9200-b83d9bfd7d29 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:34.241905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 594/1206] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:41:34.247570 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbd198-b8c2-4e9e-bde3-d51078b9d3e4 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:34.248057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbd198-b8c2-4e9e-bde3-d51078b9d3e4 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:34.248405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbd198-b8c2-4e9e-bde3-d51078b9d3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:34.268952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-56fbd198-b8c2-4e9e-bde3-d51078b9d3e4 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:34.270947 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-56fbd198-b8c2-4e9e-bde3-d51078b9d3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:34.348468 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 613/1207] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:41:34.652019 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b668e-dfbe-4b7d-9200-b83d9bfd7d29 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:34.762287 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b668e-dfbe-4b7d-9200-b83d9bfd7d29 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:34.801631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbdb6d-92e0-49d9-9899-66b7f7466d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:34.802370 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbdb6d-92e0-49d9-9899-66b7f7466d13 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:34.802650 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbdb6d-92e0-49d9-9899-66b7f7466d13 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:34.802922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbdb6d-92e0-49d9-9899-66b7f7466d13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:34.813674 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbdb6d-92e0-49d9-9899-66b7f7466d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-73bbdb6d-92e0-49d9-9899-66b7f7466d13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:41:34.819607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:34.823390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:34.824453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:34.824453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:34.824453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:34.824453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:34.824453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:41:34.824453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:41:34.824453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:41:34.824453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:41:34.824453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:41:34.824453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:41:34.824453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:41:34.824453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:41:34.824453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 595/1208] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:41:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:41:34.827373 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbd198-b8c2-4e9e-bde3-d51078b9d3e4 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:34.869593 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:34.940307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbd198-b8c2-4e9e-bde3-d51078b9d3e4 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:34.978084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a08a4-53e0-4119-b8b8-670a0ce06b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:34.978729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a08a4-53e0-4119-b8b8-670a0ce06b8c None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:34.979006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a08a4-53e0-4119-b8b8-670a0ce06b8c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:34.979282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a08a4-53e0-4119-b8b8-670a0ce06b8c None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:34.979952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a08a4-53e0-4119-b8b8-670a0ce06b8c None admin] RBAC: Adding query filter params (name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:34.980277 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a08a4-53e0-4119-b8b8-670a0ce06b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:34.981655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a08a4-53e0-4119-b8b8-670a0ce06b8c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:34.990623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 614/1209] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:41:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:34.996591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbdb6d-92e0-49d9-9899-66b7f7466d13 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:35.053970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:35.122240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbdb6d-92e0-49d9-9899-66b7f7466d13 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:35.167634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b6cdb-7e04-4030-be75-f4091a1f0017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:35.168292 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b6cdb-7e04-4030-be75-f4091a1f0017 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:35.168570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b6cdb-7e04-4030-be75-f4091a1f0017 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:35.168842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b6cdb-7e04-4030-be75-f4091a1f0017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:35.180549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b6cdb-7e04-4030-be75-f4091a1f0017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:35.181956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b6cdb-7e04-4030-be75-f4091a1f0017 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-e38b6cdb-7e04-4030-be75-f4091a1f0017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:41:35.197169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:35.198336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:41:35.199462 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:41:35.199462 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:35.199462 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:41:35.199462 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 596/1210] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:35.203436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a08a4-53e0-4119-b8b8-670a0ce06b8c None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:35.305926 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:35.308879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a08a4-53e0-4119-b8b8-670a0ce06b8c None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:35.342890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450d394-df2b-4cce-a8e6-a591f129f9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:35.343490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450d394-df2b-4cce-a8e6-a591f129f9c1 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:35.343769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450d394-df2b-4cce-a8e6-a591f129f9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:35.344034 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450d394-df2b-4cce-a8e6-a591f129f9c1 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:35.344712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450d394-df2b-4cce-a8e6-a591f129f9c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:35.345012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450d394-df2b-4cce-a8e6-a591f129f9c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:35.346371 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450d394-df2b-4cce-a8e6-a591f129f9c1 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:35.358853 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 615/1211] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:35.365498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b6cdb-7e04-4030-be75-f4091a1f0017 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:35.474323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b6cdb-7e04-4030-be75-f4091a1f0017 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:35.475881 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:35.517417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173d142-6e43-4dd6-9dc0-c4d0e116c03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:35.518050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d142-6e43-4dd6-9dc0-c4d0e116c03f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:35.518326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d142-6e43-4dd6-9dc0-c4d0e116c03f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:35.518596 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d142-6e43-4dd6-9dc0-c4d0e116c03f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:35.526459 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173d142-6e43-4dd6-9dc0-c4d0e116c03f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:35.528023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173d142-6e43-4dd6-9dc0-c4d0e116c03f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-3173d142-6e43-4dd6-9dc0-c4d0e116c03f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:41:35.540807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:35.541979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:35.542931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:35.542931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:35.542931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:41:35.542931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:41:35.542931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:41:35.542931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:41:35.542931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:41:35.542931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:41:35.542931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:41:35.542931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:41:35.542931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 597/1212] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:35.548150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450d394-df2b-4cce-a8e6-a591f129f9c1 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:35.657933 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450d394-df2b-4cce-a8e6-a591f129f9c1 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:35.692922 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5200f-9fb0-4b6c-960e-8c07d20a0d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:35.693546 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5200f-9fb0-4b6c-960e-8c07d20a0d3d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:35.693821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5200f-9fb0-4b6c-960e-8c07d20a0d3d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:35.694088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5200f-9fb0-4b6c-960e-8c07d20a0d3d None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:35.694839 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5200f-9fb0-4b6c-960e-8c07d20a0d3d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:35.695140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5200f-9fb0-4b6c-960e-8c07d20a0d3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:35.696618 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5200f-9fb0-4b6c-960e-8c07d20a0d3d None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:35.718020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 616/1213] 10.222.0.72 () {56 vars in 1143 bytes} [Mon Aug 29 22:41:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:35.730123 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173d142-6e43-4dd6-9dc0-c4d0e116c03f None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:35.842940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173d142-6e43-4dd6-9dc0-c4d0e116c03f None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:35.889077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3855c-3f55-4406-9a3b-7798ad418fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:35.889689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3855c-3f55-4406-9a3b-7798ad418fb5 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:35.889972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3855c-3f55-4406-9a3b-7798ad418fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:35.890249 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3855c-3f55-4406-9a3b-7798ad418fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:35.930584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:35.973733 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3855c-3f55-4406-9a3b-7798ad418fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:35.975330 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3855c-3f55-4406-9a3b-7798ad418fb5 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:36.102629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 598/1214] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:41:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:36.109466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5200f-9fb0-4b6c-960e-8c07d20a0d3d None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:36.132313 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:36.218271 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5200f-9fb0-4b6c-960e-8c07d20a0d3d None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:36.265545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18513d99-fecb-4e6a-8e6d-403f2d1c2b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:36.266176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18513d99-fecb-4e6a-8e6d-403f2d1c2b3b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:36.266452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18513d99-fecb-4e6a-8e6d-403f2d1c2b3b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:36.266778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18513d99-fecb-4e6a-8e6d-403f2d1c2b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:36.278391 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18513d99-fecb-4e6a-8e6d-403f2d1c2b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:36.279842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18513d99-fecb-4e6a-8e6d-403f2d1c2b3b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-18513d99-fecb-4e6a-8e6d-403f2d1c2b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:41:36.295822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:36.297698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:41:36.299187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:41:36.299187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:36.299187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:36.299187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 617/1215] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:36.306786 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3855c-3f55-4406-9a3b-7798ad418fb5 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:36.381119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:36.429378 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3855c-3f55-4406-9a3b-7798ad418fb5 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:36.468856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088abd4-b328-4925-a977-60453a89a82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:36.469483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088abd4-b328-4925-a977-60453a89a82f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:36.469851 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088abd4-b328-4925-a977-60453a89a82f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:36.470134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088abd4-b328-4925-a977-60453a89a82f None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:36.470780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088abd4-b328-4925-a977-60453a89a82f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:36.471082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088abd4-b328-4925-a977-60453a89a82f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:36.473269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088abd4-b328-4925-a977-60453a89a82f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:36.486121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 599/1216] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:41:36.493093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18513d99-fecb-4e6a-8e6d-403f2d1c2b3b None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:36.573422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:36.606691 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18513d99-fecb-4e6a-8e6d-403f2d1c2b3b None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:36.643055 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3dd12-61ba-4e78-8ee2-8759fd90f0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:36.643606 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3dd12-61ba-4e78-8ee2-8759fd90f0bb None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:36.643884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3dd12-61ba-4e78-8ee2-8759fd90f0bb None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:36.644229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3dd12-61ba-4e78-8ee2-8759fd90f0bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:36.651943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3dd12-61ba-4e78-8ee2-8759fd90f0bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:36.653501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3dd12-61ba-4e78-8ee2-8759fd90f0bb None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:36.667062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-0fc3dd12-61ba-4e78-8ee2-8759fd90f0bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:41:36.667062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:36.667062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:36.667062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:36.667062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:36.667062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:36.667062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:36.667062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:36.667062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:36.667062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:36.667062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:36.667062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:36.667062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:41:36.667062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:41:36.667062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:36.668151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:36.669530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:41:36.669530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:41:36.669530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:41:36.669530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:41:36.669530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:41:36.669530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:41:36.669530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:41:36.669530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:36.669530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 618/1217] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:41:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:36.674253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088abd4-b328-4925-a977-60453a89a82f None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:36.779783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088abd4-b328-4925-a977-60453a89a82f None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:36.804533 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:36.816814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb330a-ce9e-4552-906c-ee30967f0111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:36.817447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb330a-ce9e-4552-906c-ee30967f0111 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:36.817730 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb330a-ce9e-4552-906c-ee30967f0111 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:36.818007 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb330a-ce9e-4552-906c-ee30967f0111 None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:36.818705 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb330a-ce9e-4552-906c-ee30967f0111 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:36.819011 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb330a-ce9e-4552-906c-ee30967f0111 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:36.820465 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb330a-ce9e-4552-906c-ee30967f0111 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:36.833929 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 600/1218] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:41:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:36.840562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3dd12-61ba-4e78-8ee2-8759fd90f0bb None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:36.954457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3dd12-61ba-4e78-8ee2-8759fd90f0bb None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:36.986430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:36.993065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df84260-43a6-4d20-9755-11b1f400494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:36.993677 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84260-43a6-4d20-9755-11b1f400494c None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:36.993959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84260-43a6-4d20-9755-11b1f400494c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:36.994236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84260-43a6-4d20-9755-11b1f400494c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:36.994967 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df84260-43a6-4d20-9755-11b1f400494c None admin] RBAC: Adding query filter params (role.id=14efd2033a754e9b9143349f4994e356, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=83c5fb88d96640089eba545f4c8d3c44) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:36.995327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df84260-43a6-4d20-9755-11b1f400494c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:36.996833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df84260-43a6-4d20-9755-11b1f400494c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:37.002581 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 619/1219] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:41:36 2022] GET /identity/v3/role_assignments?user.id=83c5fb88d96640089eba545f4c8d3c44&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=14efd2033a754e9b9143349f4994e356 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:38.930239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b25b95-d1e6-47d5-a7c5-0354a72fd0be None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:38.930851 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b25b95-d1e6-47d5-a7c5-0354a72fd0be None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:38.930851 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b25b95-d1e6-47d5-a7c5-0354a72fd0be None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:38.932142 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 601/1220] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:38.937290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a828c-f257-4c40-ad72-ac76b4d62f36 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:38.937704 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a828c-f257-4c40-ad72-ac76b4d62f36 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:38.937848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a828c-f257-4c40-ad72-ac76b4d62f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:38.956593 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-8f7a828c-f257-4c40-ad72-ac76b4d62f36 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:38.957874 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8f7a828c-f257-4c40-ad72-ac76b4d62f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:39.026519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 620/1221] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:41:39.305390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b25b95-d1e6-47d5-a7c5-0354a72fd0be None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:39.409512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b25b95-d1e6-47d5-a7c5-0354a72fd0be None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:39.446202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e834562-1a5b-40c0-b897-a17040024639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:39.446834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e834562-1a5b-40c0-b897-a17040024639 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:39.451652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e834562-1a5b-40c0-b897-a17040024639 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:39.451652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e834562-1a5b-40c0-b897-a17040024639 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:39.458667 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e834562-1a5b-40c0-b897-a17040024639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-5e834562-1a5b-40c0-b897-a17040024639 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:41:39.463788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:39.465052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:39.466103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:39.466103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:39.466103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:39.466103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:39.466103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:41:39.466103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:41:39.466103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:41:39.466103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:41:39.466103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:41:39.466103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:41:39.466103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:41:39.466103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:41:39.466103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 602/1222] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:41:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:39.471312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a828c-f257-4c40-ad72-ac76b4d62f36 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:39.574326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a828c-f257-4c40-ad72-ac76b4d62f36 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:39.598228 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:39.609740 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c6c45-a2f7-416e-a9dc-908cac71ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:39.610366 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c6c45-a2f7-416e-a9dc-908cac71ceb8 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:39.610646 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c6c45-a2f7-416e-a9dc-908cac71ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:39.610914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c6c45-a2f7-416e-a9dc-908cac71ceb8 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:39.611573 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c6c45-a2f7-416e-a9dc-908cac71ceb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:39.611901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c6c45-a2f7-416e-a9dc-908cac71ceb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:39.614031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c6c45-a2f7-416e-a9dc-908cac71ceb8 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:39.622301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 621/1223] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:41:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:39.628125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e834562-1a5b-40c0-b897-a17040024639 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:39.674099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:39.731570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e834562-1a5b-40c0-b897-a17040024639 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:39.766776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b903d1-de9a-49b1-aa53-943f5fbcae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:39.767431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b903d1-de9a-49b1-aa53-943f5fbcae14 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:39.767703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b903d1-de9a-49b1-aa53-943f5fbcae14 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:39.767951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b903d1-de9a-49b1-aa53-943f5fbcae14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:39.778465 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b903d1-de9a-49b1-aa53-943f5fbcae14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:39.779910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b903d1-de9a-49b1-aa53-943f5fbcae14 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-19b903d1-de9a-49b1-aa53-943f5fbcae14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:41:39.795092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:39.799974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:41:39.801771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:41:39.801771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:39.801771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:41:39.801771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 603/1224] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:39.803108 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c6c45-a2f7-416e-a9dc-908cac71ceb8 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:39.903619 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c6c45-a2f7-416e-a9dc-908cac71ceb8 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:39.937648 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648fa9a-9fe9-4f95-b395-ae1c6b0bdad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:39.938431 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648fa9a-9fe9-4f95-b395-ae1c6b0bdad0 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:39.938543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648fa9a-9fe9-4f95-b395-ae1c6b0bdad0 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:39.938808 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648fa9a-9fe9-4f95-b395-ae1c6b0bdad0 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:39.939443 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648fa9a-9fe9-4f95-b395-ae1c6b0bdad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:39.939741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648fa9a-9fe9-4f95-b395-ae1c6b0bdad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:39.941323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648fa9a-9fe9-4f95-b395-ae1c6b0bdad0 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:39.953001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 622/1225] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:39.959622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b903d1-de9a-49b1-aa53-943f5fbcae14 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:40.057721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:40.064573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b903d1-de9a-49b1-aa53-943f5fbcae14 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:40.100272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9581ff-6410-4679-9173-572ec737b46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:40.100901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9581ff-6410-4679-9173-572ec737b46f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:40.101175 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9581ff-6410-4679-9173-572ec737b46f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:40.101447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9581ff-6410-4679-9173-572ec737b46f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:40.109289 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9581ff-6410-4679-9173-572ec737b46f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:40.110811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9581ff-6410-4679-9173-572ec737b46f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-ea9581ff-6410-4679-9173-572ec737b46f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:41:40.122331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:40.123303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:40.124367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:40.124367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:40.124367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:41:40.124367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:41:40.124367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:41:40.124367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:41:40.124367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:41:40.124367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:41:40.124367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:41:40.124367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:41:40.124367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 604/1226] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:40.129622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648fa9a-9fe9-4f95-b395-ae1c6b0bdad0 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:40.183301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:40.237431 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648fa9a-9fe9-4f95-b395-ae1c6b0bdad0 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:40.273916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4f918-0c59-492b-bc36-f3f92c395849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:40.274564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4f918-0c59-492b-bc36-f3f92c395849 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:40.274843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4f918-0c59-492b-bc36-f3f92c395849 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:40.275114 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4f918-0c59-492b-bc36-f3f92c395849 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:40.276058 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4f918-0c59-492b-bc36-f3f92c395849 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:40.276486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4f918-0c59-492b-bc36-f3f92c395849 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:40.277917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4f918-0c59-492b-bc36-f3f92c395849 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:40.295246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 623/1227] 10.222.0.72 () {56 vars in 1143 bytes} [Mon Aug 29 22:41:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:40.301582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9581ff-6410-4679-9173-572ec737b46f None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:40.404921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9581ff-6410-4679-9173-572ec737b46f None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:40.443332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92640dfa-930b-4b95-bdbd-3f8db69a86fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:40.443868 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92640dfa-930b-4b95-bdbd-3f8db69a86fa None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:40.444143 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92640dfa-930b-4b95-bdbd-3f8db69a86fa None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:40.444444 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92640dfa-930b-4b95-bdbd-3f8db69a86fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:40.455503 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92640dfa-930b-4b95-bdbd-3f8db69a86fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:40.458018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92640dfa-930b-4b95-bdbd-3f8db69a86fa None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-92640dfa-930b-4b95-bdbd-3f8db69a86fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:41:40.473027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:40.474157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:41:40.475320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:41:40.475320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:40.475320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:41:40.475320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 605/1228] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:40.480071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4f918-0c59-492b-bc36-f3f92c395849 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:40.582413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4f918-0c59-492b-bc36-f3f92c395849 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:40.584763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:40.618000 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8eed2-064f-4c57-95fe-e6dd85f0f002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:40.618580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8eed2-064f-4c57-95fe-e6dd85f0f002 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:40.618855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8eed2-064f-4c57-95fe-e6dd85f0f002 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:40.619122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8eed2-064f-4c57-95fe-e6dd85f0f002 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:40.619757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8eed2-064f-4c57-95fe-e6dd85f0f002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:40.620063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8eed2-064f-4c57-95fe-e6dd85f0f002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:40.621496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8eed2-064f-4c57-95fe-e6dd85f0f002 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:40.633763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 624/1229] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:40.639546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92640dfa-930b-4b95-bdbd-3f8db69a86fa None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:40.649516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:40.740969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92640dfa-930b-4b95-bdbd-3f8db69a86fa None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:40.775367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd52b1-840b-4c7a-b73d-42168c1699c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:40.776007 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd52b1-840b-4c7a-b73d-42168c1699c7 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:40.776341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd52b1-840b-4c7a-b73d-42168c1699c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:40.776617 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd52b1-840b-4c7a-b73d-42168c1699c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:40.783517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd52b1-840b-4c7a-b73d-42168c1699c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:40.786077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd52b1-840b-4c7a-b73d-42168c1699c7 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:40.797453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-6cbd52b1-840b-4c7a-b73d-42168c1699c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:41:40.797453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:40.797453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:40.797453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:40.797453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:40.797453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:40.797453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:40.797453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:40.797453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:40.797453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:40.797453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:40.797453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:40.797453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:41:40.797453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:41:40.797453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:40.798565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:40.799631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:41:40.799631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:41:40.799631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:41:40.799631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:41:40.799631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:41:40.799631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:41:40.799631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:41:40.799631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:41:40.799631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 606/1230] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:41:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:40.804786 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8eed2-064f-4c57-95fe-e6dd85f0f002 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:40.925129 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8eed2-064f-4c57-95fe-e6dd85f0f002 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:40.960546 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66814c7-76fb-4cd9-bb5e-577671cb7e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:40.961219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66814c7-76fb-4cd9-bb5e-577671cb7e50 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:40.961426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66814c7-76fb-4cd9-bb5e-577671cb7e50 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:40.961697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66814c7-76fb-4cd9-bb5e-577671cb7e50 None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:40.962658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66814c7-76fb-4cd9-bb5e-577671cb7e50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:40.962962 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66814c7-76fb-4cd9-bb5e-577671cb7e50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:40.964433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66814c7-76fb-4cd9-bb5e-577671cb7e50 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:40.977521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 625/1231] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:41:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:40.983869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd52b1-840b-4c7a-b73d-42168c1699c7 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:41.051938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:41.088153 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd52b1-840b-4c7a-b73d-42168c1699c7 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:41.123366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921f2bb-a268-4454-87a0-f6425312827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:41.124023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921f2bb-a268-4454-87a0-f6425312827b None admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:41.124334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921f2bb-a268-4454-87a0-f6425312827b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:41.124613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921f2bb-a268-4454-87a0-f6425312827b None admin] PATH_INFO: `/v3/projects/7abc4d6c6e004b15abff7738164175db/users/83c5fb88d96640089eba545f4c8d3c44/roles/14efd2033a754e9b9143349f4994e356` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:41.141874 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921f2bb-a268-4454-87a0-f6425312827b None admin] RBAC: Authorizing `identity:create_grant(project_id=7abc4d6c6e004b15abff7738164175db, user_id=83c5fb88d96640089eba545f4c8d3c44, role_id=14efd2033a754e9b9143349f4994e356)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:41.143384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921f2bb-a268-4454-87a0-f6425312827b None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:41.237537 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 607/1232] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:41:40 2022] PUT /identity/v3/projects/7abc4d6c6e004b15abff7738164175db/users/83c5fb88d96640089eba545f4c8d3c44/roles/14efd2033a754e9b9143349f4994e356 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:41:43.213004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69e1e4-41d7-4747-8efd-ee03aae1ae33 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:43.213574 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69e1e4-41d7-4747-8efd-ee03aae1ae33 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:43.213672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69e1e4-41d7-4747-8efd-ee03aae1ae33 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:43.214978 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 626/1233] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:43.220147 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211044-be72-417b-b866-c8f9fdea7d37 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:43.220680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211044-be72-417b-b866-c8f9fdea7d37 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:43.220782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211044-be72-417b-b866-c8f9fdea7d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:43.239380 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-12211044-be72-417b-b866-c8f9fdea7d37 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:43.254967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-12211044-be72-417b-b866-c8f9fdea7d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:43.311280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 608/1234] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:41:43.588656 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69e1e4-41d7-4747-8efd-ee03aae1ae33 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:43.616903 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:43.696443 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69e1e4-41d7-4747-8efd-ee03aae1ae33 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:43.732246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437b26e-ab47-4296-87a1-9bc76b857492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:43.732908 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437b26e-ab47-4296-87a1-9bc76b857492 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:43.733222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437b26e-ab47-4296-87a1-9bc76b857492 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:43.733498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437b26e-ab47-4296-87a1-9bc76b857492 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:43.744410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437b26e-ab47-4296-87a1-9bc76b857492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-6437b26e-ab47-4296-87a1-9bc76b857492 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:41:43.749241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:43.750364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:43.751543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:43.751543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:43.751543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:43.751543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:43.751543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:41:43.751543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:41:43.751543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:41:43.751543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:41:43.751543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:41:43.751543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:41:43.751543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:41:43.751543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:43.751543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 627/1235] 10.222.0.72 () {56 vars in 1102 bytes} [Mon Aug 29 22:41:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:43.756449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211044-be72-417b-b866-c8f9fdea7d37 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:43.809162 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:43.863511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211044-be72-417b-b866-c8f9fdea7d37 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:43.901043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc234f-f22c-4f5b-8fe8-577d2739b513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:43.901924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc234f-f22c-4f5b-8fe8-577d2739b513 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:43.902302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc234f-f22c-4f5b-8fe8-577d2739b513 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:43.902726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc234f-f22c-4f5b-8fe8-577d2739b513 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:43.903530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc234f-f22c-4f5b-8fe8-577d2739b513 None admin] RBAC: Adding query filter params (name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:43.903942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc234f-f22c-4f5b-8fe8-577d2739b513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:43.905675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc234f-f22c-4f5b-8fe8-577d2739b513 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:43.915546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 609/1236] 10.222.0.72 () {56 vars in 1103 bytes} [Mon Aug 29 22:41:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:43.921564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437b26e-ab47-4296-87a1-9bc76b857492 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:44.016329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:44.033342 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437b26e-ab47-4296-87a1-9bc76b857492 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:44.073273 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebcb72-71fb-48be-8ee5-4b2c50bcb543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:44.073926 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebcb72-71fb-48be-8ee5-4b2c50bcb543 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:44.074209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebcb72-71fb-48be-8ee5-4b2c50bcb543 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:44.074592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebcb72-71fb-48be-8ee5-4b2c50bcb543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:44.085444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebcb72-71fb-48be-8ee5-4b2c50bcb543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:44.087169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebcb72-71fb-48be-8ee5-4b2c50bcb543 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-c5ebcb72-71fb-48be-8ee5-4b2c50bcb543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:41:44.102701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:44.103834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:41:44.104995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:41:44.104995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:44.104995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:44.104995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 628/1237] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:44.110327 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc234f-f22c-4f5b-8fe8-577d2739b513 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:44.216745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc234f-f22c-4f5b-8fe8-577d2739b513 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:44.226500 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:44.254675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155affd-31d5-40fa-9671-62a95feacbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:44.255289 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155affd-31d5-40fa-9671-62a95feacbb8 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:44.255568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155affd-31d5-40fa-9671-62a95feacbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:44.255841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155affd-31d5-40fa-9671-62a95feacbb8 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:44.256531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155affd-31d5-40fa-9671-62a95feacbb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:44.256831 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155affd-31d5-40fa-9671-62a95feacbb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:44.258199 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155affd-31d5-40fa-9671-62a95feacbb8 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:44.270102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 610/1238] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:44.276177 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebcb72-71fb-48be-8ee5-4b2c50bcb543 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:44.380998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebcb72-71fb-48be-8ee5-4b2c50bcb543 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:44.422363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d979e9-0adf-46d6-be20-fe8a9498b07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:44.423257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d979e9-0adf-46d6-be20-fe8a9498b07c None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:44.423257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d979e9-0adf-46d6-be20-fe8a9498b07c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:44.423549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d979e9-0adf-46d6-be20-fe8a9498b07c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:44.427196 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:44.432681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d979e9-0adf-46d6-be20-fe8a9498b07c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:44.434141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d979e9-0adf-46d6-be20-fe8a9498b07c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-c1d979e9-0adf-46d6-be20-fe8a9498b07c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:41:44.445953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:44.447086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:44.448259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:44.448259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:44.448259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:41:44.448259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:41:44.448259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:41:44.448259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:41:44.448259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:41:44.448259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:41:44.448259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:41:44.448259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:44.448259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 629/1239] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:44.453285 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155affd-31d5-40fa-9671-62a95feacbb8 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:44.561688 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155affd-31d5-40fa-9671-62a95feacbb8 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:44.598593 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dbad3-58c9-4a8f-a4be-64ae5e312abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:44.599203 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dbad3-58c9-4a8f-a4be-64ae5e312abc None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:44.599486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dbad3-58c9-4a8f-a4be-64ae5e312abc None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:44.599862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dbad3-58c9-4a8f-a4be-64ae5e312abc None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:44.600969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dbad3-58c9-4a8f-a4be-64ae5e312abc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:44.601281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dbad3-58c9-4a8f-a4be-64ae5e312abc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:44.602733 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dbad3-58c9-4a8f-a4be-64ae5e312abc None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:44.621248 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 611/1240] 10.222.0.72 () {56 vars in 1143 bytes} [Mon Aug 29 22:41:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:44.627370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d979e9-0adf-46d6-be20-fe8a9498b07c None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:44.732150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d979e9-0adf-46d6-be20-fe8a9498b07c None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:44.767158 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3124a-b986-4954-b934-6de1e108fdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:44.767765 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3124a-b986-4954-b934-6de1e108fdc7 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:44.768086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3124a-b986-4954-b934-6de1e108fdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:44.768415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3124a-b986-4954-b934-6de1e108fdc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:44.833384 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:44.840021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3124a-b986-4954-b934-6de1e108fdc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:44.841638 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3124a-b986-4954-b934-6de1e108fdc7 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:44.959848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 630/1241] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:41:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:44.966167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dbad3-58c9-4a8f-a4be-64ae5e312abc None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:44.998640 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:45.077197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dbad3-58c9-4a8f-a4be-64ae5e312abc None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:45.113344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2216e-e06f-4cd4-96aa-93fa54f9ea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:45.113883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2216e-e06f-4cd4-96aa-93fa54f9ea39 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:45.114192 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2216e-e06f-4cd4-96aa-93fa54f9ea39 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:45.114468 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2216e-e06f-4cd4-96aa-93fa54f9ea39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:45.125387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2216e-e06f-4cd4-96aa-93fa54f9ea39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:45.126815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2216e-e06f-4cd4-96aa-93fa54f9ea39 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-7ff2216e-e06f-4cd4-96aa-93fa54f9ea39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:41:45.142487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:45.143819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:41:45.144871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:41:45.144871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:45.144871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:41:45.144871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 612/1242] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:45.149862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3124a-b986-4954-b934-6de1e108fdc7 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:45.256048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:45.262260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3124a-b986-4954-b934-6de1e108fdc7 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:45.301109 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0617ee-1704-4071-9a46-047eef6547f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:45.301967 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0617ee-1704-4071-9a46-047eef6547f4 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:45.302079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0617ee-1704-4071-9a46-047eef6547f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:45.302260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0617ee-1704-4071-9a46-047eef6547f4 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:45.302925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0617ee-1704-4071-9a46-047eef6547f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:45.303225 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0617ee-1704-4071-9a46-047eef6547f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:45.304822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0617ee-1704-4071-9a46-047eef6547f4 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:45.318679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 631/1243] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:45.327573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2216e-e06f-4cd4-96aa-93fa54f9ea39 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:45.421191 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:45.445350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2216e-e06f-4cd4-96aa-93fa54f9ea39 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:45.484798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d796161-8978-49cd-b848-e3abd6a2eadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:45.485435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d796161-8978-49cd-b848-e3abd6a2eadd None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:45.485712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d796161-8978-49cd-b848-e3abd6a2eadd None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:45.485982 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d796161-8978-49cd-b848-e3abd6a2eadd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:45.493615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d796161-8978-49cd-b848-e3abd6a2eadd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:45.495066 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d796161-8978-49cd-b848-e3abd6a2eadd None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:45.508106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-4d796161-8978-49cd-b848-e3abd6a2eadd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:41:45.508106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:45.508106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:45.508106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:45.508106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:45.508106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:45.508106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:45.508106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:45.508106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:45.508106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:45.508106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:45.508106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:45.508106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:41:45.508106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:41:45.508106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:45.509232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:45.510334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:41:45.510334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:41:45.510334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:41:45.510334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:41:45.510334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:41:45.510334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:41:45.510334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:41:45.510334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:41:45.510334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 613/1244] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:41:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:45.515352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0617ee-1704-4071-9a46-047eef6547f4 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:45.632546 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0617ee-1704-4071-9a46-047eef6547f4 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:45.669225 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8ee61-3dcb-4ed7-a445-f3cb3204baf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:45.669833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8ee61-3dcb-4ed7-a445-f3cb3204baf2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:45.670114 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8ee61-3dcb-4ed7-a445-f3cb3204baf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:45.670388 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8ee61-3dcb-4ed7-a445-f3cb3204baf2 None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:45.671085 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8ee61-3dcb-4ed7-a445-f3cb3204baf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:45.671437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8ee61-3dcb-4ed7-a445-f3cb3204baf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:45.672860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8ee61-3dcb-4ed7-a445-f3cb3204baf2 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:45.686880 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 632/1245] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:41:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:45.693130 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d796161-8978-49cd-b848-e3abd6a2eadd None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:45.801247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d796161-8978-49cd-b848-e3abd6a2eadd None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:45.837492 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d674a74-a92f-41e4-bc37-28e6217abe7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:45.838103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d674a74-a92f-41e4-bc37-28e6217abe7f None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:45.838382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d674a74-a92f-41e4-bc37-28e6217abe7f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:45.838654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d674a74-a92f-41e4-bc37-28e6217abe7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:45.839385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d674a74-a92f-41e4-bc37-28e6217abe7f None admin] RBAC: Adding query filter params (role.id=14efd2033a754e9b9143349f4994e356, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=83c5fb88d96640089eba545f4c8d3c44) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:45.839691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d674a74-a92f-41e4-bc37-28e6217abe7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:45.841264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d674a74-a92f-41e4-bc37-28e6217abe7f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:45.848083 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 614/1246] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:41:45 2022] GET /identity/v3/role_assignments?user.id=83c5fb88d96640089eba545f4c8d3c44&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=14efd2033a754e9b9143349f4994e356 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:47.887097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eafcc-ff60-4e74-ac99-4214f717897b None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:47.887634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eafcc-ff60-4e74-ac99-4214f717897b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:47.887634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eafcc-ff60-4e74-ac99-4214f717897b None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:47.889030 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 633/1247] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:47.895130 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bebe1-9c18-42f9-9cc0-4738e8da506e None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:47.895541 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bebe1-9c18-42f9-9cc0-4738e8da506e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:47.895685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bebe1-9c18-42f9-9cc0-4738e8da506e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:47.902045 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:47.914928 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-666bebe1-9c18-42f9-9cc0-4738e8da506e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:47.916146 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-666bebe1-9c18-42f9-9cc0-4738e8da506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:47.983863 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 615/1248] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:41:48.252943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812eafcc-ff60-4e74-ac99-4214f717897b None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:48.271494 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:48.360711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812eafcc-ff60-4e74-ac99-4214f717897b None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:48.396208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532709f-b55f-499d-b278-61e39d5a564f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:48.396877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532709f-b55f-499d-b278-61e39d5a564f None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:48.397154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532709f-b55f-499d-b278-61e39d5a564f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:48.397428 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532709f-b55f-499d-b278-61e39d5a564f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:48.407799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532709f-b55f-499d-b278-61e39d5a564f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-6532709f-b55f-499d-b278-61e39d5a564f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:41:48.413657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:48.414817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:48.415670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:48.415670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:48.415670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:48.415670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:48.415670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:41:48.415670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:41:48.415670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:41:48.415670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:41:48.415670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:41:48.415670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:41:48.415670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:41:48.415670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:48.415670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 634/1249] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:41:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:48.421435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bebe1-9c18-42f9-9cc0-4738e8da506e None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:48.522093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bebe1-9c18-42f9-9cc0-4738e8da506e None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:48.550216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:48.555385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a928bd5-ec61-4063-a75c-7c3720c19ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:48.555996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a928bd5-ec61-4063-a75c-7c3720c19ce2 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:48.556337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a928bd5-ec61-4063-a75c-7c3720c19ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:48.556612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a928bd5-ec61-4063-a75c-7c3720c19ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:48.557270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a928bd5-ec61-4063-a75c-7c3720c19ce2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:48.557573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a928bd5-ec61-4063-a75c-7c3720c19ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:48.558922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a928bd5-ec61-4063-a75c-7c3720c19ce2 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:48.568121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 616/1250] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:41:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:48.573980 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532709f-b55f-499d-b278-61e39d5a564f None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:48.654282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:48.676056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532709f-b55f-499d-b278-61e39d5a564f None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:48.711997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf29bc4-ebc7-4111-a507-79e446e9f2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:48.712931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf29bc4-ebc7-4111-a507-79e446e9f2dc None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:48.713211 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf29bc4-ebc7-4111-a507-79e446e9f2dc None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:48.713485 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf29bc4-ebc7-4111-a507-79e446e9f2dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:48.725322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf29bc4-ebc7-4111-a507-79e446e9f2dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:48.726878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf29bc4-ebc7-4111-a507-79e446e9f2dc None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-cbf29bc4-ebc7-4111-a507-79e446e9f2dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:41:48.741675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:48.742773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:41:48.743788 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:41:48.743788 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:48.743788 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:48.743788 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 635/1251] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:48.748793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a928bd5-ec61-4063-a75c-7c3720c19ce2 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:48.851305 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a928bd5-ec61-4063-a75c-7c3720c19ce2 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:48.886571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a173e41-3b8a-4850-bad8-5ed2e32159ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:48.887184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a173e41-3b8a-4850-bad8-5ed2e32159ff None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:48.887469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a173e41-3b8a-4850-bad8-5ed2e32159ff None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:48.887746 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a173e41-3b8a-4850-bad8-5ed2e32159ff None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:48.888418 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a173e41-3b8a-4850-bad8-5ed2e32159ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:48.888725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a173e41-3b8a-4850-bad8-5ed2e32159ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:48.890092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a173e41-3b8a-4850-bad8-5ed2e32159ff None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:48.901964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 617/1252] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:48.907893 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf29bc4-ebc7-4111-a507-79e446e9f2dc None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:49.012811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf29bc4-ebc7-4111-a507-79e446e9f2dc None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:49.039334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:49.047256 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91899-0a22-4e1e-bd61-3b4ff209fb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:49.047893 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91899-0a22-4e1e-bd61-3b4ff209fb87 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:49.048175 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91899-0a22-4e1e-bd61-3b4ff209fb87 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:49.048480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91899-0a22-4e1e-bd61-3b4ff209fb87 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:49.056817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91899-0a22-4e1e-bd61-3b4ff209fb87 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:49.058394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91899-0a22-4e1e-bd61-3b4ff209fb87 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-fca91899-0a22-4e1e-bd61-3b4ff209fb87 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:41:49.070368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:49.072079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:49.073968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:49.073968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:49.073968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:41:49.073968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:41:49.073968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:41:49.073968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:41:49.073968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:41:49.073968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:41:49.073968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:41:49.073968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:49.073968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 636/1253] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:49.077765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a173e41-3b8a-4850-bad8-5ed2e32159ff None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:49.137743 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:49.182106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a173e41-3b8a-4850-bad8-5ed2e32159ff None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:49.216362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4361a60-e277-4720-b016-e5f6ddf1c1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:49.216967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4361a60-e277-4720-b016-e5f6ddf1c1ab None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:49.217242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4361a60-e277-4720-b016-e5f6ddf1c1ab None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:49.217513 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4361a60-e277-4720-b016-e5f6ddf1c1ab None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:49.218239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4361a60-e277-4720-b016-e5f6ddf1c1ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:49.218542 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4361a60-e277-4720-b016-e5f6ddf1c1ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:49.219948 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4361a60-e277-4720-b016-e5f6ddf1c1ab None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:49.237973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 618/1254] 10.222.0.72 () {56 vars in 1143 bytes} [Mon Aug 29 22:41:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:49.243814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91899-0a22-4e1e-bd61-3b4ff209fb87 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:49.348588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91899-0a22-4e1e-bd61-3b4ff209fb87 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:49.384007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef5bee-4d54-4292-a87a-7c17680e966d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:49.384645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef5bee-4d54-4292-a87a-7c17680e966d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:49.384930 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef5bee-4d54-4292-a87a-7c17680e966d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:49.385205 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef5bee-4d54-4292-a87a-7c17680e966d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:49.445826 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:49.458366 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef5bee-4d54-4292-a87a-7c17680e966d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:49.459852 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef5bee-4d54-4292-a87a-7c17680e966d None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:49.557510 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 637/1255] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:41:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:49.563726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4361a60-e277-4720-b016-e5f6ddf1c1ab None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:49.668862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4361a60-e277-4720-b016-e5f6ddf1c1ab None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:49.682986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:49.704814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513edc-5a38-4847-86c7-37f452731035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:49.705454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513edc-5a38-4847-86c7-37f452731035 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:49.705875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513edc-5a38-4847-86c7-37f452731035 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:49.705980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513edc-5a38-4847-86c7-37f452731035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:49.716276 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63513edc-5a38-4847-86c7-37f452731035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:49.717710 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63513edc-5a38-4847-86c7-37f452731035 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-63513edc-5a38-4847-86c7-37f452731035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:41:49.732911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:49.734096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:41:49.735006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:41:49.735006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:49.735006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:41:49.735006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 619/1256] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:49.740420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef5bee-4d54-4292-a87a-7c17680e966d None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:49.828588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:49.842196 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef5bee-4d54-4292-a87a-7c17680e966d None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:49.876698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d63254-47a0-417d-9b1b-e617593e328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:49.877310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d63254-47a0-417d-9b1b-e617593e328d None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:49.878206 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d63254-47a0-417d-9b1b-e617593e328d None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:49.881508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d63254-47a0-417d-9b1b-e617593e328d None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:49.881508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d63254-47a0-417d-9b1b-e617593e328d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:49.881508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d63254-47a0-417d-9b1b-e617593e328d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:49.881508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d63254-47a0-417d-9b1b-e617593e328d None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:49.892275 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 638/1257] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:49.898426 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513edc-5a38-4847-86c7-37f452731035 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:50.005485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513edc-5a38-4847-86c7-37f452731035 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:50.044129 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a02ee-bfb2-437f-9d0e-6a852200e7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:50.044793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a02ee-bfb2-437f-9d0e-6a852200e7ea None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:50.045075 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a02ee-bfb2-437f-9d0e-6a852200e7ea None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:50.045354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a02ee-bfb2-437f-9d0e-6a852200e7ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:50.052954 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a02ee-bfb2-437f-9d0e-6a852200e7ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:50.054393 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a02ee-bfb2-437f-9d0e-6a852200e7ea None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:50.065896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-0a1a02ee-bfb2-437f-9d0e-6a852200e7ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:41:50.065896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:50.065896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:50.065896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:50.065896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:50.065896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:50.065896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:50.065896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:50.065896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:50.065896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:50.065896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:50.065896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:50.065896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:41:50.065896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:41:50.065896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:50.066996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:50.067925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:41:50.067925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:41:50.067925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:41:50.067925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:41:50.067925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:41:50.067925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:41:50.067925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:41:50.067925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:41:50.067925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 620/1258] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:41:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:50.073012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d63254-47a0-417d-9b1b-e617593e328d None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:50.177442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d63254-47a0-417d-9b1b-e617593e328d None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:50.210140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525bd9a-1aa6-4cd3-9557-249cb7979357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:50.210736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525bd9a-1aa6-4cd3-9557-249cb7979357 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:50.211013 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525bd9a-1aa6-4cd3-9557-249cb7979357 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:50.211279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525bd9a-1aa6-4cd3-9557-249cb7979357 None admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:50.212243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525bd9a-1aa6-4cd3-9557-249cb7979357 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:50.212547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525bd9a-1aa6-4cd3-9557-249cb7979357 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:50.214050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525bd9a-1aa6-4cd3-9557-249cb7979357 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:50.226472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 639/1259] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:41:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:50.232615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a02ee-bfb2-437f-9d0e-6a852200e7ea None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:50.259280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:50.336729 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a02ee-bfb2-437f-9d0e-6a852200e7ea None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:50.371742 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb40e5f-d106-4b7c-bd4b-4eb46dc632eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:50.372392 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb40e5f-d106-4b7c-bd4b-4eb46dc632eb None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:50.372670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb40e5f-d106-4b7c-bd4b-4eb46dc632eb None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:50.372940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb40e5f-d106-4b7c-bd4b-4eb46dc632eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:50.373657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb40e5f-d106-4b7c-bd4b-4eb46dc632eb None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=83c5fb88d96640089eba545f4c8d3c44) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:50.373955 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb40e5f-d106-4b7c-bd4b-4eb46dc632eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:50.375367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb40e5f-d106-4b7c-bd4b-4eb46dc632eb None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:50.380804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 621/1260] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:41:50 2022] GET /identity/v3/role_assignments?user.id=83c5fb88d96640089eba545f4c8d3c44&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:52.295003 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef5e98-095b-4f80-85b3-81e76718e3cf None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:52.295653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef5e98-095b-4f80-85b3-81e76718e3cf None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:52.295653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef5e98-095b-4f80-85b3-81e76718e3cf None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:52.296927 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 640/1261] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:52.302497 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0cb3b-4cb8-4f3c-bf2f-ac3bff993c86 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:52.305625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0cb3b-4cb8-4f3c-bf2f-ac3bff993c86 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:52.305625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0cb3b-4cb8-4f3c-bf2f-ac3bff993c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:52.322742 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-3aa0cb3b-4cb8-4f3c-bf2f-ac3bff993c86 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:52.323815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-3aa0cb3b-4cb8-4f3c-bf2f-ac3bff993c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:52.394726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 622/1262] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:41:52.663011 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef5e98-095b-4f80-85b3-81e76718e3cf None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:52.674723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:52.770596 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef5e98-095b-4f80-85b3-81e76718e3cf None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:52.805302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb5d62-49d8-4d8a-846f-9dd8f88e83a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:52.805928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb5d62-49d8-4d8a-846f-9dd8f88e83a2 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:52.806210 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb5d62-49d8-4d8a-846f-9dd8f88e83a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:52.806486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb5d62-49d8-4d8a-846f-9dd8f88e83a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:52.817466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb5d62-49d8-4d8a-846f-9dd8f88e83a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-7bdb5d62-49d8-4d8a-846f-9dd8f88e83a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:41:52.822412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:52.823486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:52.824466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:52.824466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:52.824466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:52.824466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:52.824466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:41:52.824466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:41:52.824466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:41:52.824466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:41:52.824466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:41:52.824466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:41:52.824466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:41:52.824466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:52.824466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 641/1263] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:41:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:41:52.830042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0cb3b-4cb8-4f3c-bf2f-ac3bff993c86 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:52.851164 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:52.943743 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0cb3b-4cb8-4f3c-bf2f-ac3bff993c86 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:52.979616 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f660e-6706-4aab-9df8-e12e57f0f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:52.980282 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f660e-6706-4aab-9df8-e12e57f0f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:52.980534 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f660e-6706-4aab-9df8-e12e57f0f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:52.980804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f660e-6706-4aab-9df8-e12e57f0f6a7 None admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:52.981472 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f660e-6706-4aab-9df8-e12e57f0f6a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:52.981772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f660e-6706-4aab-9df8-e12e57f0f6a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:52.983167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f660e-6706-4aab-9df8-e12e57f0f6a7 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:52.992398 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 623/1264] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:41:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:52.998327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb5d62-49d8-4d8a-846f-9dd8f88e83a2 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:53.070534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:53.107057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb5d62-49d8-4d8a-846f-9dd8f88e83a2 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:53.140730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c5534-69d5-46f3-917d-8e1a132777c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:53.141353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c5534-69d5-46f3-917d-8e1a132777c7 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:53.141632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c5534-69d5-46f3-917d-8e1a132777c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:53.141899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c5534-69d5-46f3-917d-8e1a132777c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:53.153528 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c5534-69d5-46f3-917d-8e1a132777c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:53.154998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c5534-69d5-46f3-917d-8e1a132777c7 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-9e3c5534-69d5-46f3-917d-8e1a132777c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:41:53.169620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:53.173080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:41:53.174058 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:41:53.174058 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:53.174058 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:53.174058 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 642/1265] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:53.176915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f660e-6706-4aab-9df8-e12e57f0f6a7 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:53.263453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:53.282721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f660e-6706-4aab-9df8-e12e57f0f6a7 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:53.317033 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c16fb6-61c5-43d2-a7fc-ae29f985e7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:53.317706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c16fb6-61c5-43d2-a7fc-ae29f985e7c7 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:53.317901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c16fb6-61c5-43d2-a7fc-ae29f985e7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:53.318167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c16fb6-61c5-43d2-a7fc-ae29f985e7c7 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:53.318804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c16fb6-61c5-43d2-a7fc-ae29f985e7c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:53.319105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c16fb6-61c5-43d2-a7fc-ae29f985e7c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:53.320495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c16fb6-61c5-43d2-a7fc-ae29f985e7c7 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:53.333112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 624/1266] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:41:53.339213 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c5534-69d5-46f3-917d-8e1a132777c7 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:53.441595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c5534-69d5-46f3-917d-8e1a132777c7 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:53.462639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:53.477189 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49508a8e-3029-4896-8576-db78a4611c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:53.477824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49508a8e-3029-4896-8576-db78a4611c6f None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:53.478107 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49508a8e-3029-4896-8576-db78a4611c6f None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:53.478383 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49508a8e-3029-4896-8576-db78a4611c6f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:53.485825 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49508a8e-3029-4896-8576-db78a4611c6f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:53.487884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49508a8e-3029-4896-8576-db78a4611c6f None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-49508a8e-3029-4896-8576-db78a4611c6f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:41:53.499073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:53.501168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:53.502217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:53.502217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:53.502217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:41:53.502217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:41:53.502217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:41:53.502217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:41:53.502217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:41:53.502217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:41:53.502217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:41:53.502217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:53.502217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 643/1267] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:53.506819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c16fb6-61c5-43d2-a7fc-ae29f985e7c7 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:53.607692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c16fb6-61c5-43d2-a7fc-ae29f985e7c7 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:53.646002 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a0bce-8864-42a4-ba9b-2d8939d0fe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:53.646650 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a0bce-8864-42a4-ba9b-2d8939d0fe80 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:53.646928 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a0bce-8864-42a4-ba9b-2d8939d0fe80 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:53.647200 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a0bce-8864-42a4-ba9b-2d8939d0fe80 None admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:53.647924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a0bce-8864-42a4-ba9b-2d8939d0fe80 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:53.648249 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a0bce-8864-42a4-ba9b-2d8939d0fe80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:53.649672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a0bce-8864-42a4-ba9b-2d8939d0fe80 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:53.658535 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:53.668563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 625/1268] 10.222.0.72 () {56 vars in 1143 bytes} [Mon Aug 29 22:41:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:53.674954 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49508a8e-3029-4896-8576-db78a4611c6f None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:53.779057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49508a8e-3029-4896-8576-db78a4611c6f None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:53.814928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a014a-5c2c-4321-9c48-94566e61be55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:53.815552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a014a-5c2c-4321-9c48-94566e61be55 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:53.815828 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a014a-5c2c-4321-9c48-94566e61be55 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:53.816098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a014a-5c2c-4321-9c48-94566e61be55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:53.826904 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a014a-5c2c-4321-9c48-94566e61be55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:53.828391 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a014a-5c2c-4321-9c48-94566e61be55 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-0e7a014a-5c2c-4321-9c48-94566e61be55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:41:53.842636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:53.843793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:41:53.844733 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:41:53.844733 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:53.844733 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:53.844733 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 644/1269] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:53.850440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a0bce-8864-42a4-ba9b-2d8939d0fe80 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:53.955984 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a0bce-8864-42a4-ba9b-2d8939d0fe80 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:53.997209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985631a-371f-49d7-ae9c-4742cfb63386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:53.997812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985631a-371f-49d7-ae9c-4742cfb63386 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:53.998088 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985631a-371f-49d7-ae9c-4742cfb63386 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:53.998385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985631a-371f-49d7-ae9c-4742cfb63386 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:53.999019 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985631a-371f-49d7-ae9c-4742cfb63386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:53.999318 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985631a-371f-49d7-ae9c-4742cfb63386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:54.000710 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985631a-371f-49d7-ae9c-4742cfb63386 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:54.012743 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 626/1270] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:54.019155 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a014a-5c2c-4321-9c48-94566e61be55 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:54.050358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:54.118958 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a014a-5c2c-4321-9c48-94566e61be55 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:54.154784 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e57a7-87ea-43a3-83d6-845293741ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:54.155411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e57a7-87ea-43a3-83d6-845293741ff6 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:54.155691 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e57a7-87ea-43a3-83d6-845293741ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:54.155961 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e57a7-87ea-43a3-83d6-845293741ff6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:54.163189 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e57a7-87ea-43a3-83d6-845293741ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:54.164720 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e57a7-87ea-43a3-83d6-845293741ff6 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:54.176655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-0f0e57a7-87ea-43a3-83d6-845293741ff6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:41:54.176655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:54.176655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:54.176655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:54.176655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:54.176655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:54.176655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:54.176655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:54.176655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:54.176655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:54.176655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:54.176655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:54.176655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:41:54.176655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:41:54.176655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:54.177815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:54.178840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:41:54.178840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:41:54.178840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:41:54.178840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:41:54.178840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:41:54.178840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:41:54.178840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:41:54.178840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:54.178840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 645/1271] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:41:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:54.184012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985631a-371f-49d7-ae9c-4742cfb63386 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:54.247757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:54.290456 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985631a-371f-49d7-ae9c-4742cfb63386 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:54.323377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45501a7d-90f8-403e-bb40-99d5a96bccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:54.324030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45501a7d-90f8-403e-bb40-99d5a96bccfb None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:54.324269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45501a7d-90f8-403e-bb40-99d5a96bccfb None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:54.324545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45501a7d-90f8-403e-bb40-99d5a96bccfb None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:54.325245 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45501a7d-90f8-403e-bb40-99d5a96bccfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:54.325538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45501a7d-90f8-403e-bb40-99d5a96bccfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:54.327267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45501a7d-90f8-403e-bb40-99d5a96bccfb None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:54.340961 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 627/1272] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:41:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:54.347987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e57a7-87ea-43a3-83d6-845293741ff6 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:54.442684 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:54.451738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e57a7-87ea-43a3-83d6-845293741ff6 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:54.486329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b0566-ea28-4721-be61-383498051760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:54.487055 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b0566-ea28-4721-be61-383498051760 None admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:54.487326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b0566-ea28-4721-be61-383498051760 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:54.487593 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b0566-ea28-4721-be61-383498051760 None admin] PATH_INFO: `/v3/projects/7abc4d6c6e004b15abff7738164175db/users/83c5fb88d96640089eba545f4c8d3c44/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:54.489492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b0566-ea28-4721-be61-383498051760 None admin] RBAC: Authorizing `identity:create_grant(project_id=7abc4d6c6e004b15abff7738164175db, user_id=83c5fb88d96640089eba545f4c8d3c44, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:54.490920 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b0566-ea28-4721-be61-383498051760 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:54.602402 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 646/1273] 10.222.0.72 () {58 vars in 1439 bytes} [Mon Aug 29 22:41:54 2022] PUT /identity/v3/projects/7abc4d6c6e004b15abff7738164175db/users/83c5fb88d96640089eba545f4c8d3c44/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:41:56.528251 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eab1c1-3de6-47ed-bc25-e016730e0cee None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:56.528850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eab1c1-3de6-47ed-bc25-e016730e0cee None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:56.528850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eab1c1-3de6-47ed-bc25-e016730e0cee None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:56.530133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 628/1274] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:56.535448 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c607a-59b8-4224-aac3-e338f7bdb8fe None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:56.535935 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c607a-59b8-4224-aac3-e338f7bdb8fe None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:56.536030 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c607a-59b8-4224-aac3-e338f7bdb8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:56.554751 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-981c607a-59b8-4224-aac3-e338f7bdb8fe None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:56.555941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-981c607a-59b8-4224-aac3-e338f7bdb8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:56.627105 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 647/1275] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:41:56.902551 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eab1c1-3de6-47ed-bc25-e016730e0cee None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:57.012938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eab1c1-3de6-47ed-bc25-e016730e0cee None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:57.031884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:57.050626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205182d-a03c-4ae0-9f2b-7ee793fce30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:57.051252 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205182d-a03c-4ae0-9f2b-7ee793fce30c None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:57.051529 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205182d-a03c-4ae0-9f2b-7ee793fce30c None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:57.051793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205182d-a03c-4ae0-9f2b-7ee793fce30c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:57.062173 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205182d-a03c-4ae0-9f2b-7ee793fce30c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-6205182d-a03c-4ae0-9f2b-7ee793fce30c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:41:57.067144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:57.072222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:57.073126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:57.073126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:57.073126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:57.073126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:57.073126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:41:57.073126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:41:57.073126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:41:57.073126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:41:57.073126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:41:57.073126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:41:57.073126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:41:57.073126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:41:57.073126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 629/1276] 10.222.0.72 () {56 vars in 1096 bytes} [Mon Aug 29 22:41:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:57.075315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c607a-59b8-4224-aac3-e338f7bdb8fe None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:57.163386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:57.181681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c607a-59b8-4224-aac3-e338f7bdb8fe None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:57.216833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec75c9-ca5f-41a0-9b8c-059e5e3b06e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:57.217679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec75c9-ca5f-41a0-9b8c-059e5e3b06e3 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:57.218044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec75c9-ca5f-41a0-9b8c-059e5e3b06e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:57.218323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec75c9-ca5f-41a0-9b8c-059e5e3b06e3 None admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:57.219010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec75c9-ca5f-41a0-9b8c-059e5e3b06e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:57.219317 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec75c9-ca5f-41a0-9b8c-059e5e3b06e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:57.220741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec75c9-ca5f-41a0-9b8c-059e5e3b06e3 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:57.230407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 648/1277] 10.222.0.72 () {56 vars in 1099 bytes} [Mon Aug 29 22:41:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:57.236454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205182d-a03c-4ae0-9f2b-7ee793fce30c None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:57.341934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205182d-a03c-4ae0-9f2b-7ee793fce30c None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:57.376457 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fc916-fbd2-48fe-86e8-7fac40f6a226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:57.377150 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fc916-fbd2-48fe-86e8-7fac40f6a226 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:57.377420 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fc916-fbd2-48fe-86e8-7fac40f6a226 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:57.377847 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fc916-fbd2-48fe-86e8-7fac40f6a226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:57.388220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fc916-fbd2-48fe-86e8-7fac40f6a226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:57.389672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fc916-fbd2-48fe-86e8-7fac40f6a226 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-c38fc916-fbd2-48fe-86e8-7fac40f6a226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:41:57.405424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:57.406652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:41:57.407787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:41:57.407787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:57.407787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:41:57.407787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 630/1278] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:57.413356 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec75c9-ca5f-41a0-9b8c-059e5e3b06e3 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:57.523266 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec75c9-ca5f-41a0-9b8c-059e5e3b06e3 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:57.558462 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d3dce-6742-444f-8b68-57ac5c21c697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:57.559157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d3dce-6742-444f-8b68-57ac5c21c697 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:57.559324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d3dce-6742-444f-8b68-57ac5c21c697 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:57.559593 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d3dce-6742-444f-8b68-57ac5c21c697 None admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:57.560273 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d3dce-6742-444f-8b68-57ac5c21c697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:57.560598 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d3dce-6742-444f-8b68-57ac5c21c697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:57.561972 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d3dce-6742-444f-8b68-57ac5c21c697 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:57.573694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 649/1279] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:57.579427 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fc916-fbd2-48fe-86e8-7fac40f6a226 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:57.613446 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:57.692012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fc916-fbd2-48fe-86e8-7fac40f6a226 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:57.754299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b75cc6-bb89-4333-99f3-ca01229384aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:57.754299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b75cc6-bb89-4333-99f3-ca01229384aa None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:57.754299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b75cc6-bb89-4333-99f3-ca01229384aa None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:57.754299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b75cc6-bb89-4333-99f3-ca01229384aa None admin] PATH_INFO: `/v3/users/placement` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:57.754739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b75cc6-bb89-4333-99f3-ca01229384aa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:57.754739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b75cc6-bb89-4333-99f3-ca01229384aa None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-c0b75cc6-bb89-4333-99f3-ca01229384aa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:41:57.756750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:57.757972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:57.759369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:57.759369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:57.759369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:41:57.759369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:41:57.759369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:41:57.759369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:41:57.759369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:41:57.759369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:41:57.759369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:41:57.759369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:41:57.759369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 631/1280] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:57.765051 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d3dce-6742-444f-8b68-57ac5c21c697 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:57.767839 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:57.868064 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d3dce-6742-444f-8b68-57ac5c21c697 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:57.902675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d1569-33dc-4c10-9176-0a4cb15ebd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:57.903288 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d1569-33dc-4c10-9176-0a4cb15ebd74 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:57.903566 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d1569-33dc-4c10-9176-0a4cb15ebd74 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:57.903838 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d1569-33dc-4c10-9176-0a4cb15ebd74 None admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:57.905031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d1569-33dc-4c10-9176-0a4cb15ebd74 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:57.905031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d1569-33dc-4c10-9176-0a4cb15ebd74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:57.906357 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d1569-33dc-4c10-9176-0a4cb15ebd74 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:57.929304 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 650/1281] 10.222.0.72 () {56 vars in 1143 bytes} [Mon Aug 29 22:41:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:57.935280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b75cc6-bb89-4333-99f3-ca01229384aa None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:58.035714 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:58.046709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b75cc6-bb89-4333-99f3-ca01229384aa None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:58.082047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36889ae7-128a-4648-895c-5b85f8a3c897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:58.082662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36889ae7-128a-4648-895c-5b85f8a3c897 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:58.082937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36889ae7-128a-4648-895c-5b85f8a3c897 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:58.083208 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36889ae7-128a-4648-895c-5b85f8a3c897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:58.163477 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36889ae7-128a-4648-895c-5b85f8a3c897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:58.165766 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36889ae7-128a-4648-895c-5b85f8a3c897 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:58.276455 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:58.292361 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 632/1282] 10.222.0.72 () {58 vars in 1282 bytes} [Mon Aug 29 22:41:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:58.294046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d1569-33dc-4c10-9176-0a4cb15ebd74 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:58.368315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:58.414214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d1569-33dc-4c10-9176-0a4cb15ebd74 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:58.454209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966550c-f0e0-46ae-b21f-aa4d24a00afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:58.454861 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966550c-f0e0-46ae-b21f-aa4d24a00afb None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:58.455148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966550c-f0e0-46ae-b21f-aa4d24a00afb None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:58.455424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966550c-f0e0-46ae-b21f-aa4d24a00afb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:58.468839 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966550c-f0e0-46ae-b21f-aa4d24a00afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:58.470333 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966550c-f0e0-46ae-b21f-aa4d24a00afb None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-1966550c-f0e0-46ae-b21f-aa4d24a00afb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:41:58.486255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:58.487785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:41:58.488885 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:41:58.488885 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:41:58.488885 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:58.488885 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 651/1283] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:58.495151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36889ae7-128a-4648-895c-5b85f8a3c897 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:58.605778 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36889ae7-128a-4648-895c-5b85f8a3c897 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:58.641753 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1e150-bd68-4db3-a845-cef367941046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:58.642363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1e150-bd68-4db3-a845-cef367941046 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:58.642643 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1e150-bd68-4db3-a845-cef367941046 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:58.642912 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1e150-bd68-4db3-a845-cef367941046 None admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:58.644086 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1e150-bd68-4db3-a845-cef367941046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:58.644412 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1e150-bd68-4db3-a845-cef367941046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:58.645769 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1e150-bd68-4db3-a845-cef367941046 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:58.657511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 633/1284] 10.222.0.72 () {56 vars in 1109 bytes} [Mon Aug 29 22:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:58.664001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966550c-f0e0-46ae-b21f-aa4d24a00afb None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:58.766985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966550c-f0e0-46ae-b21f-aa4d24a00afb None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:58.781431 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:58.803438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbc233-b6f4-4683-bf94-bf10d3f2c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:58.804097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbc233-b6f4-4683-bf94-bf10d3f2c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:58.804435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbc233-b6f4-4683-bf94-bf10d3f2c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:58.804709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbc233-b6f4-4683-bf94-bf10d3f2c0a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:58.811773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbc233-b6f4-4683-bf94-bf10d3f2c0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:58.813266 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbc233-b6f4-4683-bf94-bf10d3f2c0a5 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:58.825907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application [None req-54dbc233-b6f4-4683-bf94-bf10d3f2c0a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:41:58.825907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:41:58.825907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:41:58.825907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:41:58.825907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:41:58.825907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:41:58.825907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:41:58.825907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:41:58.825907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:41:58.825907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:41:58.825907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:41:58.825907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:41:58.825907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:41:58.825907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:41:58.825907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application with Lock( Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:41:58.827024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:41:58.827949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:41:58.827949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:41:58.827949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:41:58.827949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:41:58.827949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:41:58.827949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:41:58.827949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:41:58.827949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: ERROR keystone.server.flask.application Aug 29 22:41:58.827949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 652/1285] 10.222.0.72 () {56 vars in 1111 bytes} [Mon Aug 29 22:41:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:41:58.833442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1e150-bd68-4db3-a845-cef367941046 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:58.888680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:58.939484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1e150-bd68-4db3-a845-cef367941046 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:58.976468 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66abd5-05e9-47bb-aa81-bc0fe8de3062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:58.977071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66abd5-05e9-47bb-aa81-bc0fe8de3062 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:58.977353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66abd5-05e9-47bb-aa81-bc0fe8de3062 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:58.977626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66abd5-05e9-47bb-aa81-bc0fe8de3062 None admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:58.978310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66abd5-05e9-47bb-aa81-bc0fe8de3062 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:58.978618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66abd5-05e9-47bb-aa81-bc0fe8de3062 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:58.980032 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66abd5-05e9-47bb-aa81-bc0fe8de3062 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:58.993046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 634/1286] 10.222.0.72 () {56 vars in 1148 bytes} [Mon Aug 29 22:41:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:58.999365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbc233-b6f4-4683-bf94-bf10d3f2c0a5 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:59.113755 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbc233-b6f4-4683-bf94-bf10d3f2c0a5 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:59.150800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f66f5-90d2-4038-9e2f-57ba196847e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:59.151329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f66f5-90d2-4038-9e2f-57ba196847e5 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:59.151605 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f66f5-90d2-4038-9e2f-57ba196847e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:59.151874 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f66f5-90d2-4038-9e2f-57ba196847e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:59.152643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f66f5-90d2-4038-9e2f-57ba196847e5 None admin] RBAC: Adding query filter params (role.id=6cf3bd9974754c428f17420e0643bc17, scope.project.id=7abc4d6c6e004b15abff7738164175db, user.id=83c5fb88d96640089eba545f4c8d3c44) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:59.156592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f66f5-90d2-4038-9e2f-57ba196847e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:59.156592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f66f5-90d2-4038-9e2f-57ba196847e5 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:59.161115 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 653/1287] 10.222.0.72 () {56 vars in 1374 bytes} [Mon Aug 29 22:41:58 2022] GET /identity/v3/role_assignments?user.id=83c5fb88d96640089eba545f4c8d3c44&scope.project.id=7abc4d6c6e004b15abff7738164175db&role.id=6cf3bd9974754c428f17420e0643bc17 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:42:01.108956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bf47d-77da-481e-8cc3-144cfbbfbf12 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:01.109532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bf47d-77da-481e-8cc3-144cfbbfbf12 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:01.109532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bf47d-77da-481e-8cc3-144cfbbfbf12 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:01.110830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 635/1288] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:01.117423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5889f-a16c-4ee0-8c0d-d17583d64e99 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:01.117974 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5889f-a16c-4ee0-8c0d-d17583d64e99 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:01.117974 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5889f-a16c-4ee0-8c0d-d17583d64e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:01.138043 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-39a5889f-a16c-4ee0-8c0d-d17583d64e99 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:01.139746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-39a5889f-a16c-4ee0-8c0d-d17583d64e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:01.169251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:01.209302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 654/1289] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:42:01.482357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bf47d-77da-481e-8cc3-144cfbbfbf12 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:01.586019 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bf47d-77da-481e-8cc3-144cfbbfbf12 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:01.598362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:01.621684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb8d49-b36e-458e-b114-948499cfd310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:01.622320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb8d49-b36e-458e-b114-948499cfd310 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:01.622596 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb8d49-b36e-458e-b114-948499cfd310 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:01.622866 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb8d49-b36e-458e-b114-948499cfd310 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:01.623446 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb8d49-b36e-458e-b114-948499cfd310 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:01.624839 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb8d49-b36e-458e-b114-948499cfd310 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-88fb8d49-b36e-458e-b114-948499cfd310 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:42:01.635133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:42:01.636341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:42:01.637210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:42:01.637210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:42:01.637210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:42:01.637210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:42:01.637210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:42:01.637210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:42:01.637210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:42:01.637210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:42:01.637210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:42:01.637210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:42:01.637210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:42:01.637210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:42:01.637210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:42:01.637210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:42:01.637210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 636/1290] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Aug 29 22:42:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:42:01.640972 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5889f-a16c-4ee0-8c0d-d17583d64e99 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:01.742594 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5889f-a16c-4ee0-8c0d-d17583d64e99 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:01.776882 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b91be-a3a1-489c-83c0-c6105d75cc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:01.777495 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b91be-a3a1-489c-83c0-c6105d75cc9b None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:01.777777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b91be-a3a1-489c-83c0-c6105d75cc9b None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:01.778050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b91be-a3a1-489c-83c0-c6105d75cc9b None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:01.778683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b91be-a3a1-489c-83c0-c6105d75cc9b None admin] RBAC: Adding query filter params (name=placement) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:42:01.778990 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b91be-a3a1-489c-83c0-c6105d75cc9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:01.780392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b91be-a3a1-489c-83c0-c6105d75cc9b None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:01.786010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 655/1291] 10.222.0.72 () {56 vars in 1116 bytes} [Mon Aug 29 22:42:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:42:01.791778 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb8d49-b36e-458e-b114-948499cfd310 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:01.897784 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb8d49-b36e-458e-b114-948499cfd310 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:01.933808 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0accc7-3bd6-4642-ba2d-36609f09efdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:01.934702 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0accc7-3bd6-4642-ba2d-36609f09efdf None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:01.935101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0accc7-3bd6-4642-ba2d-36609f09efdf None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:01.935459 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0accc7-3bd6-4642-ba2d-36609f09efdf None admin] PATH_INFO: `/v3/services` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:01.936218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0accc7-3bd6-4642-ba2d-36609f09efdf None admin] RBAC: Adding query filter params (type=placement) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:42:01.936626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0accc7-3bd6-4642-ba2d-36609f09efdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:01.938133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0accc7-3bd6-4642-ba2d-36609f09efdf None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:01.943693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 637/1292] 10.222.0.72 () {56 vars in 1116 bytes} [Mon Aug 29 22:42:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:42:03.902586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c70ef8-b58a-4f37-9fe0-9a0981160196 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:03.903158 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c70ef8-b58a-4f37-9fe0-9a0981160196 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:03.903284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c70ef8-b58a-4f37-9fe0-9a0981160196 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:03.904678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 656/1293] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:42:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:03.910832 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a7919-a904-4963-9e04-67a43588c11d None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:03.911321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a7919-a904-4963-9e04-67a43588c11d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:03.911427 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a7919-a904-4963-9e04-67a43588c11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:03.930371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-ab0a7919-a904-4963-9e04-67a43588c11d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:03.931593 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-ab0a7919-a904-4963-9e04-67a43588c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:03.963256 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:04.004354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 638/1294] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:42:04.278337 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c70ef8-b58a-4f37-9fe0-9a0981160196 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:04.311227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:04.385631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c70ef8-b58a-4f37-9fe0-9a0981160196 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:04.421961 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec4385-b5e5-42df-9891-3aab1bb8910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:04.422572 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec4385-b5e5-42df-9891-3aab1bb8910c None admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:04.422848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec4385-b5e5-42df-9891-3aab1bb8910c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:04.423116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec4385-b5e5-42df-9891-3aab1bb8910c None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:04.423865 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec4385-b5e5-42df-9891-3aab1bb8910c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:04.425857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec4385-b5e5-42df-9891-3aab1bb8910c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:04.517030 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 657/1295] 10.222.0.72 () {60 vars in 1141 bytes} [Mon Aug 29 22:42:04 2022] POST /identity/v3/services => generated 246 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:42:06.454915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a14cae-cd3f-4ec9-b040-69b3e579a056 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:06.455471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a14cae-cd3f-4ec9-b040-69b3e579a056 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:06.455471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a14cae-cd3f-4ec9-b040-69b3e579a056 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:06.457635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 639/1296] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:06.463246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126be626-f06a-42d6-87bf-403f3495613a None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:06.463770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126be626-f06a-42d6-87bf-403f3495613a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:06.463770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126be626-f06a-42d6-87bf-403f3495613a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:06.482795 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-126be626-f06a-42d6-87bf-403f3495613a None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:06.483972 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-126be626-f06a-42d6-87bf-403f3495613a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:06.556121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 658/1297] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:42:06.826051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a14cae-cd3f-4ec9-b040-69b3e579a056 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:06.930849 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a14cae-cd3f-4ec9-b040-69b3e579a056 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:06.966368 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b576994-7efd-4db0-8a27-030fb228fb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:06.966996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b576994-7efd-4db0-8a27-030fb228fb2b None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:06.967267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b576994-7efd-4db0-8a27-030fb228fb2b None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:06.967533 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b576994-7efd-4db0-8a27-030fb228fb2b None admin] PATH_INFO: `/v3/services/placement` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:06.968109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b576994-7efd-4db0-8a27-030fb228fb2b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:06.969493 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b576994-7efd-4db0-8a27-030fb228fb2b None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-4b576994-7efd-4db0-8a27-030fb228fb2b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:42:06.978394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:42:06.979571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:42:06.980673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:42:06.980673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:42:06.980673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:42:06.980673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:42:06.980673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:42:06.980673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:42:06.980673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:42:06.980673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:42:06.980673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:42:06.980673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:42:06.980673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:42:06.980673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:42:06.980673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:42:06.980673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:42:06.980673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 640/1298] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Aug 29 22:42:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:42:06.985738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126be626-f06a-42d6-87bf-403f3495613a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:07.004893 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:07.088730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126be626-f06a-42d6-87bf-403f3495613a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:07.123100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c72f7-1fff-4473-9892-5e77efb3e872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:07.123715 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c72f7-1fff-4473-9892-5e77efb3e872 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:07.123997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c72f7-1fff-4473-9892-5e77efb3e872 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:07.124303 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c72f7-1fff-4473-9892-5e77efb3e872 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:07.124943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c72f7-1fff-4473-9892-5e77efb3e872 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:42:07.125250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c72f7-1fff-4473-9892-5e77efb3e872 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:07.126680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c72f7-1fff-4473-9892-5e77efb3e872 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:07.132950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 659/1299] 10.222.0.72 () {56 vars in 1116 bytes} [Mon Aug 29 22:42:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:42:07.139227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b576994-7efd-4db0-8a27-030fb228fb2b None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:07.171241 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:07.242496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b576994-7efd-4db0-8a27-030fb228fb2b None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:07.278547 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356391e2-1cef-4d5c-b61b-a18f56af4c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:07.279160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356391e2-1cef-4d5c-b61b-a18f56af4c78 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:07.279439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356391e2-1cef-4d5c-b61b-a18f56af4c78 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:07.279713 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356391e2-1cef-4d5c-b61b-a18f56af4c78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:07.280444 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356391e2-1cef-4d5c-b61b-a18f56af4c78 None admin] RBAC: Adding query filter params (interface=public, service_id=693a9739be284e598aa3ebfaa4c5a8d8, region_id=RegionOne) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:42:07.280841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356391e2-1cef-4d5c-b61b-a18f56af4c78 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:07.286538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356391e2-1cef-4d5c-b61b-a18f56af4c78 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:07.287652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 641/1300] 10.222.0.72 () {56 vars in 1251 bytes} [Mon Aug 29 22:42:07 2022] GET /identity/v3/endpoints?service_id=693a9739be284e598aa3ebfaa4c5a8d8&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:42:07.293527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c72f7-1fff-4473-9892-5e77efb3e872 None admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:07.381819 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:07.400036 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c72f7-1fff-4473-9892-5e77efb3e872 None admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:07.437023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d566a3b-cd53-42a5-884c-74ab6090d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:07.437639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d566a3b-cd53-42a5-884c-74ab6090d89c None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:07.437923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d566a3b-cd53-42a5-884c-74ab6090d89c None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:07.438196 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d566a3b-cd53-42a5-884c-74ab6090d89c None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:07.438805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d566a3b-cd53-42a5-884c-74ab6090d89c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:07.440289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d566a3b-cd53-42a5-884c-74ab6090d89c None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:07.448250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 660/1301] 10.222.0.72 () {56 vars in 1087 bytes} [Mon Aug 29 22:42:07 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:42:09.411584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29df062-278e-4c33-a38a-01ab4994debe None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:09.412173 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29df062-278e-4c33-a38a-01ab4994debe None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:09.412303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29df062-278e-4c33-a38a-01ab4994debe None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:09.413579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 642/1302] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:42:09.419466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba59619-6953-4760-b867-b0d4afbae0e8 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:09.420008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba59619-6953-4760-b867-b0d4afbae0e8 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:09.420098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba59619-6953-4760-b867-b0d4afbae0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:09.439429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-8ba59619-6953-4760-b867-b0d4afbae0e8 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:09.441372 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8ba59619-6953-4760-b867-b0d4afbae0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:09.514877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 661/1303] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:42:09.795640 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29df062-278e-4c33-a38a-01ab4994debe None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:09.899273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:09.906174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29df062-278e-4c33-a38a-01ab4994debe None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:09.943939 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcb021-d2b6-45cd-a9a5-e9adb5106168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:09.944610 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcb021-d2b6-45cd-a9a5-e9adb5106168 None admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:09.944888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcb021-d2b6-45cd-a9a5-e9adb5106168 None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:09.945158 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcb021-d2b6-45cd-a9a5-e9adb5106168 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:09.945736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcb021-d2b6-45cd-a9a5-e9adb5106168 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:09.947199 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcb021-d2b6-45cd-a9a5-e9adb5106168 None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application [None req-aafcb021-d2b6-45cd-a9a5-e9adb5106168 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:42:09.956213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:42:09.958992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:42:09.960505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:42:09.960505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application with Lock( Aug 29 22:42:09.960505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:42:09.960505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:42:09.960505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:42:09.960505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:42:09.960505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:42:09.960505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:42:09.960505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:42:09.960505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:42:09.960505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:42:09.960505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:42:09.960505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:42:09.960505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: ERROR keystone.server.flask.application Aug 29 22:42:09.960505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 643/1304] 10.222.0.72 () {56 vars in 1117 bytes} [Mon Aug 29 22:42:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:42:09.964064 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba59619-6953-4760-b867-b0d4afbae0e8 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:10.046917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:10.073388 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba59619-6953-4760-b867-b0d4afbae0e8 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:10.111076 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7cf7a-e1ca-4dc5-aed9-503bb2b45e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:10.111841 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7cf7a-e1ca-4dc5-aed9-503bb2b45e74 None admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:10.112899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7cf7a-e1ca-4dc5-aed9-503bb2b45e74 None admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:10.113263 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7cf7a-e1ca-4dc5-aed9-503bb2b45e74 None admin] PATH_INFO: `/v3/services` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:10.114201 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7cf7a-e1ca-4dc5-aed9-503bb2b45e74 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:42:10.114613 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7cf7a-e1ca-4dc5-aed9-503bb2b45e74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:10.116266 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7cf7a-e1ca-4dc5-aed9-503bb2b45e74 None admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:10.122168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 662/1305] 10.222.0.72 () {56 vars in 1116 bytes} [Mon Aug 29 22:42:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:42:10.128463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcb021-d2b6-45cd-a9a5-e9adb5106168 None admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:10.244276 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcb021-d2b6-45cd-a9a5-e9adb5106168 None admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:10.283560 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e0a5d-cd29-4eed-991c-28862c64be2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:10.284711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e0a5d-cd29-4eed-991c-28862c64be2f None admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:10.285441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e0a5d-cd29-4eed-991c-28862c64be2f None admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:10.285441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e0a5d-cd29-4eed-991c-28862c64be2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:10.285914 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e0a5d-cd29-4eed-991c-28862c64be2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:10.287344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e0a5d-cd29-4eed-991c-28862c64be2f None admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:10.381237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 644/1306] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:42:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:42:20.118813 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=30 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:20.375467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:09.648260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3957b-d910-4ae0-9347-39dca001b03f None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:09.648805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3957b-d910-4ae0-9347-39dca001b03f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:09.648805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3957b-d910-4ae0-9347-39dca001b03f None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:09.655556 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6b39f-7768-49bd-a200-6ee2f68f4367 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:09.656064 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6b39f-7768-49bd-a200-6ee2f68f4367 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:09.656155 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6b39f-7768-49bd-a200-6ee2f68f4367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:09.660767 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 663/1307] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:49:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:09.764762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-f7c6b39f-7768-49bd-a200-6ee2f68f4367 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:09.765982 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f7c6b39f-7768-49bd-a200-6ee2f68f4367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:09.949511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 645/1308] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:49:10.419251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eab30b-0ae3-494d-9d01-b02ccf5e4135 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:10.419251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eab30b-0ae3-494d-9d01-b02ccf5e4135 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:10.419251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eab30b-0ae3-494d-9d01-b02ccf5e4135 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:10.420173 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 664/1309] 10.222.0.72 () {54 vars in 965 bytes} [Mon Aug 29 22:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:10.434479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269a9b0-681d-47ed-9021-4e6cf887713c None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:10.434765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269a9b0-681d-47ed-9021-4e6cf887713c None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:10.435326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269a9b0-681d-47ed-9021-4e6cf887713c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:10.532160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-e269a9b0-681d-47ed-9021-4e6cf887713c None None] MFA Rules not processed for user `380c6683b4ab4d08a6cf377e620439e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:10.533438 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e269a9b0-681d-47ed-9021-4e6cf887713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:10.574443 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:10.686450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 646/1310] 10.222.0.72 () {58 vars in 1062 bytes} [Mon Aug 29 22:49:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:10.698138 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eab30b-0ae3-494d-9d01-b02ccf5e4135 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:10.700326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-50eab30b-0ae3-494d-9d01-b02ccf5e4135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:10.830391 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eab30b-0ae3-494d-9d01-b02ccf5e4135 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:10.918723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8b464-1c1e-4d52-8d49-54c54014e3bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:10.919353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8b464-1c1e-4d52-8d49-54c54014e3bb service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:10.919634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8b464-1c1e-4d52-8d49-54c54014e3bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:10.919905 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8b464-1c1e-4d52-8d49-54c54014e3bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:10.921685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f4f8b464-1c1e-4d52-8d49-54c54014e3bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:11.000803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:11.078247 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8b464-1c1e-4d52-8d49-54c54014e3bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:11.082179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8b464-1c1e-4d52-8d49-54c54014e3bb service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:11.115440 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 665/1311] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:49:13.480284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ae2fb-a24f-4c3c-aba6-146fe6ead276 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:13.480823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ae2fb-a24f-4c3c-aba6-146fe6ead276 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:13.480951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ae2fb-a24f-4c3c-aba6-146fe6ead276 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:13.482438 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 647/1312] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:13.487937 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd99e30-c723-486d-a2b9-90a3f7e5bed5 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:13.488407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd99e30-c723-486d-a2b9-90a3f7e5bed5 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:13.488577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd99e30-c723-486d-a2b9-90a3f7e5bed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:13.573603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-6cd99e30-c723-486d-a2b9-90a3f7e5bed5 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:13.574820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-6cd99e30-c723-486d-a2b9-90a3f7e5bed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:13.684995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 666/1313] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:13.991775 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef0fe6-95fe-4a9f-ae83-afd85d6c6c1d None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:13.992257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef0fe6-95fe-4a9f-ae83-afd85d6c6c1d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:13.992643 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef0fe6-95fe-4a9f-ae83-afd85d6c6c1d None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:13.994674 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 648/1314] 10.222.0.72 () {54 vars in 965 bytes} [Mon Aug 29 22:49:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:14.002390 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d6b1c-cfde-456b-8659-0e4771bb5135 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:14.002763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d6b1c-cfde-456b-8659-0e4771bb5135 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:14.003132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d6b1c-cfde-456b-8659-0e4771bb5135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:14.018249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:14.109307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-b03d6b1c-cfde-456b-8659-0e4771bb5135 None None] MFA Rules not processed for user `380c6683b4ab4d08a6cf377e620439e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:14.110558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b03d6b1c-cfde-456b-8659-0e4771bb5135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:14.202257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 667/1315] 10.222.0.72 () {58 vars in 1062 bytes} [Mon Aug 29 22:49:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:14.212063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef0fe6-95fe-4a9f-ae83-afd85d6c6c1d None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:14.213995 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-ebef0fe6-95fe-4a9f-ae83-afd85d6c6c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:14.345889 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef0fe6-95fe-4a9f-ae83-afd85d6c6c1d None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:14.439232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:14.442013 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecb83d-6d58-40fc-b88e-3e27f64e38b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:14.442647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb83d-6d58-40fc-b88e-3e27f64e38b7 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:14.442921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb83d-6d58-40fc-b88e-3e27f64e38b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:14.443179 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb83d-6d58-40fc-b88e-3e27f64e38b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:14.444924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-69ecb83d-6d58-40fc-b88e-3e27f64e38b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:14.590350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecb83d-6d58-40fc-b88e-3e27f64e38b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:14.592399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecb83d-6d58-40fc-b88e-3e27f64e38b7 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:14.612978 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 649/1316] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:17.568130 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e34be-093e-49df-b4a3-57ed5e4fe31c None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:17.568703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e34be-093e-49df-b4a3-57ed5e4fe31c None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:17.568703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e34be-093e-49df-b4a3-57ed5e4fe31c None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:17.569952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 668/1317] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:17.575575 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab103e-d33d-4ce6-bdd1-3d61d78687e2 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:17.576100 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab103e-d33d-4ce6-bdd1-3d61d78687e2 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:17.576100 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab103e-d33d-4ce6-bdd1-3d61d78687e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:17.654732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-63ab103e-d33d-4ce6-bdd1-3d61d78687e2 None None] MFA Rules not processed for user `13c53024985741bf9865d5cec76fef6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:17.656000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-63ab103e-d33d-4ce6-bdd1-3d61d78687e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:17.713438 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:17.756997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 650/1318] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:49:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:49:18.054090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e34be-093e-49df-b4a3-57ed5e4fe31c None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:18.055715 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-fa8e34be-093e-49df-b4a3-57ed5e4fe31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:18.220980 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e34be-093e-49df-b4a3-57ed5e4fe31c None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:18.223910 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:18.301214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28144f22-3a12-4614-a341-0777bbd24188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:18.301755 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28144f22-3a12-4614-a341-0777bbd24188 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:18.302035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28144f22-3a12-4614-a341-0777bbd24188 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:18.302344 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28144f22-3a12-4614-a341-0777bbd24188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:18.304316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-28144f22-3a12-4614-a341-0777bbd24188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:18.444721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28144f22-3a12-4614-a341-0777bbd24188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:18.446168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28144f22-3a12-4614-a341-0777bbd24188 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:18.465498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 669/1319] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:21.341612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd441c-59e6-4cc6-bc85-40017918782b None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:21.342131 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd441c-59e6-4cc6-bc85-40017918782b None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:21.342255 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd441c-59e6-4cc6-bc85-40017918782b None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:21.343555 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 651/1320] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:49:21.349497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dae5e9-a591-490e-8ae2-e6b93db9f0c0 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:21.350029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dae5e9-a591-490e-8ae2-e6b93db9f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:21.350029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dae5e9-a591-490e-8ae2-e6b93db9f0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:21.397001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:21.441813 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-64dae5e9-a591-490e-8ae2-e6b93db9f0c0 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:21.443497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-64dae5e9-a591-490e-8ae2-e6b93db9f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:21.560240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 670/1321] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:49:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:21.845676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd441c-59e6-4cc6-bc85-40017918782b None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:21.847223 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8ddd441c-59e6-4cc6-bc85-40017918782b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:21.963258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd441c-59e6-4cc6-bc85-40017918782b None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:22.046934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b417b2-c0dc-4713-acaf-cf6eb145433f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:22.047550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b417b2-c0dc-4713-acaf-cf6eb145433f service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:22.047825 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b417b2-c0dc-4713-acaf-cf6eb145433f service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:22.048095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b417b2-c0dc-4713-acaf-cf6eb145433f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:22.049816 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-17b417b2-c0dc-4713-acaf-cf6eb145433f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:22.058797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:22.173310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b417b2-c0dc-4713-acaf-cf6eb145433f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:22.174680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b417b2-c0dc-4713-acaf-cf6eb145433f service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:22.193777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 652/1322] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:25.407740 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2fbb6-d75d-4fec-898a-101d13e24adf None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:25.408298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2fbb6-d75d-4fec-898a-101d13e24adf None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:25.408594 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2fbb6-d75d-4fec-898a-101d13e24adf None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:25.410032 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 671/1323] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:25.415542 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2aa49-6b6b-4357-800f-6157feec120e None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:25.415975 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2aa49-6b6b-4357-800f-6157feec120e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:25.416099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2aa49-6b6b-4357-800f-6157feec120e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:25.493070 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-63e2aa49-6b6b-4357-800f-6157feec120e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:25.494424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-63e2aa49-6b6b-4357-800f-6157feec120e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:25.559375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:25.601900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 653/1324] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:25.895224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2fbb6-d75d-4fec-898a-101d13e24adf None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:25.897156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e3c2fbb6-d75d-4fec-898a-101d13e24adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:26.031117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2fbb6-d75d-4fec-898a-101d13e24adf None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:26.048424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:26.132613 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f0e14-9c46-4de4-b064-62738c0f4683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:26.133241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f0e14-9c46-4de4-b064-62738c0f4683 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:26.133581 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f0e14-9c46-4de4-b064-62738c0f4683 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:26.134124 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f0e14-9c46-4de4-b064-62738c0f4683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:26.136015 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-7f7f0e14-9c46-4de4-b064-62738c0f4683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:26.270830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f0e14-9c46-4de4-b064-62738c0f4683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:26.272320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f0e14-9c46-4de4-b064-62738c0f4683 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:26.293699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 672/1325] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:28.365953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615ce1e-00ba-48e3-85e6-b851ebf79109 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:28.366491 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615ce1e-00ba-48e3-85e6-b851ebf79109 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:28.366491 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615ce1e-00ba-48e3-85e6-b851ebf79109 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:28.367978 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 654/1326] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:28.373396 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65bfb0-3be1-4b71-9ec9-2d642f7d8e50 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:28.373834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65bfb0-3be1-4b71-9ec9-2d642f7d8e50 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:28.373925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65bfb0-3be1-4b71-9ec9-2d642f7d8e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:28.429960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:28.449383 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-cf65bfb0-3be1-4b71-9ec9-2d642f7d8e50 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:28.450647 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-cf65bfb0-3be1-4b71-9ec9-2d642f7d8e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:28.562990 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 673/1327] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:28.846891 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615ce1e-00ba-48e3-85e6-b851ebf79109 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:28.848468 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e615ce1e-00ba-48e3-85e6-b851ebf79109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:28.965083 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615ce1e-00ba-48e3-85e6-b851ebf79109 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:29.044624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09a795-31ef-498f-b7c0-0e6024f46c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:29.045245 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09a795-31ef-498f-b7c0-0e6024f46c9f service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:29.045534 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09a795-31ef-498f-b7c0-0e6024f46c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:29.045806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09a795-31ef-498f-b7c0-0e6024f46c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:29.047442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-cc09a795-31ef-498f-b7c0-0e6024f46c9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:29.066447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:29.170994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09a795-31ef-498f-b7c0-0e6024f46c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:29.172487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09a795-31ef-498f-b7c0-0e6024f46c9f service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:29.192543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 655/1328] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:31.230969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef8d75-8a2b-4983-9f21-61fa6547ac30 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:31.231502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef8d75-8a2b-4983-9f21-61fa6547ac30 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:31.231502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef8d75-8a2b-4983-9f21-61fa6547ac30 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:31.232906 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 674/1329] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:31.238231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbe33b-3c09-465c-9029-623b2c727460 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:31.238660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbe33b-3c09-465c-9029-623b2c727460 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:31.238935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbe33b-3c09-465c-9029-623b2c727460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:31.311145 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-b9cbe33b-3c09-465c-9029-623b2c727460 None None] MFA Rules not processed for user `13c53024985741bf9865d5cec76fef6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:31.312323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b9cbe33b-3c09-465c-9029-623b2c727460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:31.384161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:31.422142 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 656/1330] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:49:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:31.711084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef8d75-8a2b-4983-9f21-61fa6547ac30 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:31.713233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4cef8d75-8a2b-4983-9f21-61fa6547ac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:31.847288 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef8d75-8a2b-4983-9f21-61fa6547ac30 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:31.871668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:31.933966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f8970-cd65-4e07-a4e6-2e62d20da540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:31.934578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f8970-cd65-4e07-a4e6-2e62d20da540 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:31.934857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f8970-cd65-4e07-a4e6-2e62d20da540 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:31.935126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f8970-cd65-4e07-a4e6-2e62d20da540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:31.936854 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4e0f8970-cd65-4e07-a4e6-2e62d20da540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:32.059214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f8970-cd65-4e07-a4e6-2e62d20da540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:32.060632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f8970-cd65-4e07-a4e6-2e62d20da540 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:32.079806 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 675/1331] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:31 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:49:34.500283 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd3baf-92ba-48e2-821b-e7343f1b581a None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:34.500952 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd3baf-92ba-48e2-821b-e7343f1b581a None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:34.500952 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd3baf-92ba-48e2-821b-e7343f1b581a None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:34.502203 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 657/1332] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:34.507617 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63c963-1aad-455b-94ab-0e549f0a98dc None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:34.510122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63c963-1aad-455b-94ab-0e549f0a98dc None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:34.510122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63c963-1aad-455b-94ab-0e549f0a98dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:34.578219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:34.580961 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-7b63c963-1aad-455b-94ab-0e549f0a98dc None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:34.582444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-7b63c963-1aad-455b-94ab-0e549f0a98dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:34.684565 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 676/1333] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:49:34.974042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd3baf-92ba-48e2-821b-e7343f1b581a None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:34.975583 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-41cd3baf-92ba-48e2-821b-e7343f1b581a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:35.081201 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd3baf-92ba-48e2-821b-e7343f1b581a None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:35.154529 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fb874-e46c-4f5e-89eb-54abe7f7f9d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:35.155130 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fb874-e46c-4f5e-89eb-54abe7f7f9d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:35.155405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fb874-e46c-4f5e-89eb-54abe7f7f9d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:35.155674 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fb874-e46c-4f5e-89eb-54abe7f7f9d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:35.157296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-050fb874-e46c-4f5e-89eb-54abe7f7f9d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:35.183586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:35.270005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fb874-e46c-4f5e-89eb-54abe7f7f9d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:35.271455 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fb874-e46c-4f5e-89eb-54abe7f7f9d5 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:35.292120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 658/1334] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:37.325340 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de41647-5369-4ddd-a7bb-871310997ca0 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:37.325964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de41647-5369-4ddd-a7bb-871310997ca0 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:37.325964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de41647-5369-4ddd-a7bb-871310997ca0 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:37.327448 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 677/1335] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:37.333253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec3ef7-fbd8-44ec-a3b4-7443f1e37d9b None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:37.333747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec3ef7-fbd8-44ec-a3b4-7443f1e37d9b None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:37.333852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec3ef7-fbd8-44ec-a3b4-7443f1e37d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:37.410109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-3bec3ef7-fbd8-44ec-a3b4-7443f1e37d9b None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:37.411329 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-3bec3ef7-fbd8-44ec-a3b4-7443f1e37d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:37.497175 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:37.524626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 659/1336] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:37.812910 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de41647-5369-4ddd-a7bb-871310997ca0 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:37.814488 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-2de41647-5369-4ddd-a7bb-871310997ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:37.927195 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de41647-5369-4ddd-a7bb-871310997ca0 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:37.957491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:38.006126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cc7c2-6cc2-41c7-bf2f-9ec5a5821fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:38.006737 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cc7c2-6cc2-41c7-bf2f-9ec5a5821fdd service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:38.007018 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cc7c2-6cc2-41c7-bf2f-9ec5a5821fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:38.007290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cc7c2-6cc2-41c7-bf2f-9ec5a5821fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:38.009737 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4d2cc7c2-6cc2-41c7-bf2f-9ec5a5821fdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:38.131237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cc7c2-6cc2-41c7-bf2f-9ec5a5821fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:38.132619 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cc7c2-6cc2-41c7-bf2f-9ec5a5821fdd service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:38.151756 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 678/1337] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:40.747714 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05df90-407a-4876-ab63-26cbc9511ec3 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.748315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05df90-407a-4876-ab63-26cbc9511ec3 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.748315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05df90-407a-4876-ab63-26cbc9511ec3 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.749681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 660/1338] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:40.754947 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a1d98-28d0-404f-8a1f-3802f2259bc2 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.755436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a1d98-28d0-404f-8a1f-3802f2259bc2 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.755532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a1d98-28d0-404f-8a1f-3802f2259bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.831138 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-704a1d98-28d0-404f-8a1f-3802f2259bc2 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:40.833099 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-704a1d98-28d0-404f-8a1f-3802f2259bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:40.842661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:40.947385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 679/1339] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:49:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:41.232215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05df90-407a-4876-ab63-26cbc9511ec3 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:41.233783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2c05df90-407a-4876-ab63-26cbc9511ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:41.369004 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05df90-407a-4876-ab63-26cbc9511ec3 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:41.459932 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65ec56-c477-4063-bdc5-052070545e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:41.461464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65ec56-c477-4063-bdc5-052070545e90 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.461942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65ec56-c477-4063-bdc5-052070545e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.462389 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65ec56-c477-4063-bdc5-052070545e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.464104 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4c65ec56-c477-4063-bdc5-052070545e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:41.504813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:41.594839 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65ec56-c477-4063-bdc5-052070545e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:41.597503 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65ec56-c477-4063-bdc5-052070545e90 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:41.632096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 661/1340] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:46.098187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03fc2d-2d89-4006-9d83-d3d19bef3132 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:46.098817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03fc2d-2d89-4006-9d83-d3d19bef3132 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:46.098817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03fc2d-2d89-4006-9d83-d3d19bef3132 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:46.100312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 680/1341] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:46.106913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75df390-a7c7-485c-8522-ea120f8ffd74 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:46.107476 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75df390-a7c7-485c-8522-ea120f8ffd74 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:46.107476 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75df390-a7c7-485c-8522-ea120f8ffd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:46.189979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-a75df390-a7c7-485c-8522-ea120f8ffd74 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:46.191105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-a75df390-a7c7-485c-8522-ea120f8ffd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:46.285115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:46.297548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 662/1342] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:46.588369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03fc2d-2d89-4006-9d83-d3d19bef3132 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:46.589934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-cc03fc2d-2d89-4006-9d83-d3d19bef3132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:46.709402 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03fc2d-2d89-4006-9d83-d3d19bef3132 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:46.750014 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:46.795622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e56cc-9354-4efb-a58c-22cab4f5a20e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:46.796258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e56cc-9354-4efb-a58c-22cab4f5a20e service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:46.796527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e56cc-9354-4efb-a58c-22cab4f5a20e service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:46.796799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e56cc-9354-4efb-a58c-22cab4f5a20e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:46.798430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b68e56cc-9354-4efb-a58c-22cab4f5a20e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:46.952470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e56cc-9354-4efb-a58c-22cab4f5a20e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:46.953838 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e56cc-9354-4efb-a58c-22cab4f5a20e service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:46.974521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 681/1343] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:50.422080 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952744c-416c-4712-8328-05b94e78127d None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:50.422630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952744c-416c-4712-8328-05b94e78127d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:50.422630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952744c-416c-4712-8328-05b94e78127d None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:50.423959 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 663/1344] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:50.429337 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b4fb-542a-42da-be1c-0bce9025b53d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:50.429764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b4fb-542a-42da-be1c-0bce9025b53d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:50.429967 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b4fb-542a-42da-be1c-0bce9025b53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:50.501159 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-07c8b4fb-542a-42da-be1c-0bce9025b53d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:50.502371 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-07c8b4fb-542a-42da-be1c-0bce9025b53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:50.521784 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:50.607758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 682/1345] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:49:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:50.892242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952744c-416c-4712-8328-05b94e78127d None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:50.893813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b952744c-416c-4712-8328-05b94e78127d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:51.021413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952744c-416c-4712-8328-05b94e78127d None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:51.099157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca1bc8-2905-416c-b3a1-b847ccb22945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:51.099678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca1bc8-2905-416c-b3a1-b847ccb22945 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:51.099956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca1bc8-2905-416c-b3a1-b847ccb22945 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:51.100252 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca1bc8-2905-416c-b3a1-b847ccb22945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:51.101853 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e3ca1bc8-2905-416c-b3a1-b847ccb22945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:51.154471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:51.230232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca1bc8-2905-416c-b3a1-b847ccb22945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:51.231829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca1bc8-2905-416c-b3a1-b847ccb22945 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:51.252295 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 664/1346] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:55.838774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a8fc9-7487-4885-9d68-bb66965ae3ea None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:55.839308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a8fc9-7487-4885-9d68-bb66965ae3ea None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:55.839308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a8fc9-7487-4885-9d68-bb66965ae3ea None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:55.840717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 683/1347] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:55.846421 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788f002-9a0d-4d76-b8eb-ac71a60c5833 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:55.846973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788f002-9a0d-4d76-b8eb-ac71a60c5833 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:55.846973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788f002-9a0d-4d76-b8eb-ac71a60c5833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:55.923906 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-a788f002-9a0d-4d76-b8eb-ac71a60c5833 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:55.925248 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-a788f002-9a0d-4d76-b8eb-ac71a60c5833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:56.031996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:56.034845 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 665/1348] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:56.328313 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a8fc9-7487-4885-9d68-bb66965ae3ea None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:56.329858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ea3a8fc9-7487-4885-9d68-bb66965ae3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:56.451360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a8fc9-7487-4885-9d68-bb66965ae3ea None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:56.508805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:56.535085 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a74964-9b8a-44dd-8e8a-11b0c89713a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:56.535689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a74964-9b8a-44dd-8e8a-11b0c89713a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:56.535968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a74964-9b8a-44dd-8e8a-11b0c89713a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:56.536270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a74964-9b8a-44dd-8e8a-11b0c89713a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:56.537876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-74a74964-9b8a-44dd-8e8a-11b0c89713a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:56.663785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a74964-9b8a-44dd-8e8a-11b0c89713a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:56.665151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a74964-9b8a-44dd-8e8a-11b0c89713a6 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:56.685513 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 684/1349] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:01.787888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f84b1-d054-4a0d-b2ef-ff863e10142a None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:01.788829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f84b1-d054-4a0d-b2ef-ff863e10142a None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:01.788829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f84b1-d054-4a0d-b2ef-ff863e10142a None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:01.791001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 666/1350] 10.222.0.72 () {54 vars in 921 bytes} [Mon Aug 29 22:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:01.797341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f79fc-3939-4f20-a749-caa69773dfa3 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:01.798214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f79fc-3939-4f20-a749-caa69773dfa3 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:01.798660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f79fc-3939-4f20-a749-caa69773dfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:01.918695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-191f79fc-3939-4f20-a749-caa69773dfa3 None None] MFA Rules not processed for user `83c5fb88d96640089eba545f4c8d3c44`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:01.928298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-191f79fc-3939-4f20-a749-caa69773dfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:01.964933 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:02.135011 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 685/1351] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Aug 29 22:50:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:06.982443 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201f34c-1ece-48b1-9084-5267e942d85f None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:06.984258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201f34c-1ece-48b1-9084-5267e942d85f None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:06.984904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201f34c-1ece-48b1-9084-5267e942d85f None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:06.987587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 667/1352] 10.222.0.72 () {54 vars in 921 bytes} [Mon Aug 29 22:50:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:50:06.995331 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015b8da-c829-4cfd-86ee-a06db249816d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:06.995881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015b8da-c829-4cfd-86ee-a06db249816d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:06.995881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015b8da-c829-4cfd-86ee-a06db249816d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:07.087106 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-9015b8da-c829-4cfd-86ee-a06db249816d None None] MFA Rules not processed for user `83c5fb88d96640089eba545f4c8d3c44`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:07.088289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-9015b8da-c829-4cfd-86ee-a06db249816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:07.186087 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:07.233682 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 686/1353] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Aug 29 22:50:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:09.004322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3530952-882a-4cb3-8b3f-d1cd6f506ac8 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:09.004872 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3530952-882a-4cb3-8b3f-d1cd6f506ac8 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:09.004872 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3530952-882a-4cb3-8b3f-d1cd6f506ac8 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:09.007178 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 668/1354] 10.222.0.72 () {54 vars in 921 bytes} [Mon Aug 29 22:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:09.013392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9edc6e-494e-4c56-b241-b0af052940ee None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:09.013935 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9edc6e-494e-4c56-b241-b0af052940ee None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:09.014063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9edc6e-494e-4c56-b241-b0af052940ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:09.102206 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-cf9edc6e-494e-4c56-b241-b0af052940ee None None] MFA Rules not processed for user `83c5fb88d96640089eba545f4c8d3c44`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:09.103622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-cf9edc6e-494e-4c56-b241-b0af052940ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:09.231006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 687/1355] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Aug 29 22:50:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:12.786391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24092da0-f702-474a-af39-709d2d993d5b None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:12.786947 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24092da0-f702-474a-af39-709d2d993d5b None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:12.786947 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24092da0-f702-474a-af39-709d2d993d5b None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:12.789081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 669/1356] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:12.794939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b99919-7d15-4904-8158-dba601b129dd None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:12.795762 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b99919-7d15-4904-8158-dba601b129dd None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:12.796040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b99919-7d15-4904-8158-dba601b129dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:12.841718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:12.875894 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-68b99919-7d15-4904-8158-dba601b129dd None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:12.877771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-68b99919-7d15-4904-8158-dba601b129dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:13.032890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 688/1357] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:13.386992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e554030-bd47-455b-ac13-4dbbb803f0f0 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:13.387387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e554030-bd47-455b-ac13-4dbbb803f0f0 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:13.391238 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e554030-bd47-455b-ac13-4dbbb803f0f0 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:13.392954 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 670/1358] 10.222.0.72 () {54 vars in 962 bytes} [Mon Aug 29 22:50:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:13.401258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec768a3-97f5-4462-be57-d57d9b7e33d4 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:13.401636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec768a3-97f5-4462-be57-d57d9b7e33d4 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:13.405478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec768a3-97f5-4462-be57-d57d9b7e33d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:13.517609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-2ec768a3-97f5-4462-be57-d57d9b7e33d4 None None] MFA Rules not processed for user `0be09bd9ba7443aaa31879f56ca4aad1`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:13.518957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-2ec768a3-97f5-4462-be57-d57d9b7e33d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:13.589139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:13.692250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 689/1359] 10.222.0.72 () {58 vars in 1059 bytes} [Mon Aug 29 22:50:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:13.704842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e554030-bd47-455b-ac13-4dbbb803f0f0 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:13.707031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5e554030-bd47-455b-ac13-4dbbb803f0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:13.878907 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e554030-bd47-455b-ac13-4dbbb803f0f0 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:13.967869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:14.013603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ae40a-41f6-45ab-957e-535fb6b53a18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:14.014223 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ae40a-41f6-45ab-957e-535fb6b53a18 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:14.014503 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ae40a-41f6-45ab-957e-535fb6b53a18 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:14.014780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ae40a-41f6-45ab-957e-535fb6b53a18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:14.016444 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2d8ae40a-41f6-45ab-957e-535fb6b53a18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:14.119362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ae40a-41f6-45ab-957e-535fb6b53a18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:14.121020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ae40a-41f6-45ab-957e-535fb6b53a18 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:14.140846 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 671/1360] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:17.015741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455572e-c7a7-4568-a9ed-fe12ae12b50b None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:17.015741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455572e-c7a7-4568-a9ed-fe12ae12b50b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:17.018708 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455572e-c7a7-4568-a9ed-fe12ae12b50b None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:17.024875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962bb95-caf5-41f3-a0ff-9c7d9cbec8b1 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:17.024875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962bb95-caf5-41f3-a0ff-9c7d9cbec8b1 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:17.024875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962bb95-caf5-41f3-a0ff-9c7d9cbec8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:17.029065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 690/1361] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:50:17 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:50:17.110835 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-e962bb95-caf5-41f3-a0ff-9c7d9cbec8b1 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:17.112136 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e962bb95-caf5-41f3-a0ff-9c7d9cbec8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:17.161538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:17.256299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 672/1362] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:17.557469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455572e-c7a7-4568-a9ed-fe12ae12b50b None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:17.559008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-5455572e-c7a7-4568-a9ed-fe12ae12b50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:17.738414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455572e-c7a7-4568-a9ed-fe12ae12b50b None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:17.755015 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:17.927241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240547e9-1bf1-4ce6-8c08-df9529782adc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:17.928994 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240547e9-1bf1-4ce6-8c08-df9529782adc service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:17.929293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240547e9-1bf1-4ce6-8c08-df9529782adc service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:17.929588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240547e9-1bf1-4ce6-8c08-df9529782adc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:17.932255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-240547e9-1bf1-4ce6-8c08-df9529782adc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:18.088836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240547e9-1bf1-4ce6-8c08-df9529782adc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:18.088836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240547e9-1bf1-4ce6-8c08-df9529782adc service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:18.112455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 691/1363] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:20.612247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa117d48-92ea-4182-a40b-e0926823a7a5 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:20.612850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa117d48-92ea-4182-a40b-e0926823a7a5 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:20.612850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa117d48-92ea-4182-a40b-e0926823a7a5 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:20.614180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 673/1364] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:20.620503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f09045-63f9-45c2-b0d1-75c63697ea55 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:20.621016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f09045-63f9-45c2-b0d1-75c63697ea55 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:20.621016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f09045-63f9-45c2-b0d1-75c63697ea55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:20.638805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:20.699423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-a1f09045-63f9-45c2-b0d1-75c63697ea55 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:20.700555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a1f09045-63f9-45c2-b0d1-75c63697ea55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:20.818738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 692/1365] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:21.117194 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234fa36-7aad-45f8-aa2a-a47b0dd9f785 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:21.117534 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234fa36-7aad-45f8-aa2a-a47b0dd9f785 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:21.117746 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234fa36-7aad-45f8-aa2a-a47b0dd9f785 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:21.119236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 674/1366] 10.222.0.72 () {54 vars in 962 bytes} [Mon Aug 29 22:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:21.127477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03daa9b9-93c7-4096-9d68-44102150ce7a None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:21.127836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03daa9b9-93c7-4096-9d68-44102150ce7a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:21.128220 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03daa9b9-93c7-4096-9d68-44102150ce7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:21.219349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-03daa9b9-93c7-4096-9d68-44102150ce7a None None] MFA Rules not processed for user `0be09bd9ba7443aaa31879f56ca4aad1`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:21.220609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-03daa9b9-93c7-4096-9d68-44102150ce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:21.262480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:21.361689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 693/1367] 10.222.0.72 () {58 vars in 1059 bytes} [Mon Aug 29 22:50:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:21.370511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234fa36-7aad-45f8-aa2a-a47b0dd9f785 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:21.372220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5234fa36-7aad-45f8-aa2a-a47b0dd9f785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:21.566120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234fa36-7aad-45f8-aa2a-a47b0dd9f785 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:21.590694 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:21.714356 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0ce07-35ec-466e-9bb6-54aee57380c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:21.715902 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0ce07-35ec-466e-9bb6-54aee57380c8 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:21.716457 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0ce07-35ec-466e-9bb6-54aee57380c8 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:21.716946 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0ce07-35ec-466e-9bb6-54aee57380c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:21.718828 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c6c0ce07-35ec-466e-9bb6-54aee57380c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:21.842211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0ce07-35ec-466e-9bb6-54aee57380c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:21.844532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0ce07-35ec-466e-9bb6-54aee57380c8 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:21.880626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 675/1368] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:22.049076 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dee3b-e5e0-4941-9652-d889f4acc1e8 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.049601 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dee3b-e5e0-4941-9652-d889f4acc1e8 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.049601 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dee3b-e5e0-4941-9652-d889f4acc1e8 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.051145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 694/1369] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:22.056838 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc072bd-752e-4aea-b759-aff6523a9081 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.057115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc072bd-752e-4aea-b759-aff6523a9081 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.060828 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc072bd-752e-4aea-b759-aff6523a9081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.097195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:22.144884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-1fc072bd-752e-4aea-b759-aff6523a9081 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:22.148548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1fc072bd-752e-4aea-b759-aff6523a9081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:22.278873 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 676/1370] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:22.869628 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2904088-4d1e-4d62-ba3e-26a2f4e920e8 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.870424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2904088-4d1e-4d62-ba3e-26a2f4e920e8 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.870927 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2904088-4d1e-4d62-ba3e-26a2f4e920e8 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.873658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 695/1371] 10.222.0.72 () {54 vars in 964 bytes} [Mon Aug 29 22:50:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:22.883763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd7578-3aa2-4b07-a70c-06dc6980244b None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.883763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd7578-3aa2-4b07-a70c-06dc6980244b None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.883763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd7578-3aa2-4b07-a70c-06dc6980244b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.978581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-06cd7578-3aa2-4b07-a70c-06dc6980244b None None] MFA Rules not processed for user `e187bd54667a46c4a234d4aff23e1777`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:22.979900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-06cd7578-3aa2-4b07-a70c-06dc6980244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:23.034906 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:23.070823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 677/1372] 10.222.0.72 () {58 vars in 1061 bytes} [Mon Aug 29 22:50:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:23.079824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2904088-4d1e-4d62-ba3e-26a2f4e920e8 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:23.081670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c2904088-4d1e-4d62-ba3e-26a2f4e920e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:23.205947 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2904088-4d1e-4d62-ba3e-26a2f4e920e8 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:23.251671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:23.290672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c71a8-1527-42eb-b4b3-a0674d16c979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:23.291293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c71a8-1527-42eb-b4b3-a0674d16c979 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.291579 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c71a8-1527-42eb-b4b3-a0674d16c979 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.291857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c71a8-1527-42eb-b4b3-a0674d16c979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.293554 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8a5c71a8-1527-42eb-b4b3-a0674d16c979 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:23.425803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c71a8-1527-42eb-b4b3-a0674d16c979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:23.427539 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c71a8-1527-42eb-b4b3-a0674d16c979 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:23.447279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 696/1373] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:24.117985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c246813-0975-4714-a736-6928b30585be None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.118508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c246813-0975-4714-a736-6928b30585be None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.118508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c246813-0975-4714-a736-6928b30585be None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.120005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 678/1374] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:24.125426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288be76-a6d9-49ee-b448-1ae462e82345 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.125863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288be76-a6d9-49ee-b448-1ae462e82345 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.125955 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288be76-a6d9-49ee-b448-1ae462e82345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.195467 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-9288be76-a6d9-49ee-b448-1ae462e82345 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:24.196760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-9288be76-a6d9-49ee-b448-1ae462e82345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:24.217769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:24.312026 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 697/1375] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:24.616952 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c246813-0975-4714-a736-6928b30585be None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:24.618647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1c246813-0975-4714-a736-6928b30585be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:24.793862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c246813-0975-4714-a736-6928b30585be None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:24.858488 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:24.931108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3957309-22ec-4b75-bb1b-9ea9053e013d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:24.931741 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957309-22ec-4b75-bb1b-9ea9053e013d service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.932028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957309-22ec-4b75-bb1b-9ea9053e013d service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.932358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957309-22ec-4b75-bb1b-9ea9053e013d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.934048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d3957309-22ec-4b75-bb1b-9ea9053e013d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:25.032777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3957309-22ec-4b75-bb1b-9ea9053e013d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:25.034288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3957309-22ec-4b75-bb1b-9ea9053e013d service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:25.054792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 679/1376] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:27.238524 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64423c0d-6af6-43b4-a96b-8bf50afced65 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:27.239262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64423c0d-6af6-43b4-a96b-8bf50afced65 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:27.240156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64423c0d-6af6-43b4-a96b-8bf50afced65 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:27.243704 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 698/1377] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:27.250418 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c32827-d28d-4a8a-b23f-5e75099f17a4 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:27.250933 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c32827-d28d-4a8a-b23f-5e75099f17a4 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:27.251202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c32827-d28d-4a8a-b23f-5e75099f17a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:27.363727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-e0c32827-d28d-4a8a-b23f-5e75099f17a4 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:27.365206 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e0c32827-d28d-4a8a-b23f-5e75099f17a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:27.376691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:27.514157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 680/1378] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:27.819041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64423c0d-6af6-43b4-a96b-8bf50afced65 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:27.820853 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-64423c0d-6af6-43b4-a96b-8bf50afced65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:27.983201 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64423c0d-6af6-43b4-a96b-8bf50afced65 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:27.987190 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:28.111415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf4191-4d63-4d6e-8d8d-0b21d1d43a3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:28.111942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf4191-4d63-4d6e-8d8d-0b21d1d43a3d service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:28.112244 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf4191-4d63-4d6e-8d8d-0b21d1d43a3d service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:28.112524 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf4191-4d63-4d6e-8d8d-0b21d1d43a3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:28.114132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-1fcf4191-4d63-4d6e-8d8d-0b21d1d43a3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:28.222143 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf4191-4d63-4d6e-8d8d-0b21d1d43a3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:28.224382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf4191-4d63-4d6e-8d8d-0b21d1d43a3d service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:28.245600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 699/1379] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:30.620116 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161c9b5-3489-44bd-84c7-1d2d897788bc None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:30.620762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161c9b5-3489-44bd-84c7-1d2d897788bc None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:30.620762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161c9b5-3489-44bd-84c7-1d2d897788bc None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:30.622305 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 681/1380] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:30.627530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a632bf-189e-4dee-bb61-701d426d1d6f None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:30.627982 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a632bf-189e-4dee-bb61-701d426d1d6f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:30.628065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a632bf-189e-4dee-bb61-701d426d1d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:30.640179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:30.716084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-c1a632bf-189e-4dee-bb61-701d426d1d6f None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:30.717439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c1a632bf-189e-4dee-bb61-701d426d1d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:30.854100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 700/1381] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:31.149004 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161c9b5-3489-44bd-84c7-1d2d897788bc None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:31.151014 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b161c9b5-3489-44bd-84c7-1d2d897788bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:31.310025 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:31.322169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161c9b5-3489-44bd-84c7-1d2d897788bc None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:31.467591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bf41d-cfc4-4501-9668-d17704e5ad55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:31.468305 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bf41d-cfc4-4501-9668-d17704e5ad55 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:31.468648 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bf41d-cfc4-4501-9668-d17704e5ad55 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:31.469101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bf41d-cfc4-4501-9668-d17704e5ad55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:31.470778 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-869bf41d-cfc4-4501-9668-d17704e5ad55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:31.598022 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bf41d-cfc4-4501-9668-d17704e5ad55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:31.600057 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bf41d-cfc4-4501-9668-d17704e5ad55 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:31.615652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:31.628016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 682/1382] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:33.849031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9a546-14f9-44fb-b2d7-3066c53adaea None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:33.849601 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9a546-14f9-44fb-b2d7-3066c53adaea None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:33.849601 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9a546-14f9-44fb-b2d7-3066c53adaea None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:33.850963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 701/1383] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:33.857070 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaac6da-f390-40c1-9d0d-1c1fff92c422 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:33.857732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaac6da-f390-40c1-9d0d-1c1fff92c422 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:33.857732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaac6da-f390-40c1-9d0d-1c1fff92c422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:33.938326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-2aaac6da-f390-40c1-9d0d-1c1fff92c422 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:33.939480 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2aaac6da-f390-40c1-9d0d-1c1fff92c422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:34.065588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 683/1384] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:34.382641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9a546-14f9-44fb-b2d7-3066c53adaea None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:34.384390 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a1d9a546-14f9-44fb-b2d7-3066c53adaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:34.503487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:34.598305 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9a546-14f9-44fb-b2d7-3066c53adaea None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:34.737208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9ebdb-2d15-46c6-b5f7-0c032b4120d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:34.737917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9ebdb-2d15-46c6-b5f7-0c032b4120d8 service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:34.738202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9ebdb-2d15-46c6-b5f7-0c032b4120d8 service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:34.738465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9ebdb-2d15-46c6-b5f7-0c032b4120d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:34.740777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-22b9ebdb-2d15-46c6-b5f7-0c032b4120d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:34.795362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:34.836182 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9ebdb-2d15-46c6-b5f7-0c032b4120d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:34.837802 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9ebdb-2d15-46c6-b5f7-0c032b4120d8 service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:34.856439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 702/1385] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:36.841165 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b0a01-d6dc-4a48-9a97-622047622ff5 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:36.841876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b0a01-d6dc-4a48-9a97-622047622ff5 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:36.841876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b0a01-d6dc-4a48-9a97-622047622ff5 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:36.843231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 684/1386] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:50:36.849787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebab71-ca5d-41a1-80be-86e0bb52a0ab None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:36.850377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebab71-ca5d-41a1-80be-86e0bb52a0ab None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:36.850377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebab71-ca5d-41a1-80be-86e0bb52a0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:36.952464 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-51ebab71-ca5d-41a1-80be-86e0bb52a0ab None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:36.954715 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-51ebab71-ca5d-41a1-80be-86e0bb52a0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:37.087433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 703/1387] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:37.383188 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b0a01-d6dc-4a48-9a97-622047622ff5 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:37.384778 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b99b0a01-d6dc-4a48-9a97-622047622ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:37.475225 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:37.553976 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b0a01-d6dc-4a48-9a97-622047622ff5 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:37.686119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c50afb-05bd-416d-8629-6851703399dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:37.686645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c50afb-05bd-416d-8629-6851703399dd service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:37.686923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c50afb-05bd-416d-8629-6851703399dd service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:37.687196 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c50afb-05bd-416d-8629-6851703399dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:37.688915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-97c50afb-05bd-416d-8629-6851703399dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:37.732897 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:37.792489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c50afb-05bd-416d-8629-6851703399dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:37.794126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c50afb-05bd-416d-8629-6851703399dd service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:37.815344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 685/1388] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:39.361338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5accf28-d80a-4318-83bd-44aaed3d9dfe None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.361926 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5accf28-d80a-4318-83bd-44aaed3d9dfe None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.361926 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5accf28-d80a-4318-83bd-44aaed3d9dfe None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:39.363349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 704/1389] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:39.369719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e9c26-abb3-4c57-924d-684eb0430a82 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.370253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e9c26-abb3-4c57-924d-684eb0430a82 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.370431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e9c26-abb3-4c57-924d-684eb0430a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:39.451206 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-594e9c26-abb3-4c57-924d-684eb0430a82 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:39.452738 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-594e9c26-abb3-4c57-924d-684eb0430a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:39.587568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 686/1390] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:39.909121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec65714-bfa9-4a99-b55c-3c51ecc51993 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.909409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec65714-bfa9-4a99-b55c-3c51ecc51993 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.909686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec65714-bfa9-4a99-b55c-3c51ecc51993 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:39.911790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 705/1391] 10.222.0.72 () {54 vars in 967 bytes} [Mon Aug 29 22:50:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:39.917150 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c868d05-2249-422c-8b76-de10ecd4025c None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.917491 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c868d05-2249-422c-8b76-de10ecd4025c None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.917772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c868d05-2249-422c-8b76-de10ecd4025c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:39.934660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:39.960999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8952b-ca07-42b8-84b2-9be62016ff21 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.961289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8952b-ca07-42b8-84b2-9be62016ff21 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.961572 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8952b-ca07-42b8-84b2-9be62016ff21 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:39.963001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 706/1392] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:39.968388 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e99ddf-2e1b-47a9-bfe2-0f2a7b86da03 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.968771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e99ddf-2e1b-47a9-bfe2-0f2a7b86da03 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.969127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e99ddf-2e1b-47a9-bfe2-0f2a7b86da03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:40.012815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-7c868d05-2249-422c-8b76-de10ecd4025c None None] MFA Rules not processed for user `c7e72cc048a0418cac062d68b8df402f`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:40.014643 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7c868d05-2249-422c-8b76-de10ecd4025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:40.015105 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:40.056551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-80e99ddf-2e1b-47a9-bfe2-0f2a7b86da03 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:40.057806 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-80e99ddf-2e1b-47a9-bfe2-0f2a7b86da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:40.111965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 687/1393] 10.222.0.72 () {58 vars in 1064 bytes} [Mon Aug 29 22:50:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:40.121962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c868d05-2249-422c-8b76-de10ecd4025c None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:40.130600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c868d05-2249-422c-8b76-de10ecd4025c None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:40.169916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 707/1394] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:40.216135 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd7554-edab-4460-b581-99de35560a0a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e72cc048a0418cac062d68b8df402f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:40.216879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd7554-edab-4460-b581-99de35560a0a service glance] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:40.217161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd7554-edab-4460-b581-99de35560a0a service glance] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:40.217433 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd7554-edab-4460-b581-99de35560a0a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:40.219168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4ccd7554-edab-4460-b581-99de35560a0a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:40.252944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:40.342454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd7554-edab-4460-b581-99de35560a0a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:40.343899 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd7554-edab-4460-b581-99de35560a0a service glance] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:40.365579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 688/1395] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:50:40.463426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e99ddf-2e1b-47a9-bfe2-0f2a7b86da03 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:40.464844 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-80e99ddf-2e1b-47a9-bfe2-0f2a7b86da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:40.586651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:40.596353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e99ddf-2e1b-47a9-bfe2-0f2a7b86da03 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:40.749989 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95165b-090f-46dd-9a9f-ba2a96f34716 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:40.750684 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95165b-090f-46dd-9a9f-ba2a96f34716 service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:40.750964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95165b-090f-46dd-9a9f-ba2a96f34716 service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:40.751245 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95165b-090f-46dd-9a9f-ba2a96f34716 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:40.752882 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-5a95165b-090f-46dd-9a9f-ba2a96f34716 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:40.856095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95165b-090f-46dd-9a9f-ba2a96f34716 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:40.857767 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95165b-090f-46dd-9a9f-ba2a96f34716 service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:40.879927 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:40.883359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 708/1396] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:41.311090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f0505-407f-4b7d-b81e-aad5eede5bbe None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:41.311628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f0505-407f-4b7d-b81e-aad5eede5bbe None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:41.311721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f0505-407f-4b7d-b81e-aad5eede5bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:41.388735 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-f99f0505-407f-4b7d-b81e-aad5eede5bbe None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:41.389958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f99f0505-407f-4b7d-b81e-aad5eede5bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:41.499910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:41.506976 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 689/1397] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Aug 29 22:50:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:41.562808 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e43ea-6fd2-4f72-bc8a-6b8bdbe5ece1 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:41.563341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e43ea-6fd2-4f72-bc8a-6b8bdbe5ece1 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:41.567279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e43ea-6fd2-4f72-bc8a-6b8bdbe5ece1 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:41.567279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 709/1398] 10.222.0.72 () {54 vars in 943 bytes} [Mon Aug 29 22:50:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:41.574189 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1d9b8-8ef5-445c-ab07-a0dc5dd63640 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:41.574481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1d9b8-8ef5-445c-ab07-a0dc5dd63640 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:41.574769 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1d9b8-8ef5-445c-ab07-a0dc5dd63640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:41.655393 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-93f1d9b8-8ef5-445c-ab07-a0dc5dd63640 None None] MFA Rules not processed for user `94511ad9ee7a4ab0b70d8d5098079886`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:41.656557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-93f1d9b8-8ef5-445c-ab07-a0dc5dd63640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:41.783018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 690/1399] 10.222.0.72 () {58 vars in 1040 bytes} [Mon Aug 29 22:50:41 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:41.794180 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e43ea-6fd2-4f72-bc8a-6b8bdbe5ece1 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:41.795792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-825e43ea-6fd2-4f72-bc8a-6b8bdbe5ece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:41.944281 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e43ea-6fd2-4f72-bc8a-6b8bdbe5ece1 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:42.036829 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:42.056419 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182658a4-6598-4f08-8e26-2ed9eb5c805c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:42.057039 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182658a4-6598-4f08-8e26-2ed9eb5c805c service swift] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:42.057324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182658a4-6598-4f08-8e26-2ed9eb5c805c service swift] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:42.057612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182658a4-6598-4f08-8e26-2ed9eb5c805c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:42.059269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-182658a4-6598-4f08-8e26-2ed9eb5c805c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:42.152568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182658a4-6598-4f08-8e26-2ed9eb5c805c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:42.154173 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182658a4-6598-4f08-8e26-2ed9eb5c805c service swift] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:42.162959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 710/1400] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 22:50:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:50:43.066029 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d13bd-824f-456f-9310-0883a6958998 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.066609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d13bd-824f-456f-9310-0883a6958998 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.066726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d13bd-824f-456f-9310-0883a6958998 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.068541 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 691/1401] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:50:43.074107 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af33f2-888b-43dd-8bbe-906bb1cf0281 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.074579 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af33f2-888b-43dd-8bbe-906bb1cf0281 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.082933 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af33f2-888b-43dd-8bbe-906bb1cf0281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.168137 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-a0af33f2-888b-43dd-8bbe-906bb1cf0281 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:43.170894 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a0af33f2-888b-43dd-8bbe-906bb1cf0281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:43.294191 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:43.341305 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 711/1402] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:43.650024 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d13bd-824f-456f-9310-0883a6958998 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:43.651570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-bb9d13bd-824f-456f-9310-0883a6958998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:43.730652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:43.845922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d13bd-824f-456f-9310-0883a6958998 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:43.993484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ab93e-5f2a-4f86-8d49-43d5afcdb91f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:43.994265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ab93e-5f2a-4f86-8d49-43d5afcdb91f service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.994552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ab93e-5f2a-4f86-8d49-43d5afcdb91f service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.994830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ab93e-5f2a-4f86-8d49-43d5afcdb91f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.996535 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-455ab93e-5f2a-4f86-8d49-43d5afcdb91f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:44.020312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:44.106092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ab93e-5f2a-4f86-8d49-43d5afcdb91f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:44.107702 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ab93e-5f2a-4f86-8d49-43d5afcdb91f service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:44.127012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 692/1403] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:46.399585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9325f4c-8a9c-4cad-90bd-e29e794b6f40 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:46.400165 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9325f4c-8a9c-4cad-90bd-e29e794b6f40 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:46.400301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9325f4c-8a9c-4cad-90bd-e29e794b6f40 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:46.401648 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 712/1404] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:46.407195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d719a33-79c6-4ff5-9c5f-5ea871f741aa None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:46.407690 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d719a33-79c6-4ff5-9c5f-5ea871f741aa None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:46.407796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d719a33-79c6-4ff5-9c5f-5ea871f741aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:46.485727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-6d719a33-79c6-4ff5-9c5f-5ea871f741aa None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:46.486987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-6d719a33-79c6-4ff5-9c5f-5ea871f741aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:46.617523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:46.631558 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 693/1405] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:46.952635 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9325f4c-8a9c-4cad-90bd-e29e794b6f40 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:46.954459 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f9325f4c-8a9c-4cad-90bd-e29e794b6f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:47.162698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9325f4c-8a9c-4cad-90bd-e29e794b6f40 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:47.237031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:47.314208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c8451-0449-456e-b98c-744d4f546148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:47.315170 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c8451-0449-456e-b98c-744d4f546148 service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:47.315519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c8451-0449-456e-b98c-744d4f546148 service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:47.315792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c8451-0449-456e-b98c-744d4f546148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:47.318231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-163c8451-0449-456e-b98c-744d4f546148 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:47.495936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c8451-0449-456e-b98c-744d4f546148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:47.499538 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c8451-0449-456e-b98c-744d4f546148 service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:47.534836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 713/1406] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:49.818540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d43877-6fa5-4547-ae2e-a7933d42183d None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.819121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d43877-6fa5-4547-ae2e-a7933d42183d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.819121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d43877-6fa5-4547-ae2e-a7933d42183d None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.820449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 694/1407] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:49.826052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2be7b-01f5-4b79-af6f-6139ef7fa94d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.826543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2be7b-01f5-4b79-af6f-6139ef7fa94d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.826742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2be7b-01f5-4b79-af6f-6139ef7fa94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.912888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f3e2be7b-01f5-4b79-af6f-6139ef7fa94d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:49.914538 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f3e2be7b-01f5-4b79-af6f-6139ef7fa94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:49.933292 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:50.047677 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 714/1408] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:50.358797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d43877-6fa5-4547-ae2e-a7933d42183d None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:50.364771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-40d43877-6fa5-4547-ae2e-a7933d42183d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:50.549751 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d43877-6fa5-4547-ae2e-a7933d42183d None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:50.629314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:50.686393 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7254059-c70f-4c1e-b713-e59c0ce6a869 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:50.687038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7254059-c70f-4c1e-b713-e59c0ce6a869 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.687324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7254059-c70f-4c1e-b713-e59c0ce6a869 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.687608 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7254059-c70f-4c1e-b713-e59c0ce6a869 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.689282 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c7254059-c70f-4c1e-b713-e59c0ce6a869 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:50.822307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7254059-c70f-4c1e-b713-e59c0ce6a869 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:50.828427 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7254059-c70f-4c1e-b713-e59c0ce6a869 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:50.851594 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 695/1409] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:00.045263 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=37 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:00.846250 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=65 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:07.152965 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbcf44-d6e8-4c30-92af-405fce1f49fd None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:07.153587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbcf44-d6e8-4c30-92af-405fce1f49fd None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:07.153587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbcf44-d6e8-4c30-92af-405fce1f49fd None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:07.154885 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 715/1410] 10.222.0.72 () {54 vars in 918 bytes} [Mon Aug 29 22:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:07.160559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6ee3f-be0d-4ff4-b626-411aecd60991 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:07.165490 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6ee3f-be0d-4ff4-b626-411aecd60991 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:07.165490 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6ee3f-be0d-4ff4-b626-411aecd60991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:07.243402 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-27e6ee3f-be0d-4ff4-b626-411aecd60991 None None] MFA Rules not processed for user `83c5fb88d96640089eba545f4c8d3c44`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:07.244667 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-27e6ee3f-be0d-4ff4-b626-411aecd60991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:07.358165 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 696/1411] 10.222.0.72 () {58 vars in 1015 bytes} [Mon Aug 29 22:51:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:07.373693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfd672-028f-4f63-8eab-9b3b104d794b None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:07.373984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfd672-028f-4f63-8eab-9b3b104d794b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:07.374265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfd672-028f-4f63-8eab-9b3b104d794b None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:07.375603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 716/1412] 10.222.0.72 () {54 vars in 918 bytes} [Mon Aug 29 22:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:07.381551 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b52f6-73fe-4788-a988-f7f801e6a815 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:07.381841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b52f6-73fe-4788-a988-f7f801e6a815 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:07.382116 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b52f6-73fe-4788-a988-f7f801e6a815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:07.465253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:07.468399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-642b52f6-73fe-4788-a988-f7f801e6a815 None None] MFA Rules not processed for user `0be09bd9ba7443aaa31879f56ca4aad1`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:07.469624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-642b52f6-73fe-4788-a988-f7f801e6a815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:07.592436 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 697/1413] 10.222.0.72 () {58 vars in 1015 bytes} [Mon Aug 29 22:51:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:10.057404 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45eb7a-e84f-43ae-b02b-865714f36334 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:10.058007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45eb7a-e84f-43ae-b02b-865714f36334 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:10.058007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45eb7a-e84f-43ae-b02b-865714f36334 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:10.059343 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:10.065521 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e527185-0c7d-4f7e-9bf4-f28702e5e2ea None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:10.066033 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e527185-0c7d-4f7e-9bf4-f28702e5e2ea None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:10.066169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e527185-0c7d-4f7e-9bf4-f28702e5e2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:10.137669 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-7e527185-0c7d-4f7e-9bf4-f28702e5e2ea None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:10.138923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7e527185-0c7d-4f7e-9bf4-f28702e5e2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:10.200320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:10.244641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:10.535940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45eb7a-e84f-43ae-b02b-865714f36334 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:10.537242 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4d45eb7a-e84f-43ae-b02b-865714f36334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:10.689157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45eb7a-e84f-43ae-b02b-865714f36334 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:10.768083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:10.810538 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd60b0-44ec-4fe9-9dfd-a53d30c34971 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:10.811138 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd60b0-44ec-4fe9-9dfd-a53d30c34971 service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:10.811416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd60b0-44ec-4fe9-9dfd-a53d30c34971 service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:10.811715 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd60b0-44ec-4fe9-9dfd-a53d30c34971 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:10.813320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-82dd60b0-44ec-4fe9-9dfd-a53d30c34971 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:10.906090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd60b0-44ec-4fe9-9dfd-a53d30c34971 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:10.907763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd60b0-44ec-4fe9-9dfd-a53d30c34971 service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:10.929690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 718/1416] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:11.851832 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02205539-a796-43c3-be56-2aa61c7caa03 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:11.852434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02205539-a796-43c3-be56-2aa61c7caa03 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:11.852434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02205539-a796-43c3-be56-2aa61c7caa03 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:11.853744 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:11.859225 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463428ed-4e2b-40d2-af58-6f5ce306d30c None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:11.859675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463428ed-4e2b-40d2-af58-6f5ce306d30c None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:11.859776 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463428ed-4e2b-40d2-af58-6f5ce306d30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:11.947290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-463428ed-4e2b-40d2-af58-6f5ce306d30c None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:11.948541 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-463428ed-4e2b-40d2-af58-6f5ce306d30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:11.982310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:12.061521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:12.215631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02205539-a796-43c3-be56-2aa61c7caa03 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:12.217377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-02205539-a796-43c3-be56-2aa61c7caa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:12.369846 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02205539-a796-43c3-be56-2aa61c7caa03 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:12.416029 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:12.504075 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa56e4-93e6-4ed4-b388-bd37ccb6dc4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:12.504714 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa56e4-93e6-4ed4-b388-bd37ccb6dc4a service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:12.504994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa56e4-93e6-4ed4-b388-bd37ccb6dc4a service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:12.505264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa56e4-93e6-4ed4-b388-bd37ccb6dc4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:12.506896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-45fa56e4-93e6-4ed4-b388-bd37ccb6dc4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:12.600773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa56e4-93e6-4ed4-b388-bd37ccb6dc4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:12.602381 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa56e4-93e6-4ed4-b388-bd37ccb6dc4a service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:12.620812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 700/1419] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:51:13.543412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b8380-d873-4699-8ea9-05d800b2c810 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:13.543980 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b8380-d873-4699-8ea9-05d800b2c810 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:13.543980 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b8380-d873-4699-8ea9-05d800b2c810 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:13.545410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:13.550856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b83a52-dc14-4d66-9a87-8cbe26097d18 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:13.551343 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b83a52-dc14-4d66-9a87-8cbe26097d18 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:13.551442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b83a52-dc14-4d66-9a87-8cbe26097d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:13.607496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:13.636180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-05b83a52-dc14-4d66-9a87-8cbe26097d18 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:13.637429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-05b83a52-dc14-4d66-9a87-8cbe26097d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:13.748758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:13.905809 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b8380-d873-4699-8ea9-05d800b2c810 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:13.907480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c46b8380-d873-4699-8ea9-05d800b2c810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:14.073523 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b8380-d873-4699-8ea9-05d800b2c810 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:14.086723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:14.221437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eed4aa-8fa9-4665-87e9-227e22e13fd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:14.222314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eed4aa-8fa9-4665-87e9-227e22e13fd9 service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:14.222452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eed4aa-8fa9-4665-87e9-227e22e13fd9 service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:14.222715 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eed4aa-8fa9-4665-87e9-227e22e13fd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:14.224284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-21eed4aa-8fa9-4665-87e9-227e22e13fd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:14.331856 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eed4aa-8fa9-4665-87e9-227e22e13fd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:14.333581 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eed4aa-8fa9-4665-87e9-227e22e13fd9 service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:14.356234 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 721/1422] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:15.259536 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2da57-5263-4242-af67-599bad5cad99 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:15.260118 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2da57-5263-4242-af67-599bad5cad99 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:15.260118 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2da57-5263-4242-af67-599bad5cad99 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:15.261573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:15.266821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07062620-ff6e-49c4-b44b-c245ccabc7fd None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:15.267300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07062620-ff6e-49c4-b44b-c245ccabc7fd None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:15.267414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07062620-ff6e-49c4-b44b-c245ccabc7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:15.288990 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:15.356421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-07062620-ff6e-49c4-b44b-c245ccabc7fd None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:15.357724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-07062620-ff6e-49c4-b44b-c245ccabc7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:15.478879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:15.633584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2da57-5263-4242-af67-599bad5cad99 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:15.635083 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-57e2da57-5263-4242-af67-599bad5cad99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:15.748841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:15.786187 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2da57-5263-4242-af67-599bad5cad99 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:15.911709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb8dc1-efc8-42c8-a181-368647eed491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:15.912263 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb8dc1-efc8-42c8-a181-368647eed491 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:15.912543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb8dc1-efc8-42c8-a181-368647eed491 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:15.912813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb8dc1-efc8-42c8-a181-368647eed491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:15.914506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-a1fb8dc1-efc8-42c8-a181-368647eed491 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:15.996032 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:16.009836 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb8dc1-efc8-42c8-a181-368647eed491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:16.011431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb8dc1-efc8-42c8-a181-368647eed491 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:16.029284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 703/1425] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:16.938578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c40f05-7e4d-4f17-874a-99f89fbf725f None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:16.939151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c40f05-7e4d-4f17-874a-99f89fbf725f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:16.939151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c40f05-7e4d-4f17-874a-99f89fbf725f None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:16.941395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:51:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:16.946521 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676a946-f45f-4697-9b38-a36763316b21 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:16.946994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676a946-f45f-4697-9b38-a36763316b21 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:16.947098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676a946-f45f-4697-9b38-a36763316b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:17.025378 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-6676a946-f45f-4697-9b38-a36763316b21 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:17.026588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-6676a946-f45f-4697-9b38-a36763316b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:17.132898 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:17.287446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c40f05-7e4d-4f17-874a-99f89fbf725f None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:17.289057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b9c40f05-7e4d-4f17-874a-99f89fbf725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:17.380729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:17.463661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c40f05-7e4d-4f17-874a-99f89fbf725f None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:17.583547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f9307-feed-4499-8eb7-a327526eaf0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:17.584069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f9307-feed-4499-8eb7-a327526eaf0a service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:17.584380 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f9307-feed-4499-8eb7-a327526eaf0a service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:17.584655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f9307-feed-4499-8eb7-a327526eaf0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:17.586301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c69f9307-feed-4499-8eb7-a327526eaf0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:17.638749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:17.683079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f9307-feed-4499-8eb7-a327526eaf0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:17.684882 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f9307-feed-4499-8eb7-a327526eaf0a service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:17.706915 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 724/1428] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:18.576358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c8e89-3ccd-424c-80ab-f66e8af66729 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:18.576937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c8e89-3ccd-424c-80ab-f66e8af66729 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:18.576937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c8e89-3ccd-424c-80ab-f66e8af66729 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:18.578500 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:18.584314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd6c70-d526-4b29-bbf5-a14a649a8bee None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:18.584814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd6c70-d526-4b29-bbf5-a14a649a8bee None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:18.584926 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd6c70-d526-4b29-bbf5-a14a649a8bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:18.662443 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-a7bd6c70-d526-4b29-bbf5-a14a649a8bee None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:18.663670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a7bd6c70-d526-4b29-bbf5-a14a649a8bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:18.777305 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:18.932945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c8e89-3ccd-424c-80ab-f66e8af66729 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:18.934545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4a1c8e89-3ccd-424c-80ab-f66e8af66729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:18.988992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:19.087198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c8e89-3ccd-424c-80ab-f66e8af66729 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:19.201516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3696d9-405e-44e1-8626-3d33a4b384b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:19.202128 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3696d9-405e-44e1-8626-3d33a4b384b0 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:19.202403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3696d9-405e-44e1-8626-3d33a4b384b0 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:19.202924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3696d9-405e-44e1-8626-3d33a4b384b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:19.204564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8d3696d9-405e-44e1-8626-3d33a4b384b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:19.212472 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:19.296072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3696d9-405e-44e1-8626-3d33a4b384b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:19.297731 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3696d9-405e-44e1-8626-3d33a4b384b0 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:19.316307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 706/1431] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:20.217963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6a4b7-7f70-4aa9-8ef2-1f7677152816 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:20.218573 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6a4b7-7f70-4aa9-8ef2-1f7677152816 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:20.218573 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6a4b7-7f70-4aa9-8ef2-1f7677152816 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:20.219900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:51:20.226154 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9a84f-763d-486a-8e05-c9b57267061a None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:20.226615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9a84f-763d-486a-8e05-c9b57267061a None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:20.226742 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9a84f-763d-486a-8e05-c9b57267061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:20.304780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-fac9a84f-763d-486a-8e05-c9b57267061a None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:20.306010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-fac9a84f-763d-486a-8e05-c9b57267061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:20.380166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:20.409819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:20.565699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6a4b7-7f70-4aa9-8ef2-1f7677152816 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:20.567262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-14d6a4b7-7f70-4aa9-8ef2-1f7677152816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:20.586014 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:20.720547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6a4b7-7f70-4aa9-8ef2-1f7677152816 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:20.810950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:20.837888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffbfaf-08d9-4843-b53c-f0af8e57ce22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:20.838404 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffbfaf-08d9-4843-b53c-f0af8e57ce22 service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:20.838681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffbfaf-08d9-4843-b53c-f0af8e57ce22 service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:20.838948 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffbfaf-08d9-4843-b53c-f0af8e57ce22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:20.840575 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-12ffbfaf-08d9-4843-b53c-f0af8e57ce22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:20.936913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffbfaf-08d9-4843-b53c-f0af8e57ce22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:20.938720 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffbfaf-08d9-4843-b53c-f0af8e57ce22 service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:20.958687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 727/1434] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:21.851587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661886e-166d-4723-ba33-771b36c19f13 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:21.852172 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661886e-166d-4723-ba33-771b36c19f13 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:21.852172 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661886e-166d-4723-ba33-771b36c19f13 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:21.853683 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:21.858842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f6941-cb9c-449b-9e12-9318343ad45b None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:21.859286 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f6941-cb9c-449b-9e12-9318343ad45b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:21.859512 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f6941-cb9c-449b-9e12-9318343ad45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:21.938651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-c34f6941-cb9c-449b-9e12-9318343ad45b None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:21.940422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c34f6941-cb9c-449b-9e12-9318343ad45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:21.985236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:22.048404 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:22.208474 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661886e-166d-4723-ba33-771b36c19f13 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:22.209949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f661886e-166d-4723-ba33-771b36c19f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:22.367621 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661886e-166d-4723-ba33-771b36c19f13 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:22.428323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:22.491318 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4382739-4034-483f-adb4-b769acdf4177 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:22.491937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382739-4034-483f-adb4-b769acdf4177 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:22.492245 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382739-4034-483f-adb4-b769acdf4177 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:22.492523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382739-4034-483f-adb4-b769acdf4177 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:22.494143 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f4382739-4034-483f-adb4-b769acdf4177 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:22.587935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4382739-4034-483f-adb4-b769acdf4177 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:22.589586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4382739-4034-483f-adb4-b769acdf4177 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:22.608277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 709/1437] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:23.509096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233f9da-a55a-4e5f-a050-d9df06016f77 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:23.509694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233f9da-a55a-4e5f-a050-d9df06016f77 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:23.509694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233f9da-a55a-4e5f-a050-d9df06016f77 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:23.510982 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:23.515959 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b9f94-2721-43c9-a05d-b5c512e3b3ab None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:23.516400 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b9f94-2721-43c9-a05d-b5c512e3b3ab None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:23.516612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b9f94-2721-43c9-a05d-b5c512e3b3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:23.599132 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-0b7b9f94-2721-43c9-a05d-b5c512e3b3ab None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:23.600457 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0b7b9f94-2721-43c9-a05d-b5c512e3b3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:23.602645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:23.716171 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:23.873121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233f9da-a55a-4e5f-a050-d9df06016f77 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:23.874656 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-9233f9da-a55a-4e5f-a050-d9df06016f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:24.027878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233f9da-a55a-4e5f-a050-d9df06016f77 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:24.058359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:24.150825 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aca53a-a1b1-4068-b736-a9b007c7d6e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:24.151393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aca53a-a1b1-4068-b736-a9b007c7d6e9 service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:24.151671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aca53a-a1b1-4068-b736-a9b007c7d6e9 service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:24.151947 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aca53a-a1b1-4068-b736-a9b007c7d6e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:24.153574 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-34aca53a-a1b1-4068-b736-a9b007c7d6e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:24.247966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aca53a-a1b1-4068-b736-a9b007c7d6e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:24.249658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aca53a-a1b1-4068-b736-a9b007c7d6e9 service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:24.270533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 730/1440] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:26.122967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daf9ea-a95f-4bf7-9cfc-aebd7193e5fa None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.123552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daf9ea-a95f-4bf7-9cfc-aebd7193e5fa None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.123552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daf9ea-a95f-4bf7-9cfc-aebd7193e5fa None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.124934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:26.131040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481298d-8d1b-427f-bb57-4b5138047c87 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.131579 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481298d-8d1b-427f-bb57-4b5138047c87 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.131675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481298d-8d1b-427f-bb57-4b5138047c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.177858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:26.207419 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-5481298d-8d1b-427f-bb57-4b5138047c87 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:26.208732 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-5481298d-8d1b-427f-bb57-4b5138047c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:26.311606 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:26.606989 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daf9ea-a95f-4bf7-9cfc-aebd7193e5fa None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:26.608574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-76daf9ea-a95f-4bf7-9cfc-aebd7193e5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:26.713806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daf9ea-a95f-4bf7-9cfc-aebd7193e5fa None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:26.746931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:26.792488 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dbf48-2758-4895-a24d-09cc37b4af08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:26.793133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dbf48-2758-4895-a24d-09cc37b4af08 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.793406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dbf48-2758-4895-a24d-09cc37b4af08 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.793685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dbf48-2758-4895-a24d-09cc37b4af08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.795785 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-322dbf48-2758-4895-a24d-09cc37b4af08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:26.918995 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dbf48-2758-4895-a24d-09cc37b4af08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:26.920451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dbf48-2758-4895-a24d-09cc37b4af08 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:26.941613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 712/1443] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:29.103150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc4fe5-22aa-4dfa-a6e8-716e38793956 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.103764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc4fe5-22aa-4dfa-a6e8-716e38793956 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.103764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc4fe5-22aa-4dfa-a6e8-716e38793956 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.105087 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:29.110534 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c25ea8-6405-426e-8442-3f7a7a4d157d None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.112357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c25ea8-6405-426e-8442-3f7a7a4d157d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.112357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c25ea8-6405-426e-8442-3f7a7a4d157d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.185566 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-69c25ea8-6405-426e-8442-3f7a7a4d157d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:29.186795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-69c25ea8-6405-426e-8442-3f7a7a4d157d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:29.202012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:29.290497 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:29.574997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc4fe5-22aa-4dfa-a6e8-716e38793956 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:29.576620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-0fcc4fe5-22aa-4dfa-a6e8-716e38793956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:29.684790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc4fe5-22aa-4dfa-a6e8-716e38793956 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:29.697248 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:29.764302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ee6f0-6010-42b3-8b7b-582b2a0cb38a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:29.764915 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ee6f0-6010-42b3-8b7b-582b2a0cb38a service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.765195 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ee6f0-6010-42b3-8b7b-582b2a0cb38a service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.765466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ee6f0-6010-42b3-8b7b-582b2a0cb38a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.767695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e44ee6f0-6010-42b3-8b7b-582b2a0cb38a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:29.895268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ee6f0-6010-42b3-8b7b-582b2a0cb38a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:29.896764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ee6f0-6010-42b3-8b7b-582b2a0cb38a service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:29.915599 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 733/1446] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:32.275829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cd959-73f7-48d6-a183-3571e18f280c None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:32.276413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cd959-73f7-48d6-a183-3571e18f280c None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:32.276413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cd959-73f7-48d6-a183-3571e18f280c None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:32.277768 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:32.283990 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1d9e-c789-4650-875e-924db50e6d96 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:32.284545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1d9e-c789-4650-875e-924db50e6d96 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:32.284545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1d9e-c789-4650-875e-924db50e6d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:32.339035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:32.357834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-872b1d9e-c789-4650-875e-924db50e6d96 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:32.359067 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-872b1d9e-c789-4650-875e-924db50e6d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:32.461406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:32.746820 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cd959-73f7-48d6-a183-3571e18f280c None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:32.748402 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-fb0cd959-73f7-48d6-a183-3571e18f280c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:32.855056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cd959-73f7-48d6-a183-3571e18f280c None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:32.896156 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:32.935267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e6bbd-ea43-4863-9617-36ff869ae120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:32.935901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e6bbd-ea43-4863-9617-36ff869ae120 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:32.936168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e6bbd-ea43-4863-9617-36ff869ae120 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:32.936475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e6bbd-ea43-4863-9617-36ff869ae120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:32.938245 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-744e6bbd-ea43-4863-9617-36ff869ae120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:33.060204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e6bbd-ea43-4863-9617-36ff869ae120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:33.061781 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e6bbd-ea43-4863-9617-36ff869ae120 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:33.081641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 715/1449] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:35.241512 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549cec0-0425-48a6-ba57-a6127399a565 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:35.242292 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549cec0-0425-48a6-ba57-a6127399a565 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:35.242292 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549cec0-0425-48a6-ba57-a6127399a565 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:35.243423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:35.249117 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb87261-af8c-4cc9-8e74-b9705283f487 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:35.249627 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb87261-af8c-4cc9-8e74-b9705283f487 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:35.249735 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb87261-af8c-4cc9-8e74-b9705283f487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:35.321290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-eeb87261-af8c-4cc9-8e74-b9705283f487 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:35.322514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-eeb87261-af8c-4cc9-8e74-b9705283f487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:35.344661 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:35.429883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:35.717689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549cec0-0425-48a6-ba57-a6127399a565 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:35.719240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8549cec0-0425-48a6-ba57-a6127399a565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:35.825260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549cec0-0425-48a6-ba57-a6127399a565 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:35.846480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:35.903358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220b72a-2191-4111-bc4f-e43fb8653837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:35.903958 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b72a-2191-4111-bc4f-e43fb8653837 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:35.904288 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b72a-2191-4111-bc4f-e43fb8653837 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:35.904566 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b72a-2191-4111-bc4f-e43fb8653837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:35.906171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-7220b72a-2191-4111-bc4f-e43fb8653837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:36.017826 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220b72a-2191-4111-bc4f-e43fb8653837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:36.019663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220b72a-2191-4111-bc4f-e43fb8653837 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:36.038724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 736/1452] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:38.059299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91177e-3aaa-44c0-b276-7ff9d1a86b1b None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:38.059867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91177e-3aaa-44c0-b276-7ff9d1a86b1b None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:38.059867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91177e-3aaa-44c0-b276-7ff9d1a86b1b None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:38.061246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:38.067342 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884ac9d-7145-40db-ad40-3ec560cb9d91 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:38.067802 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884ac9d-7145-40db-ad40-3ec560cb9d91 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:38.067898 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884ac9d-7145-40db-ad40-3ec560cb9d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:38.132796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:38.135545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-b884ac9d-7145-40db-ad40-3ec560cb9d91 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:38.136782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b884ac9d-7145-40db-ad40-3ec560cb9d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:38.237015 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:38.531435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91177e-3aaa-44c0-b276-7ff9d1a86b1b None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:38.533809 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9c91177e-3aaa-44c0-b276-7ff9d1a86b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:38.641754 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91177e-3aaa-44c0-b276-7ff9d1a86b1b None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:38.696247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:38.726909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281108a-f1ee-4d68-afa3-e9c8ac44b655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:38.727555 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281108a-f1ee-4d68-afa3-e9c8ac44b655 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:38.727837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281108a-f1ee-4d68-afa3-e9c8ac44b655 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:38.728111 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281108a-f1ee-4d68-afa3-e9c8ac44b655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:38.729777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1281108a-f1ee-4d68-afa3-e9c8ac44b655 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:38.849172 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281108a-f1ee-4d68-afa3-e9c8ac44b655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:38.850650 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281108a-f1ee-4d68-afa3-e9c8ac44b655 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:38.870745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 718/1455] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:40.884969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558f83a-1d63-4b0e-9ff9-fd19c8c0276e None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:40.885537 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558f83a-1d63-4b0e-9ff9-fd19c8c0276e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:40.885537 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558f83a-1d63-4b0e-9ff9-fd19c8c0276e None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:40.886883 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:40.894288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b547662-a42c-48cb-b82a-3385f8d777e1 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:40.894847 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b547662-a42c-48cb-b82a-3385f8d777e1 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:40.894847 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b547662-a42c-48cb-b82a-3385f8d777e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:40.972952 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-6b547662-a42c-48cb-b82a-3385f8d777e1 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:40.974245 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-6b547662-a42c-48cb-b82a-3385f8d777e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:41.006630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:41.075430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:41.360775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558f83a-1d63-4b0e-9ff9-fd19c8c0276e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:41.362427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-5558f83a-1d63-4b0e-9ff9-fd19c8c0276e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:41.478930 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558f83a-1d63-4b0e-9ff9-fd19c8c0276e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:41.509475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:41.557538 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec74558-fbd4-4c29-9223-2c2b90d10aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:41.558155 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec74558-fbd4-4c29-9223-2c2b90d10aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:41.558493 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec74558-fbd4-4c29-9223-2c2b90d10aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:41.558832 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec74558-fbd4-4c29-9223-2c2b90d10aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:41.568734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-bec74558-fbd4-4c29-9223-2c2b90d10aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:41.677355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec74558-fbd4-4c29-9223-2c2b90d10aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:41.678840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec74558-fbd4-4c29-9223-2c2b90d10aa6 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:41.697926 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 739/1458] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:43.778615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee30e0-8d7a-4d1b-b451-f895480f75d0 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:43.779287 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee30e0-8d7a-4d1b-b451-f895480f75d0 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:43.779287 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee30e0-8d7a-4d1b-b451-f895480f75d0 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:43.780600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:43.786983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15ad43-987b-40a3-9fc1-c575f575bdb4 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:43.787489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15ad43-987b-40a3-9fc1-c575f575bdb4 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:43.787489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15ad43-987b-40a3-9fc1-c575f575bdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:43.857932 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-4a15ad43-987b-40a3-9fc1-c575f575bdb4 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:43.859333 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4a15ad43-987b-40a3-9fc1-c575f575bdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:43.868679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:43.971434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:44.254809 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee30e0-8d7a-4d1b-b451-f895480f75d0 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:44.256404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e6ee30e0-8d7a-4d1b-b451-f895480f75d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:44.363973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee30e0-8d7a-4d1b-b451-f895480f75d0 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:44.423065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:44.442887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74591633-aa39-4dd5-9cf6-6e56c2989b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:44.443848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74591633-aa39-4dd5-9cf6-6e56c2989b7b service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:44.443848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74591633-aa39-4dd5-9cf6-6e56c2989b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:44.444057 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74591633-aa39-4dd5-9cf6-6e56c2989b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:44.445762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-74591633-aa39-4dd5-9cf6-6e56c2989b7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:44.558381 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74591633-aa39-4dd5-9cf6-6e56c2989b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:44.559728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74591633-aa39-4dd5-9cf6-6e56c2989b7b service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:44.579198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 721/1461] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:46.592749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b4d31-ee5f-4c2c-824e-512a7c125f73 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:46.593289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b4d31-ee5f-4c2c-824e-512a7c125f73 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:46.593382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b4d31-ee5f-4c2c-824e-512a7c125f73 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:46.594739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:46.600416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a5f1d-34d9-47a0-af9b-bab1e8add0a5 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:46.600922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a5f1d-34d9-47a0-af9b-bab1e8add0a5 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:46.601066 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a5f1d-34d9-47a0-af9b-bab1e8add0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:46.667472 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-e10a5f1d-34d9-47a0-af9b-bab1e8add0a5 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:46.668718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e10a5f1d-34d9-47a0-af9b-bab1e8add0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:46.708464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:46.768077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:47.049789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b4d31-ee5f-4c2c-824e-512a7c125f73 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:47.051368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d36b4d31-ee5f-4c2c-824e-512a7c125f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:47.166089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b4d31-ee5f-4c2c-824e-512a7c125f73 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:47.206153 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:47.243070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2183db-ea07-4953-bef3-6fb6db6134f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:47.243682 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2183db-ea07-4953-bef3-6fb6db6134f5 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:47.243960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2183db-ea07-4953-bef3-6fb6db6134f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:47.244255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2183db-ea07-4953-bef3-6fb6db6134f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:47.245871 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8c2183db-ea07-4953-bef3-6fb6db6134f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:47.369555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2183db-ea07-4953-bef3-6fb6db6134f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:47.370940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2183db-ea07-4953-bef3-6fb6db6134f5 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:47.392420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 742/1464] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:49.505208 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38054773-a165-4eff-a6b5-9e05c5ddf881 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:49.505816 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38054773-a165-4eff-a6b5-9e05c5ddf881 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:49.505915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38054773-a165-4eff-a6b5-9e05c5ddf881 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:49.507298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:49.513121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af2fc0-80b3-4a6e-aff4-c93ded4865fc None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:49.513717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af2fc0-80b3-4a6e-aff4-c93ded4865fc None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:49.514125 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af2fc0-80b3-4a6e-aff4-c93ded4865fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:49.591155 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-22af2fc0-80b3-4a6e-aff4-c93ded4865fc None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:49.592425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-22af2fc0-80b3-4a6e-aff4-c93ded4865fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:49.611364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:49.707472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:49.996208 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38054773-a165-4eff-a6b5-9e05c5ddf881 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:49.997876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-38054773-a165-4eff-a6b5-9e05c5ddf881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:50.135600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38054773-a165-4eff-a6b5-9e05c5ddf881 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:50.206646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:50.213543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e04f3-9d04-4109-b85a-dc4b701873e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:50.214208 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e04f3-9d04-4109-b85a-dc4b701873e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:50.214488 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e04f3-9d04-4109-b85a-dc4b701873e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:50.214763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e04f3-9d04-4109-b85a-dc4b701873e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:50.216463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9a4e04f3-9d04-4109-b85a-dc4b701873e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:50.344347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e04f3-9d04-4109-b85a-dc4b701873e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:50.346243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e04f3-9d04-4109-b85a-dc4b701873e7 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:50.365355 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 724/1467] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:52.321099 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44d546-dcbe-487a-ad0c-a51b9d1e2a57 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:52.321667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44d546-dcbe-487a-ad0c-a51b9d1e2a57 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:52.321667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44d546-dcbe-487a-ad0c-a51b9d1e2a57 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:52.323049 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:51:52.329334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9691d-d75a-45c1-917a-d9d584469763 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:52.329780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9691d-d75a-45c1-917a-d9d584469763 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:52.329884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9691d-d75a-45c1-917a-d9d584469763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:52.403903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-4ed9691d-d75a-45c1-917a-d9d584469763 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:52.405263 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4ed9691d-d75a-45c1-917a-d9d584469763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:52.465463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:52.522925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:52.808577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44d546-dcbe-487a-ad0c-a51b9d1e2a57 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:52.810139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-5b44d546-dcbe-487a-ad0c-a51b9d1e2a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:52.924041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44d546-dcbe-487a-ad0c-a51b9d1e2a57 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:52.978110 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:53.006255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378cba4-ebcf-481e-8edd-1ff8b9fab42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:53.006871 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378cba4-ebcf-481e-8edd-1ff8b9fab42d service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:53.007157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378cba4-ebcf-481e-8edd-1ff8b9fab42d service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:53.007439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378cba4-ebcf-481e-8edd-1ff8b9fab42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:53.009101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b378cba4-ebcf-481e-8edd-1ff8b9fab42d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:53.127915 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378cba4-ebcf-481e-8edd-1ff8b9fab42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:53.129397 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378cba4-ebcf-481e-8edd-1ff8b9fab42d service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:53.152335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 745/1470] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:02.520658 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=22 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:03.148844 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=66 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:13.213315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2281ff-33bb-4455-9043-ce09de144023 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:13.213864 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2281ff-33bb-4455-9043-ce09de144023 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:13.213864 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2281ff-33bb-4455-9043-ce09de144023 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:13.215236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 726/1471] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:52:13.221727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535f6c7-280a-4e08-a591-d5b91a2ad3f7 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:13.222155 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535f6c7-280a-4e08-a591-d5b91a2ad3f7 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:13.222314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535f6c7-280a-4e08-a591-d5b91a2ad3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:13.290721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-8535f6c7-280a-4e08-a591-d5b91a2ad3f7 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:13.291964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8535f6c7-280a-4e08-a591-d5b91a2ad3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:13.407782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 746/1472] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:13.722295 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f7ee1-2831-4ba1-8a29-83dc99b29197 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:13.722586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f7ee1-2831-4ba1-8a29-83dc99b29197 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:13.722869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f7ee1-2831-4ba1-8a29-83dc99b29197 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:13.724221 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 727/1473] 10.222.0.72 () {54 vars in 967 bytes} [Mon Aug 29 22:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:52:13.729247 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc1e8a-4afc-4aff-9565-b3c5e33a379e None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:13.729536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc1e8a-4afc-4aff-9565-b3c5e33a379e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:13.729812 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc1e8a-4afc-4aff-9565-b3c5e33a379e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:13.813684 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-17dc1e8a-4afc-4aff-9565-b3c5e33a379e None None] MFA Rules not processed for user `c7e72cc048a0418cac062d68b8df402f`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:13.814996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-17dc1e8a-4afc-4aff-9565-b3c5e33a379e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:13.838732 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:13.896349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 747/1474] 10.222.0.72 () {58 vars in 1064 bytes} [Mon Aug 29 22:52:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:13.904156 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f7ee1-2831-4ba1-8a29-83dc99b29197 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:13.906861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-400f7ee1-2831-4ba1-8a29-83dc99b29197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:14.079038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f7ee1-2831-4ba1-8a29-83dc99b29197 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:14.157468 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7863baf-744d-49d3-a8d4-371d016c87ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e72cc048a0418cac062d68b8df402f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:14.158072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7863baf-744d-49d3-a8d4-371d016c87ba service glance] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:14.158345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7863baf-744d-49d3-a8d4-371d016c87ba service glance] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:14.158612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7863baf-744d-49d3-a8d4-371d016c87ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:14.160278 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b7863baf-744d-49d3-a8d4-371d016c87ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:14.222915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:14.316524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7863baf-744d-49d3-a8d4-371d016c87ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:14.319270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7863baf-744d-49d3-a8d4-371d016c87ba service glance] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:14.348950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 728/1475] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:16.373063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823690a-1da0-47b0-93a5-0de7d3d3d43b None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:16.373737 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823690a-1da0-47b0-93a5-0de7d3d3d43b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:16.373737 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823690a-1da0-47b0-93a5-0de7d3d3d43b None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:16.375006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 748/1476] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:52:16.383793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209c7b7-9d79-405e-84b6-54ceefd5cc12 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:16.384360 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209c7b7-9d79-405e-84b6-54ceefd5cc12 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:16.384476 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209c7b7-9d79-405e-84b6-54ceefd5cc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:16.458472 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-3209c7b7-9d79-405e-84b6-54ceefd5cc12 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:16.459719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-3209c7b7-9d79-405e-84b6-54ceefd5cc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:16.568820 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 729/1477] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:16.854497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823690a-1da0-47b0-93a5-0de7d3d3d43b None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:16.856049 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a823690a-1da0-47b0-93a5-0de7d3d3d43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:16.995008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823690a-1da0-47b0-93a5-0de7d3d3d43b None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:17.047620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:17.095460 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4ca7b-802f-485a-a67b-61acc919b0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:17.096070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4ca7b-802f-485a-a67b-61acc919b0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:17.096378 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4ca7b-802f-485a-a67b-61acc919b0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:17.096645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4ca7b-802f-485a-a67b-61acc919b0e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:17.097286 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4ca7b-802f-485a-a67b-61acc919b0e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:17.099060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: WARNING py.warnings [None req-eed4ca7b-802f-485a-a67b-61acc919b0e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:52:17.099060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: warnings.warn(msg) Aug 29 22:52:17.099060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: Aug 29 22:52:17.100234 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4ca7b-802f-485a-a67b-61acc919b0e1 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:17.119908 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 749/1478] 10.222.0.72 () {56 vars in 1108 bytes} [Mon Aug 29 22:52:16 2022] GET /identity/v3/projects => generated 2553 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:19.120863 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a6d07-6981-417a-81e3-f4b5e4c25780 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:19.125709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a6d07-6981-417a-81e3-f4b5e4c25780 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:19.125709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a6d07-6981-417a-81e3-f4b5e4c25780 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:19.125709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 730/1479] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:52:19.128493 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8911941-7488-4b4c-97e5-1a0c3bdf83df None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:19.128925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8911941-7488-4b4c-97e5-1a0c3bdf83df None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:19.129057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8911941-7488-4b4c-97e5-1a0c3bdf83df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:19.197224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-e8911941-7488-4b4c-97e5-1a0c3bdf83df None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:19.198437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e8911941-7488-4b4c-97e5-1a0c3bdf83df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:19.306589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 750/1480] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:19.607193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a6d07-6981-417a-81e3-f4b5e4c25780 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:19.608892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-ef0a6d07-6981-417a-81e3-f4b5e4c25780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:19.619709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:19.772609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a6d07-6981-417a-81e3-f4b5e4c25780 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:19.855658 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:19.890615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f608dd4-6a32-49fa-a5b4-8376226ac1ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:19.891269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f608dd4-6a32-49fa-a5b4-8376226ac1ba service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:19.891660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f608dd4-6a32-49fa-a5b4-8376226ac1ba service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:19.892229 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f608dd4-6a32-49fa-a5b4-8376226ac1ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:19.894495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7f608dd4-6a32-49fa-a5b4-8376226ac1ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:19.993475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f608dd4-6a32-49fa-a5b4-8376226ac1ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:19.995084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f608dd4-6a32-49fa-a5b4-8376226ac1ba service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:20.014974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 731/1481] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:22.142322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc83c2-55ec-4eab-be79-324ff674f07b None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:22.142918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc83c2-55ec-4eab-be79-324ff674f07b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:22.142918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc83c2-55ec-4eab-be79-324ff674f07b None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:22.144229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 751/1482] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:52:22.149676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6a3da-f773-42b0-8a2e-f0f6273815b4 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:22.150157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6a3da-f773-42b0-8a2e-f0f6273815b4 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:22.150264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6a3da-f773-42b0-8a2e-f0f6273815b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:22.220466 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-61c6a3da-f773-42b0-8a2e-f0f6273815b4 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:22.221690 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-61c6a3da-f773-42b0-8a2e-f0f6273815b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:22.281269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:22.339363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 732/1483] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:22.640847 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc83c2-55ec-4eab-be79-324ff674f07b None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:22.643007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-aabc83c2-55ec-4eab-be79-324ff674f07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:22.668859 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:22.756259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc83c2-55ec-4eab-be79-324ff674f07b None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:22.831473 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6291d-5ff4-4ce8-812f-eabeb433ae2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:22.832088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6291d-5ff4-4ce8-812f-eabeb433ae2c service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:22.832396 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6291d-5ff4-4ce8-812f-eabeb433ae2c service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:22.832670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6291d-5ff4-4ce8-812f-eabeb433ae2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:22.834302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-02d6291d-5ff4-4ce8-812f-eabeb433ae2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:22.921003 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:22.964386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6291d-5ff4-4ce8-812f-eabeb433ae2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:22.965863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6291d-5ff4-4ce8-812f-eabeb433ae2c service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:22.986000 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 752/1484] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:24.981569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830db11c-ad6b-4da4-9bc1-aefe776e93fd None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:24.982176 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830db11c-ad6b-4da4-9bc1-aefe776e93fd None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:24.982176 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830db11c-ad6b-4da4-9bc1-aefe776e93fd None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:24.983591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 733/1485] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:52:24.989301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bccc2-0cea-4e39-83da-3826ab0befa8 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:24.989901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bccc2-0cea-4e39-83da-3826ab0befa8 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:24.989901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bccc2-0cea-4e39-83da-3826ab0befa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.059927 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-626bccc2-0cea-4e39-83da-3826ab0befa8 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:25.062294 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-626bccc2-0cea-4e39-83da-3826ab0befa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:25.161792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 753/1486] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:25.459224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830db11c-ad6b-4da4-9bc1-aefe776e93fd None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:25.460841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-830db11c-ad6b-4da4-9bc1-aefe776e93fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:25.568867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830db11c-ad6b-4da4-9bc1-aefe776e93fd None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:25.643495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:25.645284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a1ef5-1ebd-4e3b-8e05-dbd7f884778a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:25.645899 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a1ef5-1ebd-4e3b-8e05-dbd7f884778a service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.646171 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a1ef5-1ebd-4e3b-8e05-dbd7f884778a service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.646437 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a1ef5-1ebd-4e3b-8e05-dbd7f884778a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.648071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b51a1ef5-1ebd-4e3b-8e05-dbd7f884778a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:25.761727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a1ef5-1ebd-4e3b-8e05-dbd7f884778a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:25.763197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a1ef5-1ebd-4e3b-8e05-dbd7f884778a service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:25.781699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 734/1487] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:52:27.914970 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65683a49-7139-4649-a6a7-9d8764183911 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:27.915650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65683a49-7139-4649-a6a7-9d8764183911 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:27.915650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65683a49-7139-4649-a6a7-9d8764183911 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:27.916988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 754/1488] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:52:27.922537 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcd0e9-d8eb-4cc6-b38e-291460564cfb None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:27.923259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcd0e9-d8eb-4cc6-b38e-291460564cfb None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:27.923259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcd0e9-d8eb-4cc6-b38e-291460564cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:27.991515 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-43dcd0e9-d8eb-4cc6-b38e-291460564cfb None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:27.992773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-43dcd0e9-d8eb-4cc6-b38e-291460564cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:28.046622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:28.093306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 735/1489] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:28.384373 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65683a49-7139-4649-a6a7-9d8764183911 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:28.386029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-65683a49-7139-4649-a6a7-9d8764183911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:28.425610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:28.501938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65683a49-7139-4649-a6a7-9d8764183911 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:28.582670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d80fa9-78d8-40d9-88a6-2c7ec9de9da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:28.583335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d80fa9-78d8-40d9-88a6-2c7ec9de9da7 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:28.583624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d80fa9-78d8-40d9-88a6-2c7ec9de9da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:28.583887 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d80fa9-78d8-40d9-88a6-2c7ec9de9da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:28.585616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-11d80fa9-78d8-40d9-88a6-2c7ec9de9da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:28.673552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:28.704301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d80fa9-78d8-40d9-88a6-2c7ec9de9da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:28.705754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d80fa9-78d8-40d9-88a6-2c7ec9de9da7 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:28.723903 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 755/1490] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:31.063288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32242442-0203-469c-b8af-5e6eb956340c None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:31.063862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32242442-0203-469c-b8af-5e6eb956340c None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:31.063862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32242442-0203-469c-b8af-5e6eb956340c None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:31.065282 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 736/1491] 10.222.0.72 () {54 vars in 927 bytes} [Mon Aug 29 22:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:52:31.070710 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af910b-a951-40ea-b6c6-8df1677a2a34 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:31.071283 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af910b-a951-40ea-b6c6-8df1677a2a34 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:31.071283 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af910b-a951-40ea-b6c6-8df1677a2a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:31.140908 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-c1af910b-a951-40ea-b6c6-8df1677a2a34 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:31.142128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c1af910b-a951-40ea-b6c6-8df1677a2a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:31.365106 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 756/1492] 10.222.0.72 () {58 vars in 1024 bytes} [Mon Aug 29 22:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:31.658999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32242442-0203-469c-b8af-5e6eb956340c None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:31.660613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-32242442-0203-469c-b8af-5e6eb956340c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:31.770648 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32242442-0203-469c-b8af-5e6eb956340c None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:31.852165 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d5d14-c657-4ea1-9d84-b8f805ad603b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:31.852792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d5d14-c657-4ea1-9d84-b8f805ad603b service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:31.853067 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d5d14-c657-4ea1-9d84-b8f805ad603b service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:31.853336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d5d14-c657-4ea1-9d84-b8f805ad603b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:31.855048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b75d5d14-c657-4ea1-9d84-b8f805ad603b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:31.864869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:31.979131 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d5d14-c657-4ea1-9d84-b8f805ad603b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:31.980548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d5d14-c657-4ea1-9d84-b8f805ad603b service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:32.000447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 737/1493] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:41.363090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=82 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:41.997278 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=50 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:02.704461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc20b4c-bc41-471b-9ded-d82a4c545020 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:02.705031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc20b4c-bc41-471b-9ded-d82a4c545020 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:02.705031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc20b4c-bc41-471b-9ded-d82a4c545020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:02.795849 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-edc20b4c-bc41-471b-9ded-d82a4c545020 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:02.797138 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-edc20b4c-bc41-471b-9ded-d82a4c545020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:02.908871 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 757/1494] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:02.917869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f30e7-d8ed-4062-8a81-01a5290d9960 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:02.918441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f30e7-d8ed-4062-8a81-01a5290d9960 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:02.918441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f30e7-d8ed-4062-8a81-01a5290d9960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:03.002976 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-5b4f30e7-d8ed-4062-8a81-01a5290d9960 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:03.004361 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5b4f30e7-d8ed-4062-8a81-01a5290d9960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:03.106876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 738/1495] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:03.111620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc20b4c-bc41-471b-9ded-d82a4c545020 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:03.112853 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-edc20b4c-bc41-471b-9ded-d82a4c545020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:03.125494 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc20b4c-bc41-471b-9ded-d82a4c545020 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:03.191884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:03.226998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872818f6-dabd-4db7-8904-5820cb4406a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:03.227658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872818f6-dabd-4db7-8904-5820cb4406a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:03.227931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872818f6-dabd-4db7-8904-5820cb4406a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:03.228260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872818f6-dabd-4db7-8904-5820cb4406a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:03.228937 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872818f6-dabd-4db7-8904-5820cb4406a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:54:03.229236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872818f6-dabd-4db7-8904-5820cb4406a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:03.230252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: WARNING py.warnings [None req-872818f6-dabd-4db7-8904-5820cb4406a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:54:03.230252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: warnings.warn(msg) Aug 29 22:54:03.230252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: Aug 29 22:54:03.231126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872818f6-dabd-4db7-8904-5820cb4406a1 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:03.243222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 758/1496] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:54:03.251760 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f30e7-d8ed-4062-8a81-01a5290d9960 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:03.261997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f30e7-d8ed-4062-8a81-01a5290d9960 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:03.328421 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:03.363088 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ddfde-6289-4b19-963f-b73106add2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:03.363701 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ddfde-6289-4b19-963f-b73106add2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:03.363981 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ddfde-6289-4b19-963f-b73106add2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:03.364285 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ddfde-6289-4b19-963f-b73106add2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:03.364942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ddfde-6289-4b19-963f-b73106add2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:03.366845 dv-cinder-854271-4-smb devstack@keystone.service[88553]: WARNING py.warnings [None req-e85ddfde-6289-4b19-963f-b73106add2b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:54:03.366845 dv-cinder-854271-4-smb devstack@keystone.service[88553]: warnings.warn(msg) Aug 29 22:54:03.366845 dv-cinder-854271-4-smb devstack@keystone.service[88553]: Aug 29 22:54:03.369071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ddfde-6289-4b19-963f-b73106add2b4 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:03.509057 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 739/1497] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:54:03 2022] POST /identity/v3/projects => generated 379 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:54:03.513302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872818f6-dabd-4db7-8904-5820cb4406a1 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:03.514934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-872818f6-dabd-4db7-8904-5820cb4406a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:03.551119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872818f6-dabd-4db7-8904-5820cb4406a1 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:03.660742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ccb90-d8b4-418d-ad0d-9590c52c2e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:03.661359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ccb90-d8b4-418d-ad0d-9590c52c2e14 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:03.661639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ccb90-d8b4-418d-ad0d-9590c52c2e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:03.661917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ccb90-d8b4-418d-ad0d-9590c52c2e14 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:03.662558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ccb90-d8b4-418d-ad0d-9590c52c2e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:03.663564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: WARNING py.warnings [None req-943ccb90-d8b4-418d-ad0d-9590c52c2e14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:54:03.663564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: warnings.warn(msg) Aug 29 22:54:03.663564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: Aug 29 22:54:03.665140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ccb90-d8b4-418d-ad0d-9590c52c2e14 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:03.755939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 759/1498] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:54:03 2022] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:54:03.761253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ddfde-6289-4b19-963f-b73106add2b4 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:03.762803 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e85ddfde-6289-4b19-963f-b73106add2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:03.829770 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ddfde-6289-4b19-963f-b73106add2b4 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:03.955564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:03.968700 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb665b90-a2f9-42da-ade7-9e1e56bdf48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:03.969351 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb665b90-a2f9-42da-ade7-9e1e56bdf48d admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:03.969636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb665b90-a2f9-42da-ade7-9e1e56bdf48d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:03.969914 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb665b90-a2f9-42da-ade7-9e1e56bdf48d admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:03.970574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb665b90-a2f9-42da-ade7-9e1e56bdf48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:03.971604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: WARNING py.warnings [None req-eb665b90-a2f9-42da-ade7-9e1e56bdf48d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:54:03.971604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: warnings.warn(msg) Aug 29 22:54:03.971604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: Aug 29 22:54:03.972603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb665b90-a2f9-42da-ade7-9e1e56bdf48d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:03.986440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 740/1499] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:54:03.990647 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ccb90-d8b4-418d-ad0d-9590c52c2e14 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:03.993155 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-943ccb90-d8b4-418d-ad0d-9590c52c2e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:04.006604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ccb90-d8b4-418d-ad0d-9590c52c2e14 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:04.033884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:04.107974 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135ef32-6498-4643-b2f6-a7ba36178953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:04.108717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135ef32-6498-4643-b2f6-a7ba36178953 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:04.109181 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135ef32-6498-4643-b2f6-a7ba36178953 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:04.109909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135ef32-6498-4643-b2f6-a7ba36178953 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:04.110566 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135ef32-6498-4643-b2f6-a7ba36178953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:04.111623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: WARNING py.warnings [None req-3135ef32-6498-4643-b2f6-a7ba36178953 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:54:04.111623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: warnings.warn(msg) Aug 29 22:54:04.111623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: Aug 29 22:54:04.112581 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135ef32-6498-4643-b2f6-a7ba36178953 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:04.125744 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 760/1500] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:54:04.130012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb665b90-a2f9-42da-ade7-9e1e56bdf48d admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:04.131590 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-eb665b90-a2f9-42da-ade7-9e1e56bdf48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:04.167785 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb665b90-a2f9-42da-ade7-9e1e56bdf48d admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:04.270045 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae3619-fbb9-4212-924e-877d1f5e6a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:04.270712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae3619-fbb9-4212-924e-877d1f5e6a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:04.270993 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae3619-fbb9-4212-924e-877d1f5e6a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:04.271270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae3619-fbb9-4212-924e-877d1f5e6a60 admin admin] PATH_INFO: `/v3/projects/c9163190f5b14f358c5346b12c4994d7/users/85c8e53ea4b14cb8badc23303298894b/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:04.295268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae3619-fbb9-4212-924e-877d1f5e6a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9163190f5b14f358c5346b12c4994d7, user_id=85c8e53ea4b14cb8badc23303298894b, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:04.296340 dv-cinder-854271-4-smb devstack@keystone.service[88553]: WARNING py.warnings [None req-f8ae3619-fbb9-4212-924e-877d1f5e6a60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:54:04.296340 dv-cinder-854271-4-smb devstack@keystone.service[88553]: warnings.warn(msg) Aug 29 22:54:04.296340 dv-cinder-854271-4-smb devstack@keystone.service[88553]: Aug 29 22:54:04.298298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae3619-fbb9-4212-924e-877d1f5e6a60 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:04.388676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 741/1501] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:54:04 2022] PUT /identity/v3/projects/c9163190f5b14f358c5346b12c4994d7/users/85c8e53ea4b14cb8badc23303298894b/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:54:04.401217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bceb7-8eed-49df-af47-920c17f2fe82 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:04.401533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bceb7-8eed-49df-af47-920c17f2fe82 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:04.401828 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bceb7-8eed-49df-af47-920c17f2fe82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:04.470759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-803bceb7-8eed-49df-af47-920c17f2fe82 None None] MFA Rules not processed for user `85c8e53ea4b14cb8badc23303298894b`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:04.471992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-803bceb7-8eed-49df-af47-920c17f2fe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:04.563158 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 761/1502] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:54:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:04.577860 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9131a2-6142-46ce-9933-0efa8c9cadc5 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:04.578148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9131a2-6142-46ce-9933-0efa8c9cadc5 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:04.578422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9131a2-6142-46ce-9933-0efa8c9cadc5 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:04.579758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 742/1503] 10.222.0.72 () {54 vars in 964 bytes} [Mon Aug 29 22:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:54:04.584977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61288d-70b7-41a5-a8c6-551ef37f2c24 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:04.585266 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61288d-70b7-41a5-a8c6-551ef37f2c24 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:04.585573 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61288d-70b7-41a5-a8c6-551ef37f2c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:04.618771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:04.670879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-cf61288d-70b7-41a5-a8c6-551ef37f2c24 None None] MFA Rules not processed for user `e187bd54667a46c4a234d4aff23e1777`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:04.672053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-cf61288d-70b7-41a5-a8c6-551ef37f2c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:04.752042 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 762/1504] 10.222.0.72 () {58 vars in 1061 bytes} [Mon Aug 29 22:54:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:04.760129 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9131a2-6142-46ce-9933-0efa8c9cadc5 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:04.765252 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5c9131a2-6142-46ce-9933-0efa8c9cadc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:04.814442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:04.873579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9131a2-6142-46ce-9933-0efa8c9cadc5 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:04.958726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46131b26-f9c0-45a6-bc4b-a76722e41fb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:04.959378 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46131b26-f9c0-45a6-bc4b-a76722e41fb4 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:04.959500 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46131b26-f9c0-45a6-bc4b-a76722e41fb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:04.959774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46131b26-f9c0-45a6-bc4b-a76722e41fb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:04.962186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-46131b26-f9c0-45a6-bc4b-a76722e41fb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:05.070726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46131b26-f9c0-45a6-bc4b-a76722e41fb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:05.072443 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46131b26-f9c0-45a6-bc4b-a76722e41fb4 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:05.076266 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:05.092373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 743/1505] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:05.138992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293a8a4-494d-427e-86ac-7253ba6897f7 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:05.139449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293a8a4-494d-427e-86ac-7253ba6897f7 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:05.139572 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293a8a4-494d-427e-86ac-7253ba6897f7 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:05.140827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 763/1506] 10.222.0.72 () {52 vars in 830 bytes} [Mon Aug 29 22:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:54:05.144619 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46131b26-f9c0-45a6-bc4b-a76722e41fb4 service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:05.145845 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-46131b26-f9c0-45a6-bc4b-a76722e41fb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:05.251999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46131b26-f9c0-45a6-bc4b-a76722e41fb4 service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:05.351360 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92073b88-f16a-4bc1-8749-c65dede21b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:05.351993 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92073b88-f16a-4bc1-8749-c65dede21b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:05.352290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92073b88-f16a-4bc1-8749-c65dede21b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:05.352675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92073b88-f16a-4bc1-8749-c65dede21b7c admin admin] PATH_INFO: `/v3/users/85c8e53ea4b14cb8badc23303298894b` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:05.365017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92073b88-f16a-4bc1-8749-c65dede21b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c8e53ea4b14cb8badc23303298894b)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:05.366043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: WARNING py.warnings [None req-92073b88-f16a-4bc1-8749-c65dede21b7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:54:05.366043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: warnings.warn(msg) Aug 29 22:54:05.366043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: Aug 29 22:54:05.368028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92073b88-f16a-4bc1-8749-c65dede21b7c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:05.377936 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:05.671066 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-92073b88-f16a-4bc1-8749-c65dede21b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c8e53ea4b14cb8badc23303298894b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:05.671417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-92073b88-f16a-4bc1-8749-c65dede21b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c8e53ea4b14cb8badc23303298894b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:05.671939 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-92073b88-f16a-4bc1-8749-c65dede21b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c8e53ea4b14cb8badc23303298894b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:05.700475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-92073b88-f16a-4bc1-8749-c65dede21b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c8e53ea4b14cb8badc23303298894b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:05.718737 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-92073b88-f16a-4bc1-8749-c65dede21b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c8e53ea4b14cb8badc23303298894b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:05.808355 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 744/1507] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:54:05 2022] DELETE /identity/v3/users/85c8e53ea4b14cb8badc23303298894b => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:54:05.813254 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d67e03-e68c-4266-831d-5367655d8066 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:05.813547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d67e03-e68c-4266-831d-5367655d8066 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:05.813823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d67e03-e68c-4266-831d-5367655d8066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:05.876159 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-a0d67e03-e68c-4266-831d-5367655d8066 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:05.877446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a0d67e03-e68c-4266-831d-5367655d8066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:05.958639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:05.971957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 764/1508] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:05.981975 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92073b88-f16a-4bc1-8749-c65dede21b7c admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:05.983243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-92073b88-f16a-4bc1-8749-c65dede21b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:06.090913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92073b88-f16a-4bc1-8749-c65dede21b7c admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:06.153894 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:06.173070 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514a6da-4cc5-4655-b25e-de490e10f416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:06.173691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514a6da-4cc5-4655-b25e-de490e10f416 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:06.173975 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514a6da-4cc5-4655-b25e-de490e10f416 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:06.174255 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514a6da-4cc5-4655-b25e-de490e10f416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:06.178093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2514a6da-4cc5-4655-b25e-de490e10f416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:06.301849 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514a6da-4cc5-4655-b25e-de490e10f416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:06.303291 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514a6da-4cc5-4655-b25e-de490e10f416 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:06.324603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 745/1509] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:06.822731 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d67e03-e68c-4266-831d-5367655d8066 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:06.823997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a0d67e03-e68c-4266-831d-5367655d8066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:06.836584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d67e03-e68c-4266-831d-5367655d8066 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:06.956677 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698e3a9-4eea-4e80-9882-05879d16ca97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:06.957631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698e3a9-4eea-4e80-9882-05879d16ca97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:06.958072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698e3a9-4eea-4e80-9882-05879d16ca97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:06.958496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698e3a9-4eea-4e80-9882-05879d16ca97 admin admin] PATH_INFO: `/v3/projects/c9163190f5b14f358c5346b12c4994d7` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:06.973682 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698e3a9-4eea-4e80-9882-05879d16ca97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9163190f5b14f358c5346b12c4994d7)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:06.975400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: WARNING py.warnings [None req-9698e3a9-4eea-4e80-9882-05879d16ca97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:54:06.975400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: warnings.warn(msg) Aug 29 22:54:06.975400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: Aug 29 22:54:06.977738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698e3a9-4eea-4e80-9882-05879d16ca97 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:07.141990 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9698e3a9-4eea-4e80-9882-05879d16ca97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9163190f5b14f358c5346b12c4994d7', 'request_id': 'req-9698e3a9-4eea-4e80-9882-05879d16ca97'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:07.155166 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9698e3a9-4eea-4e80-9882-05879d16ca97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9163190f5b14f358c5346b12c4994d7', 'request_id': 'req-9698e3a9-4eea-4e80-9882-05879d16ca97'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:07.161406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9698e3a9-4eea-4e80-9882-05879d16ca97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9163190f5b14f358c5346b12c4994d7', 'request_id': 'req-9698e3a9-4eea-4e80-9882-05879d16ca97'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:07.255304 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9698e3a9-4eea-4e80-9882-05879d16ca97 admin admin] The token cache is being invalidate because project c9163190f5b14f358c5346b12c4994d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:54:07.255601 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9698e3a9-4eea-4e80-9882-05879d16ca97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:07.256031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9698e3a9-4eea-4e80-9882-05879d16ca97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:07.257824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 765/1510] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:54:06 2022] DELETE /identity/v3/projects/c9163190f5b14f358c5346b12c4994d7 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:54:16.322049 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=62 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:17.253143 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:48.809184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4c44d-bf45-4e1c-a2f9-fc61b569523b None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:48.809828 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4c44d-bf45-4e1c-a2f9-fc61b569523b None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:48.809828 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4c44d-bf45-4e1c-a2f9-fc61b569523b None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:48.811086 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:55:48.816655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfdbc1-310a-4879-842a-2d2b5315e15d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:48.817425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfdbc1-310a-4879-842a-2d2b5315e15d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:48.817585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfdbc1-310a-4879-842a-2d2b5315e15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:48.907352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-06cfdbc1-310a-4879-842a-2d2b5315e15d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:48.908626 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-06cfdbc1-310a-4879-842a-2d2b5315e15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:49.027400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:49.183964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4c44d-bf45-4e1c-a2f9-fc61b569523b None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:49.186203 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-35e4c44d-bf45-4e1c-a2f9-fc61b569523b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:49.309449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4c44d-bf45-4e1c-a2f9-fc61b569523b None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:49.314893 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cded9e-e55b-4046-9aff-96ed54e076b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:49.316608 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cded9e-e55b-4046-9aff-96ed54e076b6 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:49.316895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cded9e-e55b-4046-9aff-96ed54e076b6 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:49.317163 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cded9e-e55b-4046-9aff-96ed54e076b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:49.325326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cded9e-e55b-4046-9aff-96ed54e076b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:49.326895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cded9e-e55b-4046-9aff-96ed54e076b6 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:49.336961 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 747/1513] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:50.201223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3835b-f959-4b22-ae47-6c12b742f02a None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:50.201799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3835b-f959-4b22-ae47-6c12b742f02a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:50.201799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3835b-f959-4b22-ae47-6c12b742f02a None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:50.203112 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:55:50.209055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db71c63-8eec-4b56-995f-cb7365e203e6 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:50.209558 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db71c63-8eec-4b56-995f-cb7365e203e6 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:50.209684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db71c63-8eec-4b56-995f-cb7365e203e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:50.229177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-6db71c63-8eec-4b56-995f-cb7365e203e6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:50.230389 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-6db71c63-8eec-4b56-995f-cb7365e203e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:50.238309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:50.402289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3835b-f959-4b22-ae47-6c12b742f02a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:50.417349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3835b-f959-4b22-ae47-6c12b742f02a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:50.422969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad63f3-a82a-485a-b78c-d27a653841ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:50.423580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad63f3-a82a-485a-b78c-d27a653841ee service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:50.423864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad63f3-a82a-485a-b78c-d27a653841ee service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:50.424140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad63f3-a82a-485a-b78c-d27a653841ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:50.433756 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad63f3-a82a-485a-b78c-d27a653841ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:50.435358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad63f3-a82a-485a-b78c-d27a653841ee service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:50.446024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 768/1516] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:50.709653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5532a6f-64be-4a37-837d-b6d657f01c22 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:50.709869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5532a6f-64be-4a37-837d-b6d657f01c22 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:50.710107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5532a6f-64be-4a37-837d-b6d657f01c22 None None] PATH_INFO: `/v3` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:50.711430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 749/1517] 10.222.0.70 () {54 vars in 925 bytes} [Mon Aug 29 22:55:50 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:55:50.741126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f2b5d-0f2a-41d7-a617-5408dbdc5ab8 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:50.741543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f2b5d-0f2a-41d7-a617-5408dbdc5ab8 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:50.741912 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f2b5d-0f2a-41d7-a617-5408dbdc5ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:50.804673 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-767f2b5d-0f2a-41d7-a617-5408dbdc5ab8 None None] MFA Rules not processed for user `83c5fb88d96640089eba545f4c8d3c44`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:50.805899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-767f2b5d-0f2a-41d7-a617-5408dbdc5ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:50.823057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:50.880229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 769/1518] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Aug 29 22:55:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:00.224273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=56 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:00.231776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaa070-b7d6-4e28-a9dc-e535ce7fd972 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:00.232061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaa070-b7d6-4e28-a9dc-e535ce7fd972 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:00.232365 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaa070-b7d6-4e28-a9dc-e535ce7fd972 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:00.233691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 750/1519] 10.222.0.72 () {54 vars in 961 bytes} [Mon Aug 29 22:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:56:00.239433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeb53f-3784-4145-8004-c3585e434470 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:00.243489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeb53f-3784-4145-8004-c3585e434470 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:00.243489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeb53f-3784-4145-8004-c3585e434470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:00.260149 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-acfeb53f-3784-4145-8004-c3585e434470 None None] MFA Rules not processed for user `83c5fb88d96640089eba545f4c8d3c44`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:00.261396 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-acfeb53f-3784-4145-8004-c3585e434470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:00.270285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 770/1520] 10.222.0.72 () {58 vars in 1058 bytes} [Mon Aug 29 22:56:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:56:00.277815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaa070-b7d6-4e28-a9dc-e535ce7fd972 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:00.291064 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaa070-b7d6-4e28-a9dc-e535ce7fd972 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:00.296004 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2394281-c27e-43ec-826d-6402843ad8d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5fb88d96640089eba545f4c8d3c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:00.296638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394281-c27e-43ec-826d-6402843ad8d6 service placement] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:00.296912 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394281-c27e-43ec-826d-6402843ad8d6 service placement] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:00.297182 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394281-c27e-43ec-826d-6402843ad8d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:00.306841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2394281-c27e-43ec-826d-6402843ad8d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:00.308450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2394281-c27e-43ec-826d-6402843ad8d6 service placement] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:00.319129 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 751/1521] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:01.706081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee7710-4f83-4969-a948-f6e50a9c727d None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:01.706686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee7710-4f83-4969-a948-f6e50a9c727d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:01.706795 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee7710-4f83-4969-a948-f6e50a9c727d None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:01.708325 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:56:01.713770 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50410175-dd93-4dc8-926f-921d562d72e0 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:01.714316 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50410175-dd93-4dc8-926f-921d562d72e0 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:01.714316 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50410175-dd93-4dc8-926f-921d562d72e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:01.733815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-50410175-dd93-4dc8-926f-921d562d72e0 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:01.735014 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-50410175-dd93-4dc8-926f-921d562d72e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:01.743928 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:01.902495 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee7710-4f83-4969-a948-f6e50a9c727d None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:01.918682 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee7710-4f83-4969-a948-f6e50a9c727d None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:01.924550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a21bd-fb8a-4bbf-b79f-a45b18b98b7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:01.925167 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a21bd-fb8a-4bbf-b79f-a45b18b98b7e service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:01.925444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a21bd-fb8a-4bbf-b79f-a45b18b98b7e service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:01.925758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a21bd-fb8a-4bbf-b79f-a45b18b98b7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:01.934857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a21bd-fb8a-4bbf-b79f-a45b18b98b7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:01.936495 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a21bd-fb8a-4bbf-b79f-a45b18b98b7e service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:01.948338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 772/1524] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:02.797022 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822cccb-9eda-48ce-af45-1ca0ac86c4c5 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:02.797672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822cccb-9eda-48ce-af45-1ca0ac86c4c5 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:02.797672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822cccb-9eda-48ce-af45-1ca0ac86c4c5 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:02.798994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:56:02.804265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e916da-ce2f-4710-ad8f-bfe9c148024d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:02.804721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e916da-ce2f-4710-ad8f-bfe9c148024d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:02.804830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e916da-ce2f-4710-ad8f-bfe9c148024d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:02.824994 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-a4e916da-ce2f-4710-ad8f-bfe9c148024d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:02.826214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a4e916da-ce2f-4710-ad8f-bfe9c148024d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:02.835366 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:02.998711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822cccb-9eda-48ce-af45-1ca0ac86c4c5 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:03.014415 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822cccb-9eda-48ce-af45-1ca0ac86c4c5 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:03.021277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca652fa9-9fac-4a30-aefe-f809e5e4e417 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:03.021880 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652fa9-9fac-4a30-aefe-f809e5e4e417 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:03.022164 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652fa9-9fac-4a30-aefe-f809e5e4e417 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:03.022434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652fa9-9fac-4a30-aefe-f809e5e4e417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:03.031531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca652fa9-9fac-4a30-aefe-f809e5e4e417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:03.033180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca652fa9-9fac-4a30-aefe-f809e5e4e417 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:03.043081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 754/1527] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:07.166154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531587f-d6be-40ea-afe0-a14e196c581b None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:07.166699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531587f-d6be-40ea-afe0-a14e196c581b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:07.166699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531587f-d6be-40ea-afe0-a14e196c581b None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:07.167965 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:56:07.173364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2ec5a-8202-49a6-8f55-cdea923754b0 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:07.173915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2ec5a-8202-49a6-8f55-cdea923754b0 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:07.174012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2ec5a-8202-49a6-8f55-cdea923754b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:07.194410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-9de2ec5a-8202-49a6-8f55-cdea923754b0 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:07.195631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9de2ec5a-8202-49a6-8f55-cdea923754b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:07.203518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:07.499981 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531587f-d6be-40ea-afe0-a14e196c581b None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:07.503320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f531587f-d6be-40ea-afe0-a14e196c581b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:07.588610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531587f-d6be-40ea-afe0-a14e196c581b None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:07.592523 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519fda3-7681-4935-a396-a793258cc354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:07.593118 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519fda3-7681-4935-a396-a793258cc354 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:07.593398 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519fda3-7681-4935-a396-a793258cc354 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:07.593664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519fda3-7681-4935-a396-a793258cc354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:07.603671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519fda3-7681-4935-a396-a793258cc354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:07.605394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519fda3-7681-4935-a396-a793258cc354 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:07.615453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 775/1530] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:09.577729 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f86fbf-a692-4c13-87a3-a17584f85a6c None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:09.578293 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f86fbf-a692-4c13-87a3-a17584f85a6c None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:09.578293 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f86fbf-a692-4c13-87a3-a17584f85a6c None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:09.580297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:56:09.586167 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ba114-a6c6-47c4-9062-3167dec38ff8 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:09.586667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ba114-a6c6-47c4-9062-3167dec38ff8 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:09.586780 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ba114-a6c6-47c4-9062-3167dec38ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:09.607992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f56ba114-a6c6-47c4-9062-3167dec38ff8 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:09.609238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f56ba114-a6c6-47c4-9062-3167dec38ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:09.617178 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:09.903826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f86fbf-a692-4c13-87a3-a17584f85a6c None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:09.915307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f86fbf-a692-4c13-87a3-a17584f85a6c None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:09.918920 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc34b26-47a4-4ccc-900f-b6968be0bf2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:09.919523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc34b26-47a4-4ccc-900f-b6968be0bf2e service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:09.919798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc34b26-47a4-4ccc-900f-b6968be0bf2e service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:09.920072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc34b26-47a4-4ccc-900f-b6968be0bf2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:09.930143 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc34b26-47a4-4ccc-900f-b6968be0bf2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:09.931559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc34b26-47a4-4ccc-900f-b6968be0bf2e service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:09.941743 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 757/1533] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:13.884303 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6720b-95b1-4231-9a9e-cd9e1ac0e70e None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:13.884884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6720b-95b1-4231-9a9e-cd9e1ac0e70e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:13.884884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6720b-95b1-4231-9a9e-cd9e1ac0e70e None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:13.886247 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:56:13.891579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780bcb7-aa32-4e76-b928-4f1145503712 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:13.895775 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780bcb7-aa32-4e76-b928-4f1145503712 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:13.895775 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780bcb7-aa32-4e76-b928-4f1145503712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:13.912919 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-2780bcb7-aa32-4e76-b928-4f1145503712 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:13.914199 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2780bcb7-aa32-4e76-b928-4f1145503712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:13.923917 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:14.512077 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6720b-95b1-4231-9a9e-cd9e1ac0e70e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:14.513802 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ecd6720b-95b1-4231-9a9e-cd9e1ac0e70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:14.583289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:14.599250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6720b-95b1-4231-9a9e-cd9e1ac0e70e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:14.603000 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42541-73d6-4d1b-9436-ad960cfb0782 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:14.604642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42541-73d6-4d1b-9436-ad960cfb0782 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:14.604642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42541-73d6-4d1b-9436-ad960cfb0782 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:14.604642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42541-73d6-4d1b-9436-ad960cfb0782 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:14.614558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b42541-73d6-4d1b-9436-ad960cfb0782 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:14.616037 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b42541-73d6-4d1b-9436-ad960cfb0782 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:14.626923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 778/1536] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:16.581049 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76dc93-3cf4-4f4c-9aeb-5235103bcc8f None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:16.581680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76dc93-3cf4-4f4c-9aeb-5235103bcc8f None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:16.581680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76dc93-3cf4-4f4c-9aeb-5235103bcc8f None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:16.582921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:56:16.588403 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0138d90-8895-468c-a2d8-43cda65c98b2 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:16.588873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0138d90-8895-468c-a2d8-43cda65c98b2 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:16.588994 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0138d90-8895-468c-a2d8-43cda65c98b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:16.609597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-e0138d90-8895-468c-a2d8-43cda65c98b2 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:16.611794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e0138d90-8895-468c-a2d8-43cda65c98b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:16.619916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:17.180889 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76dc93-3cf4-4f4c-9aeb-5235103bcc8f None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:17.182630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4f76dc93-3cf4-4f4c-9aeb-5235103bcc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:17.196959 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76dc93-3cf4-4f4c-9aeb-5235103bcc8f None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:17.200494 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db5cf3-144e-40ee-84b1-408b91f80f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:17.201086 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db5cf3-144e-40ee-84b1-408b91f80f10 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:17.201364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db5cf3-144e-40ee-84b1-408b91f80f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:17.201643 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db5cf3-144e-40ee-84b1-408b91f80f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:17.212239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db5cf3-144e-40ee-84b1-408b91f80f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:17.213665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db5cf3-144e-40ee-84b1-408b91f80f10 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:17.223717 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 760/1539] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:26.604216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=11 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:27.218913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=33 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:47.952024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44612a24-f535-4ca9-9815-9aa47b64e4a0 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:47.952753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44612a24-f535-4ca9-9815-9aa47b64e4a0 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:47.952753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44612a24-f535-4ca9-9815-9aa47b64e4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:47.991406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-44612a24-f535-4ca9-9815-9aa47b64e4a0 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:47.992672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-44612a24-f535-4ca9-9815-9aa47b64e4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:48.007193 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 780/1540] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 29 22:57:48.017111 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cb12c-5d60-4256-93ff-f40135a88396 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.018453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cb12c-5d60-4256-93ff-f40135a88396 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.018772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cb12c-5d60-4256-93ff-f40135a88396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:48.047127 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-d53cb12c-5d60-4256-93ff-f40135a88396 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:48.048782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d53cb12c-5d60-4256-93ff-f40135a88396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:48.061249 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 761/1541] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:48.066641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44612a24-f535-4ca9-9815-9aa47b64e4a0 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:48.081954 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44612a24-f535-4ca9-9815-9aa47b64e4a0 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:48.092699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8b029-f8de-48d8-b64d-e154ba291a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:48.093345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8b029-f8de-48d8-b64d-e154ba291a31 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.093631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8b029-f8de-48d8-b64d-e154ba291a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.093907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8b029-f8de-48d8-b64d-e154ba291a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:48.094576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8b029-f8de-48d8-b64d-e154ba291a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:57:48.094884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8b029-f8de-48d8-b64d-e154ba291a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:48.096631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8b029-f8de-48d8-b64d-e154ba291a31 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:48.111774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 781/1542] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:57:48.120380 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cb12c-5d60-4256-93ff-f40135a88396 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:48.137761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cb12c-5d60-4256-93ff-f40135a88396 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:48.146179 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c83b9-4863-471d-92ed-692e653312f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:48.146956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c83b9-4863-471d-92ed-692e653312f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.147237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c83b9-4863-471d-92ed-692e653312f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.147510 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c83b9-4863-471d-92ed-692e653312f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:48.148149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c83b9-4863-471d-92ed-692e653312f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:48.150315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c83b9-4863-471d-92ed-692e653312f2 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:48.292540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 762/1543] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:48 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:48.297892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8b029-f8de-48d8-b64d-e154ba291a31 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:48.313201 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8b029-f8de-48d8-b64d-e154ba291a31 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:48.399906 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6995fe-ca56-461a-a72e-33a8b57af463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:48.400579 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6995fe-ca56-461a-a72e-33a8b57af463 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.400866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6995fe-ca56-461a-a72e-33a8b57af463 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.401143 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6995fe-ca56-461a-a72e-33a8b57af463 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:48.401798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6995fe-ca56-461a-a72e-33a8b57af463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:48.404630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6995fe-ca56-461a-a72e-33a8b57af463 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:48.490969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 782/1544] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:48 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:48.495944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c83b9-4863-471d-92ed-692e653312f2 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:48.514436 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c83b9-4863-471d-92ed-692e653312f2 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:48.522950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2e89f-6caf-4070-9590-d67cbb546443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:48.523718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2e89f-6caf-4070-9590-d67cbb546443 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.524001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2e89f-6caf-4070-9590-d67cbb546443 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.524327 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2e89f-6caf-4070-9590-d67cbb546443 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:48.525006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2e89f-6caf-4070-9590-d67cbb546443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:48.527223 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2e89f-6caf-4070-9590-d67cbb546443 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:48.547576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 763/1545] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:48.553329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6995fe-ca56-461a-a72e-33a8b57af463 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:48.576034 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6995fe-ca56-461a-a72e-33a8b57af463 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:48.585520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c77294-12fb-4419-b5b4-41245312bcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:48.586215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c77294-12fb-4419-b5b4-41245312bcbf admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.586500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c77294-12fb-4419-b5b4-41245312bcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.587117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c77294-12fb-4419-b5b4-41245312bcbf admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:48.587811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c77294-12fb-4419-b5b4-41245312bcbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:48.589536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c77294-12fb-4419-b5b4-41245312bcbf admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:48.609634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 783/1546] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:48.614521 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2e89f-6caf-4070-9590-d67cbb546443 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:48.628036 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2e89f-6caf-4070-9590-d67cbb546443 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:48.639323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d539de-fef6-4a56-8669-d30432e2820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:48.640170 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d539de-fef6-4a56-8669-d30432e2820b admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.640697 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d539de-fef6-4a56-8669-d30432e2820b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.641041 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d539de-fef6-4a56-8669-d30432e2820b admin admin] PATH_INFO: `/v3/projects/9d9c8644b0f543559839e056773016ce/users/fbc534cfc37940579e8e508f8a037750/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:48.664880 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d539de-fef6-4a56-8669-d30432e2820b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9c8644b0f543559839e056773016ce, user_id=fbc534cfc37940579e8e508f8a037750, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:48.667613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d539de-fef6-4a56-8669-d30432e2820b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:48.726659 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3731422-9f7a-4606-af36-faf96354533f None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.727018 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3731422-9f7a-4606-af36-faf96354533f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.727235 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3731422-9f7a-4606-af36-faf96354533f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:48.744158 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 764/1547] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:48 2022] PUT /identity/v3/projects/9d9c8644b0f543559839e056773016ce/users/fbc534cfc37940579e8e508f8a037750/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:48.750908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630d0f-31b6-4523-9072-14ddbbdba7be None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.751231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630d0f-31b6-4523-9072-14ddbbdba7be None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.751463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630d0f-31b6-4523-9072-14ddbbdba7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:48.757350 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-e3731422-9f7a-4606-af36-faf96354533f None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:48.758774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e3731422-9f7a-4606-af36-faf96354533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:48.790865 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-98630d0f-31b6-4523-9072-14ddbbdba7be None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:48.792105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-98630d0f-31b6-4523-9072-14ddbbdba7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:48.877670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 784/1548] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:57:48.878878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390660ef-2de0-4da5-85c0-db6c91a8cfdb None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.885681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390660ef-2de0-4da5-85c0-db6c91a8cfdb None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.885989 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390660ef-2de0-4da5-85c0-db6c91a8cfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:48.915049 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 765/1549] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:57:48.915049 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9cd33-44aa-4683-85f6-04f5b2e7b6a2 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.915049 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9cd33-44aa-4683-85f6-04f5b2e7b6a2 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.915049 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9cd33-44aa-4683-85f6-04f5b2e7b6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:48.937399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-390660ef-2de0-4da5-85c0-db6c91a8cfdb None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:48.939332 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-390660ef-2de0-4da5-85c0-db6c91a8cfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:48.943773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-b8a9cd33-44aa-4683-85f6-04f5b2e7b6a2 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:48.944942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b8a9cd33-44aa-4683-85f6-04f5b2e7b6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:48.947742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 785/1550] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:48.948844 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101b470-b0f6-4337-8b86-e3941a1649f3 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.949131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101b470-b0f6-4337-8b86-e3941a1649f3 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.949410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101b470-b0f6-4337-8b86-e3941a1649f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:48.957556 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 766/1551] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:48.959246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72f6b6-d50d-4dde-be5e-9422cb37ff83 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.959533 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72f6b6-d50d-4dde-be5e-9422cb37ff83 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.959812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72f6b6-d50d-4dde-be5e-9422cb37ff83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:48.971732 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-4101b470-b0f6-4337-8b86-e3941a1649f3 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:48.973603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4101b470-b0f6-4337-8b86-e3941a1649f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:48.982879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 786/1552] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:48.983257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-0e72f6b6-d50d-4dde-be5e-9422cb37ff83 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:48.983948 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b017a7-ced8-466d-b40a-b3e8f4d19eab None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.984267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b017a7-ced8-466d-b40a-b3e8f4d19eab None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.984546 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b017a7-ced8-466d-b40a-b3e8f4d19eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:48.984684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0e72f6b6-d50d-4dde-be5e-9422cb37ff83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:48.994492 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 767/1553] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:49.000346 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72f6b6-d50d-4dde-be5e-9422cb37ff83 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.001419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0e72f6b6-d50d-4dde-be5e-9422cb37ff83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:49.006294 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-45b017a7-ced8-466d-b40a-b3e8f4d19eab None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:49.007515 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-45b017a7-ced8-466d-b40a-b3e8f4d19eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:49.016836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 787/1554] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:49.017927 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f886a-9b10-43cf-a964-a3d7da24d198 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.018219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f886a-9b10-43cf-a964-a3d7da24d198 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.018498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f886a-9b10-43cf-a964-a3d7da24d198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.038665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-e34f886a-9b10-43cf-a964-a3d7da24d198 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:49.039884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e34f886a-9b10-43cf-a964-a3d7da24d198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:49.049306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 788/1555] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:49.050309 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f8bbe-2ce9-47b5-85f7-187e31dbb8c5 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.050599 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f8bbe-2ce9-47b5-85f7-187e31dbb8c5 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.050876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f8bbe-2ce9-47b5-85f7-187e31dbb8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.067386 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72f6b6-d50d-4dde-be5e-9422cb37ff83 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.071423 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6788a3c-b23d-4320-92ba-4bc3f99a490b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.072048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6788a3c-b23d-4320-92ba-4bc3f99a490b service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.072367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6788a3c-b23d-4320-92ba-4bc3f99a490b service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.072647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6788a3c-b23d-4320-92ba-4bc3f99a490b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.075937 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-a01f8bbe-2ce9-47b5-85f7-187e31dbb8c5 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:49.077162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a01f8bbe-2ce9-47b5-85f7-187e31dbb8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:49.082302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6788a3c-b23d-4320-92ba-4bc3f99a490b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.083751 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6788a3c-b23d-4320-92ba-4bc3f99a490b service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.085299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 789/1556] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:49.089547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342dc6b-ff7b-4e01-819c-cb5376e486c3 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.089833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342dc6b-ff7b-4e01-819c-cb5376e486c3 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.090110 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342dc6b-ff7b-4e01-819c-cb5376e486c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.094402 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 768/1557] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:49.095236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6788a3c-b23d-4320-92ba-4bc3f99a490b service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.104795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6788a3c-b23d-4320-92ba-4bc3f99a490b service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.110376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80152cf3-4dff-43c1-9410-f4776089a55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.110996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80152cf3-4dff-43c1-9410-f4776089a55f admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.111275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80152cf3-4dff-43c1-9410-f4776089a55f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.111550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80152cf3-4dff-43c1-9410-f4776089a55f admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.112278 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80152cf3-4dff-43c1-9410-f4776089a55f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:57:49.112671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80152cf3-4dff-43c1-9410-f4776089a55f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.113692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: WARNING py.warnings [None req-80152cf3-4dff-43c1-9410-f4776089a55f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:57:49.113692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: warnings.warn(msg) Aug 29 22:57:49.113692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: Aug 29 22:57:49.114098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-d342dc6b-ff7b-4e01-819c-cb5376e486c3 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:49.114580 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80152cf3-4dff-43c1-9410-f4776089a55f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.115326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d342dc6b-ff7b-4e01-819c-cb5376e486c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:49.125053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 790/1558] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:49.126387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620534b2-4d3e-476e-924f-b780d826bd12 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.126680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620534b2-4d3e-476e-924f-b780d826bd12 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.126955 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620534b2-4d3e-476e-924f-b780d826bd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.131591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 769/1559] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:57:49.132776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760e619-402c-48b0-bc94-861cc844f9d6 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.133074 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760e619-402c-48b0-bc94-861cc844f9d6 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.133356 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760e619-402c-48b0-bc94-861cc844f9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.143413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:49.150762 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-620534b2-4d3e-476e-924f-b780d826bd12 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:49.150762 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-620534b2-4d3e-476e-924f-b780d826bd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:49.154854 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-d760e619-402c-48b0-bc94-861cc844f9d6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:49.156040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d760e619-402c-48b0-bc94-861cc844f9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:49.158381 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 791/1560] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:49.159647 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d490d-6fce-49a4-b8f3-df347de5a038 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.159980 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d490d-6fce-49a4-b8f3-df347de5a038 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.160286 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d490d-6fce-49a4-b8f3-df347de5a038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.165257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 770/1561] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:49.166685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba3f3d-80e4-4641-a596-c7a531a9aa4d None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.166972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba3f3d-80e4-4641-a596-c7a531a9aa4d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.167253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba3f3d-80e4-4641-a596-c7a531a9aa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.180556 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-573d490d-6fce-49a4-b8f3-df347de5a038 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:49.181755 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-573d490d-6fce-49a4-b8f3-df347de5a038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:49.190849 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-2eba3f3d-80e4-4641-a596-c7a531a9aa4d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:49.191023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 792/1562] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:49.191475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d490d-6fce-49a4-b8f3-df347de5a038 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.191876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2eba3f3d-80e4-4641-a596-c7a531a9aa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:49.200465 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 771/1563] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:49.201201 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba3f3d-80e4-4641-a596-c7a531a9aa4d None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.201727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d490d-6fce-49a4-b8f3-df347de5a038 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.206780 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3138fd-2a52-43df-9edb-7e0a84f1b8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.207393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3138fd-2a52-43df-9edb-7e0a84f1b8cb admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.207667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3138fd-2a52-43df-9edb-7e0a84f1b8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.207941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3138fd-2a52-43df-9edb-7e0a84f1b8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.208696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3138fd-2a52-43df-9edb-7e0a84f1b8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:57:49.209003 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3138fd-2a52-43df-9edb-7e0a84f1b8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.214021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3138fd-2a52-43df-9edb-7e0a84f1b8cb admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.214300 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba3f3d-80e4-4641-a596-c7a531a9aa4d None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.214399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:49.217225 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22db850-fe6b-443b-bbda-5d4da5567287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.217869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22db850-fe6b-443b-bbda-5d4da5567287 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.218151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22db850-fe6b-443b-bbda-5d4da5567287 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.218429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22db850-fe6b-443b-bbda-5d4da5567287 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.219101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22db850-fe6b-443b-bbda-5d4da5567287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:57:49.219395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22db850-fe6b-443b-bbda-5d4da5567287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.221036 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22db850-fe6b-443b-bbda-5d4da5567287 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.223925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 793/1564] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:57:49.229208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3138fd-2a52-43df-9edb-7e0a84f1b8cb admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.242454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 772/1565] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:57:49.242454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22db850-fe6b-443b-bbda-5d4da5567287 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.244378 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3138fd-2a52-43df-9edb-7e0a84f1b8cb admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.249844 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c21c31-3168-40bd-a3e7-031c789d25cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.250578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c21c31-3168-40bd-a3e7-031c789d25cd admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.250824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c21c31-3168-40bd-a3e7-031c789d25cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.251082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c21c31-3168-40bd-a3e7-031c789d25cd admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.251774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c21c31-3168-40bd-a3e7-031c789d25cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.252814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: WARNING py.warnings [None req-f2c21c31-3168-40bd-a3e7-031c789d25cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:57:49.252814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: warnings.warn(msg) Aug 29 22:57:49.252814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: Aug 29 22:57:49.254021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c21c31-3168-40bd-a3e7-031c789d25cd admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.254778 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22db850-fe6b-443b-bbda-5d4da5567287 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.259557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54357820-a16b-4fb2-9aa8-89512d65ea2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.262969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54357820-a16b-4fb2-9aa8-89512d65ea2f admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.262969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54357820-a16b-4fb2-9aa8-89512d65ea2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.262969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54357820-a16b-4fb2-9aa8-89512d65ea2f admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.262969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54357820-a16b-4fb2-9aa8-89512d65ea2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:57:49.262969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54357820-a16b-4fb2-9aa8-89512d65ea2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.263918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54357820-a16b-4fb2-9aa8-89512d65ea2f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.276742 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 773/1566] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:57:49.278053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6d0e2-5e85-46a9-aaa2-9234a622790a None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.278334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6d0e2-5e85-46a9-aaa2-9234a622790a None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.278721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6d0e2-5e85-46a9-aaa2-9234a622790a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.298719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-d7b6d0e2-5e85-46a9-aaa2-9234a622790a None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:49.299981 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d7b6d0e2-5e85-46a9-aaa2-9234a622790a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:49.308710 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 774/1567] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:49.309942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6d0e2-5e85-46a9-aaa2-9234a622790a None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.319367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6d0e2-5e85-46a9-aaa2-9234a622790a None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.326106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873c359-161e-49fa-bb29-e5f989ed6ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.326732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873c359-161e-49fa-bb29-e5f989ed6ade admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.327203 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873c359-161e-49fa-bb29-e5f989ed6ade admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.327326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873c359-161e-49fa-bb29-e5f989ed6ade admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.328222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873c359-161e-49fa-bb29-e5f989ed6ade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:57:49.328222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873c359-161e-49fa-bb29-e5f989ed6ade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.329842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873c359-161e-49fa-bb29-e5f989ed6ade admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.343112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 775/1568] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:57:49.346198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873c359-161e-49fa-bb29-e5f989ed6ade admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.347415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 794/1569] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:49.348139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c21c31-3168-40bd-a3e7-031c789d25cd admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.358006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873c359-161e-49fa-bb29-e5f989ed6ade admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.434925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ab304-cc93-4d1f-8bcf-2f542fd1915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.435241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c21c31-3168-40bd-a3e7-031c789d25cd admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.436433 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ab304-cc93-4d1f-8bcf-2f542fd1915b admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.436937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ab304-cc93-4d1f-8bcf-2f542fd1915b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.437394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ab304-cc93-4d1f-8bcf-2f542fd1915b admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.438351 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ab304-cc93-4d1f-8bcf-2f542fd1915b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:57:49.438840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ab304-cc93-4d1f-8bcf-2f542fd1915b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.440807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ab304-cc93-4d1f-8bcf-2f542fd1915b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.447420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957bc3a-b615-4d80-95ac-2bdc187644be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.448047 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957bc3a-b615-4d80-95ac-2bdc187644be admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.448437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957bc3a-b615-4d80-95ac-2bdc187644be admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.448710 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957bc3a-b615-4d80-95ac-2bdc187644be admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.449406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957bc3a-b615-4d80-95ac-2bdc187644be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.452161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957bc3a-b615-4d80-95ac-2bdc187644be admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.459491 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 776/1570] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:57:49.468250 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ab304-cc93-4d1f-8bcf-2f542fd1915b admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.472681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ab304-cc93-4d1f-8bcf-2f542fd1915b admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.479284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f17ee-728c-41a1-b80a-0de52d3a67ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.480006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f17ee-728c-41a1-b80a-0de52d3a67ea admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.480166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f17ee-728c-41a1-b80a-0de52d3a67ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.480595 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f17ee-728c-41a1-b80a-0de52d3a67ea admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.481905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f17ee-728c-41a1-b80a-0de52d3a67ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.483995 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f17ee-728c-41a1-b80a-0de52d3a67ea admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.571313 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 795/1571] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/projects => generated 379 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:49.576755 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957bc3a-b615-4d80-95ac-2bdc187644be admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.627925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 777/1572] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:49.628811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f17ee-728c-41a1-b80a-0de52d3a67ea admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.645399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957bc3a-b615-4d80-95ac-2bdc187644be admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.716625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e77a34-ad4e-4186-92bc-6872e423c7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.717544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e77a34-ad4e-4186-92bc-6872e423c7c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.717832 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e77a34-ad4e-4186-92bc-6872e423c7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.718103 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e77a34-ad4e-4186-92bc-6872e423c7c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.718751 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e77a34-ad4e-4186-92bc-6872e423c7c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.720714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e77a34-ad4e-4186-92bc-6872e423c7c1 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.722862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f17ee-728c-41a1-b80a-0de52d3a67ea admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.728837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92a060-38e4-4886-9dc1-407360aa7576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.729565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a060-38e4-4886-9dc1-407360aa7576 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.729909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a060-38e4-4886-9dc1-407360aa7576 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.730261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a060-38e4-4886-9dc1-407360aa7576 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.731146 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92a060-38e4-4886-9dc1-407360aa7576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:57:49.732281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92a060-38e4-4886-9dc1-407360aa7576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.733036 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:49.733562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92a060-38e4-4886-9dc1-407360aa7576 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.748663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 778/1573] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:57:49.755480 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92a060-38e4-4886-9dc1-407360aa7576 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.767412 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92a060-38e4-4886-9dc1-407360aa7576 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.772134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7483f5-721f-4e3f-8a56-a1802feb552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.772763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7483f5-721f-4e3f-8a56-a1802feb552b admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.773044 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7483f5-721f-4e3f-8a56-a1802feb552b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.773322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7483f5-721f-4e3f-8a56-a1802feb552b admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.774027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7483f5-721f-4e3f-8a56-a1802feb552b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.775069 dv-cinder-854271-4-smb devstack@keystone.service[88553]: WARNING py.warnings [None req-6a7483f5-721f-4e3f-8a56-a1802feb552b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:57:49.775069 dv-cinder-854271-4-smb devstack@keystone.service[88553]: warnings.warn(msg) Aug 29 22:57:49.775069 dv-cinder-854271-4-smb devstack@keystone.service[88553]: Aug 29 22:57:49.776294 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7483f5-721f-4e3f-8a56-a1802feb552b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.787981 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:49.801052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 796/1574] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:49.802975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e77a34-ad4e-4186-92bc-6872e423c7c1 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.870053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e77a34-ad4e-4186-92bc-6872e423c7c1 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.876312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6536984-d0a2-4207-bee1-ea2e87e1a12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.877125 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6536984-d0a2-4207-bee1-ea2e87e1a12f admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.877408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6536984-d0a2-4207-bee1-ea2e87e1a12f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.877692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6536984-d0a2-4207-bee1-ea2e87e1a12f admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.878340 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6536984-d0a2-4207-bee1-ea2e87e1a12f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.880294 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6536984-d0a2-4207-bee1-ea2e87e1a12f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.904333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 779/1575] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:49.904333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7483f5-721f-4e3f-8a56-a1802feb552b admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.915942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7483f5-721f-4e3f-8a56-a1802feb552b admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.922504 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64429-6005-42f6-b66a-b34659d6d177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.923164 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64429-6005-42f6-b66a-b34659d6d177 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.926669 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64429-6005-42f6-b66a-b34659d6d177 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.926669 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64429-6005-42f6-b66a-b34659d6d177 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.926669 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d64429-6005-42f6-b66a-b34659d6d177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.926669 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d64429-6005-42f6-b66a-b34659d6d177 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.983162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 797/1576] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:49.984251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6536984-d0a2-4207-bee1-ea2e87e1a12f admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.042159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 780/1577] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/projects => generated 389 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:50.042159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64429-6005-42f6-b66a-b34659d6d177 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.058502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6536984-d0a2-4207-bee1-ea2e87e1a12f admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.111706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64429-6005-42f6-b66a-b34659d6d177 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.116715 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a65982-b0ac-4cfa-a321-0aa513f7a12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.117362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a65982-b0ac-4cfa-a321-0aa513f7a12b admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.117641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a65982-b0ac-4cfa-a321-0aa513f7a12b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.117915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a65982-b0ac-4cfa-a321-0aa513f7a12b admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.118161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09008c-6ca8-4864-9402-d8a40a826e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.118586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a65982-b0ac-4cfa-a321-0aa513f7a12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.118786 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09008c-6ca8-4864-9402-d8a40a826e0c admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.119059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09008c-6ca8-4864-9402-d8a40a826e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.119332 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09008c-6ca8-4864-9402-d8a40a826e0c admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.119965 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09008c-6ca8-4864-9402-d8a40a826e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.120557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a65982-b0ac-4cfa-a321-0aa513f7a12b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.122125 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09008c-6ca8-4864-9402-d8a40a826e0c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.234416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 781/1578] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:50 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:50.234416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a65982-b0ac-4cfa-a321-0aa513f7a12b admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.243409 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a65982-b0ac-4cfa-a321-0aa513f7a12b admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.248567 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b369a-1e6b-46d7-a0fb-a5a6c8859c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.249168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b369a-1e6b-46d7-a0fb-a5a6c8859c73 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.249449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b369a-1e6b-46d7-a0fb-a5a6c8859c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.249721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b369a-1e6b-46d7-a0fb-a5a6c8859c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.250351 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b369a-1e6b-46d7-a0fb-a5a6c8859c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.252330 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b369a-1e6b-46d7-a0fb-a5a6c8859c73 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.257052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 798/1579] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:49 2022] POST /identity/v3/users => generated 290 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:50.264793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09008c-6ca8-4864-9402-d8a40a826e0c admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.270392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09008c-6ca8-4864-9402-d8a40a826e0c admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.275808 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb729d-8e64-4733-9881-e2e8c4bcf692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.276534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb729d-8e64-4733-9881-e2e8c4bcf692 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.276884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb729d-8e64-4733-9881-e2e8c4bcf692 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.277165 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb729d-8e64-4733-9881-e2e8c4bcf692 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.278410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb729d-8e64-4733-9881-e2e8c4bcf692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.280370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb729d-8e64-4733-9881-e2e8c4bcf692 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.290450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:50.341404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 782/1580] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:50 2022] POST /identity/v3/projects => generated 393 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:50.342303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b369a-1e6b-46d7-a0fb-a5a6c8859c73 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.397851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 799/1581] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:50 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:50.398854 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb729d-8e64-4733-9881-e2e8c4bcf692 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.409885 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb729d-8e64-4733-9881-e2e8c4bcf692 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.410113 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b369a-1e6b-46d7-a0fb-a5a6c8859c73 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.414748 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055fd68-3656-4592-bd04-b149b2390207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.416792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d1413-5935-4d33-bf4f-8ea04554b1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.416941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055fd68-3656-4592-bd04-b149b2390207 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.417075 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d1413-5935-4d33-bf4f-8ea04554b1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.417161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055fd68-3656-4592-bd04-b149b2390207 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.417257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d1413-5935-4d33-bf4f-8ea04554b1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.417341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055fd68-3656-4592-bd04-b149b2390207 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.417416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d1413-5935-4d33-bf4f-8ea04554b1b2 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.417495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055fd68-3656-4592-bd04-b149b2390207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.417614 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d1413-5935-4d33-bf4f-8ea04554b1b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.418133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055fd68-3656-4592-bd04-b149b2390207 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.419090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d1413-5935-4d33-bf4f-8ea04554b1b2 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.430366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 783/1582] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:50.433132 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055fd68-3656-4592-bd04-b149b2390207 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.445860 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055fd68-3656-4592-bd04-b149b2390207 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.452569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8ea46-9c64-451b-a48f-0c6f1347bc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.453449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8ea46-9c64-451b-a48f-0c6f1347bc58 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.453733 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8ea46-9c64-451b-a48f-0c6f1347bc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.454005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8ea46-9c64-451b-a48f-0c6f1347bc58 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.454644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8ea46-9c64-451b-a48f-0c6f1347bc58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.456648 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8ea46-9c64-451b-a48f-0c6f1347bc58 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.529173 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 800/1583] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:50 2022] POST /identity/v3/users => generated 283 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:50.530103 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d1413-5935-4d33-bf4f-8ea04554b1b2 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.540644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d1413-5935-4d33-bf4f-8ea04554b1b2 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.546635 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7555b4a-d87a-4400-bdd7-d1b24fb1a127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.547255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7555b4a-d87a-4400-bdd7-d1b24fb1a127 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.547533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7555b4a-d87a-4400-bdd7-d1b24fb1a127 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.547804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7555b4a-d87a-4400-bdd7-d1b24fb1a127 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.548488 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7555b4a-d87a-4400-bdd7-d1b24fb1a127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.550525 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7555b4a-d87a-4400-bdd7-d1b24fb1a127 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.563298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 784/1584] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:50 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:50.563298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8ea46-9c64-451b-a48f-0c6f1347bc58 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.571386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 801/1585] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:50.571386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7555b4a-d87a-4400-bdd7-d1b24fb1a127 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.575135 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8ea46-9c64-451b-a48f-0c6f1347bc58 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.583362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7555b4a-d87a-4400-bdd7-d1b24fb1a127 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.589077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553970f-a3db-453e-8452-51215624eb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.589308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd561cee-7894-4b12-9435-737dba6ece72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.591972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553970f-a3db-453e-8452-51215624eb33 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.592125 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd561cee-7894-4b12-9435-737dba6ece72 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.592325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553970f-a3db-453e-8452-51215624eb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.592422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd561cee-7894-4b12-9435-737dba6ece72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.592524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553970f-a3db-453e-8452-51215624eb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.592631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd561cee-7894-4b12-9435-737dba6ece72 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.592727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553970f-a3db-453e-8452-51215624eb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.592828 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd561cee-7894-4b12-9435-737dba6ece72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.594012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553970f-a3db-453e-8452-51215624eb33 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.594897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd561cee-7894-4b12-9435-737dba6ece72 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.606389 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 785/1586] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:50.607911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553970f-a3db-453e-8452-51215624eb33 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.619264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553970f-a3db-453e-8452-51215624eb33 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.625760 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791a018-e0f3-49b3-a811-c11e69c0e2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.626448 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791a018-e0f3-49b3-a811-c11e69c0e2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.626790 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791a018-e0f3-49b3-a811-c11e69c0e2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.627139 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791a018-e0f3-49b3-a811-c11e69c0e2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.627834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791a018-e0f3-49b3-a811-c11e69c0e2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.629550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791a018-e0f3-49b3-a811-c11e69c0e2e0 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.631151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:50.641742 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 786/1587] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:50.642818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791a018-e0f3-49b3-a811-c11e69c0e2e0 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.653653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791a018-e0f3-49b3-a811-c11e69c0e2e0 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.658435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee52076-55fe-4bab-a731-c4147da0532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.659030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee52076-55fe-4bab-a731-c4147da0532d admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.659475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee52076-55fe-4bab-a731-c4147da0532d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.659749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee52076-55fe-4bab-a731-c4147da0532d admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.660420 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee52076-55fe-4bab-a731-c4147da0532d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.662054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee52076-55fe-4bab-a731-c4147da0532d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.675545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 787/1588] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:50.675545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee52076-55fe-4bab-a731-c4147da0532d admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.683446 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee52076-55fe-4bab-a731-c4147da0532d admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.689273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb49360-15a8-4047-89cb-feb2cb04bac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.689891 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb49360-15a8-4047-89cb-feb2cb04bac3 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.690168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb49360-15a8-4047-89cb-feb2cb04bac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.690440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb49360-15a8-4047-89cb-feb2cb04bac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.691083 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb49360-15a8-4047-89cb-feb2cb04bac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.692848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb49360-15a8-4047-89cb-feb2cb04bac3 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.705349 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 788/1589] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:50.706701 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb49360-15a8-4047-89cb-feb2cb04bac3 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.719055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb49360-15a8-4047-89cb-feb2cb04bac3 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.724221 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c76358-c13d-4ca3-bcd0-17f08b9b119a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.724844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c76358-c13d-4ca3-bcd0-17f08b9b119a admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.725112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c76358-c13d-4ca3-bcd0-17f08b9b119a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.725395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c76358-c13d-4ca3-bcd0-17f08b9b119a admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.726302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c76358-c13d-4ca3-bcd0-17f08b9b119a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.727641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c76358-c13d-4ca3-bcd0-17f08b9b119a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.738530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 789/1590] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:50.741765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c76358-c13d-4ca3-bcd0-17f08b9b119a admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.743321 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 802/1591] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:50 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:50.749738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd561cee-7894-4b12-9435-737dba6ece72 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.752716 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c76358-c13d-4ca3-bcd0-17f08b9b119a admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.757900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900acc94-5ba6-4cb1-a2f4-1a3d77e97abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.758537 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900acc94-5ba6-4cb1-a2f4-1a3d77e97abd admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.759277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900acc94-5ba6-4cb1-a2f4-1a3d77e97abd admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.759277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900acc94-5ba6-4cb1-a2f4-1a3d77e97abd admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.759877 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900acc94-5ba6-4cb1-a2f4-1a3d77e97abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.763461 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900acc94-5ba6-4cb1-a2f4-1a3d77e97abd admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.765854 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd561cee-7894-4b12-9435-737dba6ece72 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.773311 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742e6f0-e23a-4a88-91cc-fd24a058afee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.774475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742e6f0-e23a-4a88-91cc-fd24a058afee admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.774967 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742e6f0-e23a-4a88-91cc-fd24a058afee admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.775381 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 790/1592] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:50.776444 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900acc94-5ba6-4cb1-a2f4-1a3d77e97abd admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.779708 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742e6f0-e23a-4a88-91cc-fd24a058afee admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.780736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742e6f0-e23a-4a88-91cc-fd24a058afee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.782903 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742e6f0-e23a-4a88-91cc-fd24a058afee admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.789218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900acc94-5ba6-4cb1-a2f4-1a3d77e97abd admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.794436 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3663e-5f68-473a-bd52-1efc4bd92673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.795067 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3663e-5f68-473a-bd52-1efc4bd92673 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.795348 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3663e-5f68-473a-bd52-1efc4bd92673 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.795623 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3663e-5f68-473a-bd52-1efc4bd92673 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.796249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 803/1593] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:50.796364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3663e-5f68-473a-bd52-1efc4bd92673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.798032 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3663e-5f68-473a-bd52-1efc4bd92673 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.800045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742e6f0-e23a-4a88-91cc-fd24a058afee admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.813037 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742e6f0-e23a-4a88-91cc-fd24a058afee admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.814921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 791/1594] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:50.815796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3663e-5f68-473a-bd52-1efc4bd92673 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.818344 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cbc57-bef0-4fa2-9fe9-1b6972db9569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.822692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cbc57-bef0-4fa2-9fe9-1b6972db9569 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.822692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cbc57-bef0-4fa2-9fe9-1b6972db9569 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.822692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cbc57-bef0-4fa2-9fe9-1b6972db9569 admin admin] PATH_INFO: `/v3/projects/94e828a5db8540e4b59bddaa6007e03d/users/24dbd95c579d44cd8c95ca63669fca24/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.829316 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3663e-5f68-473a-bd52-1efc4bd92673 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.835026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c87be-3862-4f69-a7d6-6f2bef18e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.835745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c87be-3862-4f69-a7d6-6f2bef18e7cc admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.836105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c87be-3862-4f69-a7d6-6f2bef18e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.836489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c87be-3862-4f69-a7d6-6f2bef18e7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.837756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c87be-3862-4f69-a7d6-6f2bef18e7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.841312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c87be-3862-4f69-a7d6-6f2bef18e7cc admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.846664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cbc57-bef0-4fa2-9fe9-1b6972db9569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e828a5db8540e4b59bddaa6007e03d, user_id=24dbd95c579d44cd8c95ca63669fca24, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.850209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: WARNING py.warnings [None req-d75cbc57-bef0-4fa2-9fe9-1b6972db9569 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:57:50.850209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: warnings.warn(msg) Aug 29 22:57:50.850209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: Aug 29 22:57:50.854457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cbc57-bef0-4fa2-9fe9-1b6972db9569 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.860565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 792/1595] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:50.864952 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c87be-3862-4f69-a7d6-6f2bef18e7cc admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.877654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c87be-3862-4f69-a7d6-6f2bef18e7cc admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.882689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8d9a1-95d1-4694-8879-1db135626887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.883334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8d9a1-95d1-4694-8879-1db135626887 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.883620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8d9a1-95d1-4694-8879-1db135626887 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.883953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8d9a1-95d1-4694-8879-1db135626887 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.884652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8d9a1-95d1-4694-8879-1db135626887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.886345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8d9a1-95d1-4694-8879-1db135626887 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.898296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 793/1596] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:50.901957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8d9a1-95d1-4694-8879-1db135626887 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.912015 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8d9a1-95d1-4694-8879-1db135626887 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.918059 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4ff33-d096-424a-a755-47798b3b3d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.919013 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4ff33-d096-424a-a755-47798b3b3d32 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.919373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4ff33-d096-424a-a755-47798b3b3d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.919653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4ff33-d096-424a-a755-47798b3b3d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.920341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4ff33-d096-424a-a755-47798b3b3d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.921944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4ff33-d096-424a-a755-47798b3b3d32 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.932959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 804/1597] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:50 2022] PUT /identity/v3/projects/94e828a5db8540e4b59bddaa6007e03d/users/24dbd95c579d44cd8c95ca63669fca24/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:50.932959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cbc57-bef0-4fa2-9fe9-1b6972db9569 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.938439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 794/1598] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:50.939368 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4ff33-d096-424a-a755-47798b3b3d32 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.950141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4ff33-d096-424a-a755-47798b3b3d32 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:51.009847 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cbc57-bef0-4fa2-9fe9-1b6972db9569 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:51.016232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b9be1-fad5-4c58-b033-3fb1bfad5e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:51.016700 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9827bbe-5f37-4aee-86eb-c07f2271623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:51.016863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b9be1-fad5-4c58-b033-3fb1bfad5e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.017013 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b9be1-fad5-4c58-b033-3fb1bfad5e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.017308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b9be1-fad5-4c58-b033-3fb1bfad5e47 admin admin] PATH_INFO: `/v3/projects/5512afbfff474f508c981c3d4b282c72/users/d8be000ad55e4f868c72845c839b3788/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.017412 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9827bbe-5f37-4aee-86eb-c07f2271623e admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.017634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9827bbe-5f37-4aee-86eb-c07f2271623e admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.017901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9827bbe-5f37-4aee-86eb-c07f2271623e admin admin] PATH_INFO: `/v3/projects/e4d081ad209d4ab19fa7173a85a7bb8e/users/d8c798ecc0bd44c58e597c8859ccb777/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.034989 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b9be1-fad5-4c58-b033-3fb1bfad5e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5512afbfff474f508c981c3d4b282c72, user_id=d8be000ad55e4f868c72845c839b3788, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:51.035141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9827bbe-5f37-4aee-86eb-c07f2271623e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d081ad209d4ab19fa7173a85a7bb8e, user_id=d8c798ecc0bd44c58e597c8859ccb777, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:51.037806 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b9be1-fad5-4c58-b033-3fb1bfad5e47 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:51.038140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9827bbe-5f37-4aee-86eb-c07f2271623e admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:51.106694 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 795/1599] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:50 2022] PUT /identity/v3/projects/e4d081ad209d4ab19fa7173a85a7bb8e/users/d8c798ecc0bd44c58e597c8859ccb777/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:51.107690 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9827bbe-5f37-4aee-86eb-c07f2271623e admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:51.130045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 805/1600] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:50 2022] PUT /identity/v3/projects/5512afbfff474f508c981c3d4b282c72/users/d8be000ad55e4f868c72845c839b3788/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:51.143720 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b9be1-fad5-4c58-b033-3fb1bfad5e47 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:51.185489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:51.202707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9827bbe-5f37-4aee-86eb-c07f2271623e admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:51.222367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:51.229129 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b9be1-fad5-4c58-b033-3fb1bfad5e47 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:51.235805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58eb86-22fb-484b-bb49-789fca958692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:51.236965 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58eb86-22fb-484b-bb49-789fca958692 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.237392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58eb86-22fb-484b-bb49-789fca958692 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.237734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58eb86-22fb-484b-bb49-789fca958692 admin admin] PATH_INFO: `/v3/projects/033df2188b1b46fdaf017312574e1b8c/users/7691d2a2fde741f9a66293b24bd9299b/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.257675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58eb86-22fb-484b-bb49-789fca958692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033df2188b1b46fdaf017312574e1b8c, user_id=7691d2a2fde741f9a66293b24bd9299b, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:51.260719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58eb86-22fb-484b-bb49-789fca958692 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:51.274139 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3c18b-99b5-4195-a3b4-f25bd00f453d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:51.274817 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3c18b-99b5-4195-a3b4-f25bd00f453d admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.275658 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3c18b-99b5-4195-a3b4-f25bd00f453d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.275658 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3c18b-99b5-4195-a3b4-f25bd00f453d admin admin] PATH_INFO: `/v3/projects/ca5c16201afb471ab6e07f06e0231649/users/13a239f0c47c49e097b1b46a69245e6f/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.292206 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3c18b-99b5-4195-a3b4-f25bd00f453d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca5c16201afb471ab6e07f06e0231649, user_id=13a239f0c47c49e097b1b46a69245e6f, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:51.295897 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3c18b-99b5-4195-a3b4-f25bd00f453d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:51.379774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 806/1601] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:51 2022] PUT /identity/v3/projects/033df2188b1b46fdaf017312574e1b8c/users/7691d2a2fde741f9a66293b24bd9299b/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:51.381297 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58eb86-22fb-484b-bb49-789fca958692 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:51.398739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 796/1602] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:51 2022] PUT /identity/v3/projects/ca5c16201afb471ab6e07f06e0231649/users/13a239f0c47c49e097b1b46a69245e6f/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:51.403641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208fd9f-b4d8-4a48-9185-017a7c3def47 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.403641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208fd9f-b4d8-4a48-9185-017a7c3def47 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.403641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208fd9f-b4d8-4a48-9185-017a7c3def47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.438233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-0208fd9f-b4d8-4a48-9185-017a7c3def47 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:51.439539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0208fd9f-b4d8-4a48-9185-017a7c3def47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:51.498341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58eb86-22fb-484b-bb49-789fca958692 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:51.513175 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 797/1603] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:51.514637 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208fd9f-b4d8-4a48-9185-017a7c3def47 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:51.526831 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208fd9f-b4d8-4a48-9185-017a7c3def47 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:51.533119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47acb5-6c50-486b-9a73-839a4371d415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:51.535409 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47acb5-6c50-486b-9a73-839a4371d415 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.535409 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47acb5-6c50-486b-9a73-839a4371d415 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.535409 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47acb5-6c50-486b-9a73-839a4371d415 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.535409 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47acb5-6c50-486b-9a73-839a4371d415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:51.537110 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47acb5-6c50-486b-9a73-839a4371d415 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:51.552276 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 798/1604] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:51.553679 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6260fef-b046-4396-b79d-2c731fdc0a68 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.553965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6260fef-b046-4396-b79d-2c731fdc0a68 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.554268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6260fef-b046-4396-b79d-2c731fdc0a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.588227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-f6260fef-b046-4396-b79d-2c731fdc0a68 None None] MFA Rules not processed for user `d8c798ecc0bd44c58e597c8859ccb777`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:51.589584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f6260fef-b046-4396-b79d-2c731fdc0a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:51.594013 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e35891-3787-45c9-b4ec-e227fb21b038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:51.594682 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e35891-3787-45c9-b4ec-e227fb21b038 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.595414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e35891-3787-45c9-b4ec-e227fb21b038 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.595414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e35891-3787-45c9-b4ec-e227fb21b038 admin admin] PATH_INFO: `/v3/projects/00847a5fa63d48fb978c5594aa89d174/users/12245620ca0e4579890a93e4492e4fc0/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.704030 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e35891-3787-45c9-b4ec-e227fb21b038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00847a5fa63d48fb978c5594aa89d174, user_id=12245620ca0e4579890a93e4492e4fc0, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:51.704030 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e35891-3787-45c9-b4ec-e227fb21b038 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:51.705255 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:51.708696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 799/1605] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:51.711885 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 807/1606] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:51 2022] PUT /identity/v3/projects/00847a5fa63d48fb978c5594aa89d174/users/12245620ca0e4579890a93e4492e4fc0/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:51.711885 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69e32c-5609-450c-97f4-794a98a11f8b None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.712481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69e32c-5609-450c-97f4-794a98a11f8b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.712564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6257225-a293-4aa8-a02b-73ef2c856925 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.712653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6257225-a293-4aa8-a02b-73ef2c856925 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.712728 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69e32c-5609-450c-97f4-794a98a11f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.712904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6257225-a293-4aa8-a02b-73ef2c856925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.760314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-9d69e32c-5609-450c-97f4-794a98a11f8b None None] MFA Rules not processed for user `7691d2a2fde741f9a66293b24bd9299b`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:51.760573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-f6257225-a293-4aa8-a02b-73ef2c856925 None None] MFA Rules not processed for user `d8be000ad55e4f868c72845c839b3788`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:51.761633 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f6257225-a293-4aa8-a02b-73ef2c856925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:51.762197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-9d69e32c-5609-450c-97f4-794a98a11f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:51.848454 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:51.860458 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 800/1607] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:51.860649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 808/1608] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:51.860649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb659020-d901-4c3b-bfcc-51cceac3be2c None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.860649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb659020-d901-4c3b-bfcc-51cceac3be2c None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.860649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb659020-d901-4c3b-bfcc-51cceac3be2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.868028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6257225-a293-4aa8-a02b-73ef2c856925 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:51.910687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-fb659020-d901-4c3b-bfcc-51cceac3be2c None None] MFA Rules not processed for user `13a239f0c47c49e097b1b46a69245e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:51.911941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-fb659020-d901-4c3b-bfcc-51cceac3be2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:51.947445 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6257225-a293-4aa8-a02b-73ef2c856925 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:51.952561 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f5212-385f-483a-893b-e5e65865ff03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:51.953253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f5212-385f-483a-893b-e5e65865ff03 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.953531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f5212-385f-483a-893b-e5e65865ff03 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.953793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f5212-385f-483a-893b-e5e65865ff03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.994611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 809/1609] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:51.999608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb659020-d901-4c3b-bfcc-51cceac3be2c None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:52.031181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f5212-385f-483a-893b-e5e65865ff03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:52.032767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f5212-385f-483a-893b-e5e65865ff03 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:52.043938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 801/1610] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:52.044956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f5212-385f-483a-893b-e5e65865ff03 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:52.055301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f5212-385f-483a-893b-e5e65865ff03 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:52.061484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12386869-6cf4-4fa4-925f-53f6d4f02985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:52.062108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12386869-6cf4-4fa4-925f-53f6d4f02985 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:52.062717 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12386869-6cf4-4fa4-925f-53f6d4f02985 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:52.062717 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12386869-6cf4-4fa4-925f-53f6d4f02985 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:52.063299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12386869-6cf4-4fa4-925f-53f6d4f02985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:52.067174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12386869-6cf4-4fa4-925f-53f6d4f02985 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:52.103684 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb659020-d901-4c3b-bfcc-51cceac3be2c None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:52.110545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dcf18-d3d6-4bdc-b5b4-c39e2e60c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:52.111447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dcf18-d3d6-4bdc-b5b4-c39e2e60c89d admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:52.111934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dcf18-d3d6-4bdc-b5b4-c39e2e60c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:52.112396 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dcf18-d3d6-4bdc-b5b4-c39e2e60c89d admin admin] PATH_INFO: `/v3/projects/269e950862de4817b49d3db302f89d35/users/c50a3ef2f80040f9a4372568ee984096/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:52.130094 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63dcf18-d3d6-4bdc-b5b4-c39e2e60c89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=269e950862de4817b49d3db302f89d35, user_id=c50a3ef2f80040f9a4372568ee984096, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:52.133081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63dcf18-d3d6-4bdc-b5b4-c39e2e60c89d admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:52.162081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 802/1611] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:52 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:52.163424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618416a-32eb-4a2e-b6ab-e0b766249562 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:52.163824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618416a-32eb-4a2e-b6ab-e0b766249562 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:52.164258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618416a-32eb-4a2e-b6ab-e0b766249562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:52.192177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-b618416a-32eb-4a2e-b6ab-e0b766249562 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:52.193656 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b618416a-32eb-4a2e-b6ab-e0b766249562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:52.210148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 810/1612] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:51 2022] PUT /identity/v3/projects/269e950862de4817b49d3db302f89d35/users/c50a3ef2f80040f9a4372568ee984096/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:52.212466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dcf18-d3d6-4bdc-b5b4-c39e2e60c89d admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:52.231902 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:52.304495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 803/1613] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:52.305850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15fc63-6347-4eb9-8c4f-a5a3433186fa None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:52.306128 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15fc63-6347-4eb9-8c4f-a5a3433186fa None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:52.306454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15fc63-6347-4eb9-8c4f-a5a3433186fa None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:52.314025 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 804/1614] 10.222.0.72 () {54 vars in 962 bytes} [Mon Aug 29 22:57:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:57:52.314971 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15fc63-6347-4eb9-8c4f-a5a3433186fa None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:52.323212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dcf18-d3d6-4bdc-b5b4-c39e2e60c89d admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:52.334688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232a7a1-16ca-494f-ba07-fe2bd0c2dc80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:52.335964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232a7a1-16ca-494f-ba07-fe2bd0c2dc80 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:52.336429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232a7a1-16ca-494f-ba07-fe2bd0c2dc80 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:52.336716 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232a7a1-16ca-494f-ba07-fe2bd0c2dc80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:52.399053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:52.410404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15fc63-6347-4eb9-8c4f-a5a3433186fa None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:52.419105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc43ba2-67f4-4051-b85c-351d726920ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:52.419817 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc43ba2-67f4-4051-b85c-351d726920ee admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:52.420101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc43ba2-67f4-4051-b85c-351d726920ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:52.420445 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc43ba2-67f4-4051-b85c-351d726920ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:52.421107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc43ba2-67f4-4051-b85c-351d726920ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:52.423914 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc43ba2-67f4-4051-b85c-351d726920ee admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:52.459138 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232a7a1-16ca-494f-ba07-fe2bd0c2dc80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:52.460642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232a7a1-16ca-494f-ba07-fe2bd0c2dc80 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:52.486970 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 811/1615] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:52.488488 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232a7a1-16ca-494f-ba07-fe2bd0c2dc80 service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:52.533886 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 805/1616] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:52 2022] POST /identity/v3/projects => generated 387 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:52.538424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167cd02-44e3-40e0-87a4-49c126e68e55 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:52.538702 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167cd02-44e3-40e0-87a4-49c126e68e55 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:52.539076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167cd02-44e3-40e0-87a4-49c126e68e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:52.546241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232a7a1-16ca-494f-ba07-fe2bd0c2dc80 service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:52.598163 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-e167cd02-44e3-40e0-87a4-49c126e68e55 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:52.598995 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e167cd02-44e3-40e0-87a4-49c126e68e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:52.670738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3c2b5-360d-4d96-aad6-9dc087a993cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:52.672132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3c2b5-360d-4d96-aad6-9dc087a993cf admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:52.672832 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3c2b5-360d-4d96-aad6-9dc087a993cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:52.673269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3c2b5-360d-4d96-aad6-9dc087a993cf admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:52.675002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3c2b5-360d-4d96-aad6-9dc087a993cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:52.678088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3c2b5-360d-4d96-aad6-9dc087a993cf admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:52.706306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 806/1617] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:52.707738 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42634ae-b6c7-4031-ac58-d9f864bfaa63 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:52.710943 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42634ae-b6c7-4031-ac58-d9f864bfaa63 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:52.710943 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42634ae-b6c7-4031-ac58-d9f864bfaa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:52.797207 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-d42634ae-b6c7-4031-ac58-d9f864bfaa63 None None] MFA Rules not processed for user `0be09bd9ba7443aaa31879f56ca4aad1`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:52.797207 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d42634ae-b6c7-4031-ac58-d9f864bfaa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:52.822169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 812/1618] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:52 2022] POST /identity/v3/users => generated 296 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:52.831678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3c2b5-360d-4d96-aad6-9dc087a993cf admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:52.887682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:52.968812 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3c2b5-360d-4d96-aad6-9dc087a993cf admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:52.981859 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502db874-5401-4c91-a08a-59047702280b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:52.988722 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502db874-5401-4c91-a08a-59047702280b service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:52.988722 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502db874-5401-4c91-a08a-59047702280b service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:52.988722 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502db874-5401-4c91-a08a-59047702280b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:52.998068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 807/1619] 10.222.0.72 () {58 vars in 1059 bytes} [Mon Aug 29 22:57:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:52.999449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42634ae-b6c7-4031-ac58-d9f864bfaa63 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.002306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502db874-5401-4c91-a08a-59047702280b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.004052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502db874-5401-4c91-a08a-59047702280b service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.019070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 813/1620] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:53.020401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502db874-5401-4c91-a08a-59047702280b service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.025127 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42634ae-b6c7-4031-ac58-d9f864bfaa63 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.032762 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502db874-5401-4c91-a08a-59047702280b service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.038143 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592d468-be7a-4a7f-be7c-25141fc384b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.038889 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592d468-be7a-4a7f-be7c-25141fc384b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.039180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4ba0c-904f-42cd-8546-31d55c968023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.039326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592d468-be7a-4a7f-be7c-25141fc384b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.039649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592d468-be7a-4a7f-be7c-25141fc384b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.039808 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4ba0c-904f-42cd-8546-31d55c968023 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.040265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4ba0c-904f-42cd-8546-31d55c968023 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.040877 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4ba0c-904f-42cd-8546-31d55c968023 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.041780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4ba0c-904f-42cd-8546-31d55c968023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.047925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4ba0c-904f-42cd-8546-31d55c968023 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.054997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592d468-be7a-4a7f-be7c-25141fc384b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.056753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592d468-be7a-4a7f-be7c-25141fc384b2 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.069270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 814/1621] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:53.070529 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592d468-be7a-4a7f-be7c-25141fc384b2 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.101980 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592d468-be7a-4a7f-be7c-25141fc384b2 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.115909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9689f-7da4-4603-bdaa-3c64c2a5461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.117052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9689f-7da4-4603-bdaa-3c64c2a5461d admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.117310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9689f-7da4-4603-bdaa-3c64c2a5461d admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.117675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9689f-7da4-4603-bdaa-3c64c2a5461d admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.119031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9689f-7da4-4603-bdaa-3c64c2a5461d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.121098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9689f-7da4-4603-bdaa-3c64c2a5461d admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.136622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 815/1622] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:53.137756 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9689f-7da4-4603-bdaa-3c64c2a5461d admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.155840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9689f-7da4-4603-bdaa-3c64c2a5461d admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.164287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b30c12-6ce3-49e9-9bcc-0ed89321a829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.165478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b30c12-6ce3-49e9-9bcc-0ed89321a829 service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.165903 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b30c12-6ce3-49e9-9bcc-0ed89321a829 service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.166258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b30c12-6ce3-49e9-9bcc-0ed89321a829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.219169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:53.234215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 808/1623] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:52 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:53.234215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4ba0c-904f-42cd-8546-31d55c968023 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.269588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4ba0c-904f-42cd-8546-31d55c968023 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.284036 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8239a-8088-4039-8f1b-7a8859bef23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.284765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8239a-8088-4039-8f1b-7a8859bef23f admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.285048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8239a-8088-4039-8f1b-7a8859bef23f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.285321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8239a-8088-4039-8f1b-7a8859bef23f admin admin] PATH_INFO: `/v3/projects/f90009890aff47f992e58ace947886d4/users/e0f7ca399464427b8c6ed5c3c38e60e9/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.298356 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b30c12-6ce3-49e9-9bcc-0ed89321a829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.301983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b30c12-6ce3-49e9-9bcc-0ed89321a829 service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.320871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8239a-8088-4039-8f1b-7a8859bef23f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90009890aff47f992e58ace947886d4, user_id=e0f7ca399464427b8c6ed5c3c38e60e9, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.323481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8239a-8088-4039-8f1b-7a8859bef23f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.331827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 816/1624] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:53.333392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b30c12-6ce3-49e9-9bcc-0ed89321a829 service nova] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.363659 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b30c12-6ce3-49e9-9bcc-0ed89321a829 service nova] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.376269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05c7f1-7dca-4bfe-a446-3eba35390941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.376997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05c7f1-7dca-4bfe-a446-3eba35390941 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.377400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05c7f1-7dca-4bfe-a446-3eba35390941 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.377824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05c7f1-7dca-4bfe-a446-3eba35390941 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.380945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05c7f1-7dca-4bfe-a446-3eba35390941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.383891 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05c7f1-7dca-4bfe-a446-3eba35390941 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.412490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 817/1625] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:53.416461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05c7f1-7dca-4bfe-a446-3eba35390941 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.450865 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05c7f1-7dca-4bfe-a446-3eba35390941 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.460753 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 809/1626] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:53 2022] PUT /identity/v3/projects/f90009890aff47f992e58ace947886d4/users/e0f7ca399464427b8c6ed5c3c38e60e9/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:53.462759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a742f-e8db-4e91-8adb-2fac856575ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.463746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a742f-e8db-4e91-8adb-2fac856575ef admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.464365 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8239a-8088-4039-8f1b-7a8859bef23f admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.464777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a742f-e8db-4e91-8adb-2fac856575ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.465991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a742f-e8db-4e91-8adb-2fac856575ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.468948 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a742f-e8db-4e91-8adb-2fac856575ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.471364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a742f-e8db-4e91-8adb-2fac856575ef admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.486390 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 818/1627] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:53.495926 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a742f-e8db-4e91-8adb-2fac856575ef admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.523212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a742f-e8db-4e91-8adb-2fac856575ef admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.687880 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa4737-53fb-46d4-9af5-3e3d1c4a6f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.688875 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa4737-53fb-46d4-9af5-3e3d1c4a6f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.689170 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa4737-53fb-46d4-9af5-3e3d1c4a6f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.689452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa4737-53fb-46d4-9af5-3e3d1c4a6f3c admin admin] PATH_INFO: `/v3/projects/27dbcb9d05a74745891bc339fba3f440/users/aa2402a9a7c648f889a1f94eded83bec/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.927006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8239a-8088-4039-8f1b-7a8859bef23f admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.928408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa4737-53fb-46d4-9af5-3e3d1c4a6f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27dbcb9d05a74745891bc339fba3f440, user_id=aa2402a9a7c648f889a1f94eded83bec, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.928956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b752fb7-4f48-4371-9451-6293c4c8683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.928956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b752fb7-4f48-4371-9451-6293c4c8683b admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.928956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b752fb7-4f48-4371-9451-6293c4c8683b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.928956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b752fb7-4f48-4371-9451-6293c4c8683b admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.929452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa4737-53fb-46d4-9af5-3e3d1c4a6f3c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.930532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b752fb7-4f48-4371-9451-6293c4c8683b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.930532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b752fb7-4f48-4371-9451-6293c4c8683b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.930532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 810/1628] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:53.930532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b752fb7-4f48-4371-9451-6293c4c8683b admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.930532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b752fb7-4f48-4371-9451-6293c4c8683b admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.932182 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b48d2-bcc2-4a39-9594-59014d5429fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.932182 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b48d2-bcc2-4a39-9594-59014d5429fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.932182 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b48d2-bcc2-4a39-9594-59014d5429fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.932182 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b48d2-bcc2-4a39-9594-59014d5429fa admin admin] PATH_INFO: `/v3/projects/f90009890aff47f992e58ace947886d4/users/e0f7ca399464427b8c6ed5c3c38e60e9/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.934813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b48d2-bcc2-4a39-9594-59014d5429fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90009890aff47f992e58ace947886d4, user_id=e0f7ca399464427b8c6ed5c3c38e60e9, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.934813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b48d2-bcc2-4a39-9594-59014d5429fa admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.934813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 811/1629] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:53 2022] PUT /identity/v3/projects/f90009890aff47f992e58ace947886d4/users/e0f7ca399464427b8c6ed5c3c38e60e9/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:57:53.934813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad58cec-c95c-4d74-8692-1bc721a8ddfd None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.934813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad58cec-c95c-4d74-8692-1bc721a8ddfd None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.934813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad58cec-c95c-4d74-8692-1bc721a8ddfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.939352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 819/1630] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:53 2022] PUT /identity/v3/projects/27dbcb9d05a74745891bc339fba3f440/users/aa2402a9a7c648f889a1f94eded83bec/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:53.939352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e8255-6d21-4ac6-b68e-94a42cccfbd0 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.939352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e8255-6d21-4ac6-b68e-94a42cccfbd0 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.939352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e8255-6d21-4ac6-b68e-94a42cccfbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.018611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-cad58cec-c95c-4d74-8692-1bc721a8ddfd None None] MFA Rules not processed for user `e0f7ca399464427b8c6ed5c3c38e60e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:54.018841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-cad58cec-c95c-4d74-8692-1bc721a8ddfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:54.057479 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-4d5e8255-6d21-4ac6-b68e-94a42cccfbd0 None None] MFA Rules not processed for user `aa2402a9a7c648f889a1f94eded83bec`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:54.063376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4d5e8255-6d21-4ac6-b68e-94a42cccfbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:54.240942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:54.245434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 820/1631] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:54.247499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853de3f-3ac7-4f30-8ef8-1f775cacf26b None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.247790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853de3f-3ac7-4f30-8ef8-1f775cacf26b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.248067 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853de3f-3ac7-4f30-8ef8-1f775cacf26b None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.250771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 821/1632] 10.222.0.72 () {54 vars in 912 bytes} [Mon Aug 29 22:57:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:57:54.251552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853de3f-3ac7-4f30-8ef8-1f775cacf26b None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:54.306419 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:54.327798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 812/1633] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:57:54.331997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327fed3-b052-45f1-b9c5-1578515825f5 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.339655 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327fed3-b052-45f1-b9c5-1578515825f5 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.340529 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327fed3-b052-45f1-b9c5-1578515825f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.368104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853de3f-3ac7-4f30-8ef8-1f775cacf26b None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:54.374931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d5ce5-5bc3-4cd2-ba48-95c919028b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:54.377444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d5ce5-5bc3-4cd2-ba48-95c919028b74 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.377444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d5ce5-5bc3-4cd2-ba48-95c919028b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.377444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d5ce5-5bc3-4cd2-ba48-95c919028b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.377444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d5ce5-5bc3-4cd2-ba48-95c919028b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:54.379378 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d5ce5-5bc3-4cd2-ba48-95c919028b74 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:54.412490 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-f327fed3-b052-45f1-b9c5-1578515825f5 None None] MFA Rules not processed for user `0be09bd9ba7443aaa31879f56ca4aad1`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:54.417027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f327fed3-b052-45f1-b9c5-1578515825f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:54.483084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 822/1634] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:54 2022] POST /identity/v3/projects => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:54.485729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d5ce5-5bc3-4cd2-ba48-95c919028b74 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:54.578423 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 813/1635] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Aug 29 22:57:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:54.579628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327fed3-b052-45f1-b9c5-1578515825f5 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:54.598697 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327fed3-b052-45f1-b9c5-1578515825f5 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:54.650460 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d5ce5-5bc3-4cd2-ba48-95c919028b74 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:54.663179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2daabe-3763-4b51-8fd4-5475578d4887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:54.663884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2daabe-3763-4b51-8fd4-5475578d4887 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.664217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2daabe-3763-4b51-8fd4-5475578d4887 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.664616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2daabe-3763-4b51-8fd4-5475578d4887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.713070 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72816e-13e2-4550-9e58-39879f1bb541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:54.713521 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72816e-13e2-4550-9e58-39879f1bb541 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.714088 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72816e-13e2-4550-9e58-39879f1bb541 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.714378 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72816e-13e2-4550-9e58-39879f1bb541 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.715618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72816e-13e2-4550-9e58-39879f1bb541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:54.718948 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72816e-13e2-4550-9e58-39879f1bb541 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:54.827511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2daabe-3763-4b51-8fd4-5475578d4887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:54.829142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2daabe-3763-4b51-8fd4-5475578d4887 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:54.843720 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 814/1636] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:54 2022] POST /identity/v3/users => generated 298 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:54.844739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72816e-13e2-4550-9e58-39879f1bb541 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:54.859859 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 823/1637] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:54.861085 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2daabe-3763-4b51-8fd4-5475578d4887 service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:54.878624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72816e-13e2-4550-9e58-39879f1bb541 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:54.894631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2daabe-3763-4b51-8fd4-5475578d4887 service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:54.896247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe11cd5-e47d-4904-a1f5-60333cfc8b86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:54.896950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe11cd5-e47d-4904-a1f5-60333cfc8b86 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.897230 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe11cd5-e47d-4904-a1f5-60333cfc8b86 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.901879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe11cd5-e47d-4904-a1f5-60333cfc8b86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.909310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a9b63-8367-43ec-b4f9-76dcc69ebed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:54.910160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a9b63-8367-43ec-b4f9-76dcc69ebed8 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.910447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a9b63-8367-43ec-b4f9-76dcc69ebed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.910718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a9b63-8367-43ec-b4f9-76dcc69ebed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.911380 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a9b63-8367-43ec-b4f9-76dcc69ebed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:54.914133 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a9b63-8367-43ec-b4f9-76dcc69ebed8 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:54.932235 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 824/1638] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:54.933163 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a9b63-8367-43ec-b4f9-76dcc69ebed8 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:54.945610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a9b63-8367-43ec-b4f9-76dcc69ebed8 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:54.953166 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a73e6-1019-4b0d-853a-584446e6b883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:54.954003 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a73e6-1019-4b0d-853a-584446e6b883 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.964417 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a73e6-1019-4b0d-853a-584446e6b883 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.964417 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a73e6-1019-4b0d-853a-584446e6b883 admin admin] PATH_INFO: `/v3/projects/262fe5de35014c5faee34f4137520854/users/7b062bdcdcf94529941dfdb78968adbb/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.978036 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a73e6-1019-4b0d-853a-584446e6b883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262fe5de35014c5faee34f4137520854, user_id=7b062bdcdcf94529941dfdb78968adbb, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:54.982469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a73e6-1019-4b0d-853a-584446e6b883 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:55.093369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 825/1639] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:54 2022] PUT /identity/v3/projects/262fe5de35014c5faee34f4137520854/users/7b062bdcdcf94529941dfdb78968adbb/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:55.094391 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a73e6-1019-4b0d-853a-584446e6b883 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:55.127307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:55.135312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe11cd5-e47d-4904-a1f5-60333cfc8b86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:55.139167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe11cd5-e47d-4904-a1f5-60333cfc8b86 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:55.178362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:55.186553 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 815/1640] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:55.211340 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe11cd5-e47d-4904-a1f5-60333cfc8b86 service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:55.233453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe11cd5-e47d-4904-a1f5-60333cfc8b86 service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:55.268664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a73e6-1019-4b0d-853a-584446e6b883 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:55.288534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d2907-6231-4434-979e-2db2f922fc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:55.289447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d2907-6231-4434-979e-2db2f922fc06 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:55.289738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d2907-6231-4434-979e-2db2f922fc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:55.290011 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d2907-6231-4434-979e-2db2f922fc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:55.290679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d2907-6231-4434-979e-2db2f922fc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:55.292653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d2907-6231-4434-979e-2db2f922fc06 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:55.329084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 826/1641] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:55.330038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d2907-6231-4434-979e-2db2f922fc06 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:55.352499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d2907-6231-4434-979e-2db2f922fc06 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:55.371906 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd922fc6-6b7f-4d74-b40d-05fce22ded49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:55.372803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd922fc6-6b7f-4d74-b40d-05fce22ded49 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:55.373652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd922fc6-6b7f-4d74-b40d-05fce22ded49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:55.373932 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd922fc6-6b7f-4d74-b40d-05fce22ded49 admin admin] PATH_INFO: `/v3/projects/262fe5de35014c5faee34f4137520854/users/7b062bdcdcf94529941dfdb78968adbb/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:55.382414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd922fc6-6b7f-4d74-b40d-05fce22ded49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262fe5de35014c5faee34f4137520854, user_id=7b062bdcdcf94529941dfdb78968adbb, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:55.385171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd922fc6-6b7f-4d74-b40d-05fce22ded49 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:55.387799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112198e-f8b0-4aba-9c58-32dd9ee90a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:55.388535 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112198e-f8b0-4aba-9c58-32dd9ee90a16 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:55.388936 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112198e-f8b0-4aba-9c58-32dd9ee90a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:55.389284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112198e-f8b0-4aba-9c58-32dd9ee90a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:55.424830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 827/1642] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:55 2022] PUT /identity/v3/projects/262fe5de35014c5faee34f4137520854/users/7b062bdcdcf94529941dfdb78968adbb/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:55.430368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478079b7-dd73-4520-a1b3-901011365bff None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:55.430368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478079b7-dd73-4520-a1b3-901011365bff None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:55.430368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478079b7-dd73-4520-a1b3-901011365bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:55.466763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-478079b7-dd73-4520-a1b3-901011365bff None None] MFA Rules not processed for user `7b062bdcdcf94529941dfdb78968adbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:55.468087 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-478079b7-dd73-4520-a1b3-901011365bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:55.579604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 828/1643] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:55.620571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112198e-f8b0-4aba-9c58-32dd9ee90a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:55.622326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112198e-f8b0-4aba-9c58-32dd9ee90a16 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:55.650268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 816/1644] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:57:56.446630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478079b7-dd73-4520-a1b3-901011365bff None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:56.680379 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478079b7-dd73-4520-a1b3-901011365bff None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:56.707233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d97a3-16ee-4e93-8059-6a922e55f6de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:56.709822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d97a3-16ee-4e93-8059-6a922e55f6de service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:56.713405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d97a3-16ee-4e93-8059-6a922e55f6de service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:56.713857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d97a3-16ee-4e93-8059-6a922e55f6de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:56.759703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d97a3-16ee-4e93-8059-6a922e55f6de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:56.765997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d97a3-16ee-4e93-8059-6a922e55f6de service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:56.858407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 829/1645] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:57.216794 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4900f-8520-4c91-8dad-df927f368738 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:57.217974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4900f-8520-4c91-8dad-df927f368738 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:57.218453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4900f-8520-4c91-8dad-df927f368738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:57.254312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcbc08-2819-4b2a-babf-c14361154d44 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:57.256520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcbc08-2819-4b2a-babf-c14361154d44 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:57.261199 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcbc08-2819-4b2a-babf-c14361154d44 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:57.261199 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 830/1646] 10.222.0.72 () {54 vars in 962 bytes} [Mon Aug 29 22:57:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:57:57.267421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21fff8-a730-4baf-ba17-2c949e850a90 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:57.267864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21fff8-a730-4baf-ba17-2c949e850a90 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:57.268293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21fff8-a730-4baf-ba17-2c949e850a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:57.298720 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-bb21fff8-a730-4baf-ba17-2c949e850a90 None None] MFA Rules not processed for user `0be09bd9ba7443aaa31879f56ca4aad1`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:57.299892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-bb21fff8-a730-4baf-ba17-2c949e850a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:57.305747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-c4b4900f-8520-4c91-8dad-df927f368738 None None] MFA Rules not processed for user `fbc534cfc37940579e8e508f8a037750`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:57.309300 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c4b4900f-8520-4c91-8dad-df927f368738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:57.348466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:57.428616 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 817/1647] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:57.430124 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e058b-4650-4773-8cc8-2aa123be43d5 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:57.430419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e058b-4650-4773-8cc8-2aa123be43d5 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:57.430715 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e058b-4650-4773-8cc8-2aa123be43d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:57.464331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-b50e058b-4650-4773-8cc8-2aa123be43d5 None None] MFA Rules not processed for user `fbc534cfc37940579e8e508f8a037750`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:57.466845 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b50e058b-4650-4773-8cc8-2aa123be43d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:57.471249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 831/1648] 10.222.0.72 () {58 vars in 1059 bytes} [Mon Aug 29 22:57:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:57.479386 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 818/1649] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:57:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:57.481521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612a4e0-b6f1-4d04-92bd-64d0bcae371e None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:57.482035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612a4e0-b6f1-4d04-92bd-64d0bcae371e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:57.483045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612a4e0-b6f1-4d04-92bd-64d0bcae371e None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:57.486913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 832/1650] 10.222.0.72 () {54 vars in 912 bytes} [Mon Aug 29 22:57:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:57:57.497051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10e7fa-5ea9-4989-a970-abba72e39429 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:57.497633 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10e7fa-5ea9-4989-a970-abba72e39429 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:57.498057 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10e7fa-5ea9-4989-a970-abba72e39429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:57.508534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612a4e0-b6f1-4d04-92bd-64d0bcae371e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:57.541714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612a4e0-b6f1-4d04-92bd-64d0bcae371e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:57.551925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-9c10e7fa-5ea9-4989-a970-abba72e39429 None None] MFA Rules not processed for user `0be09bd9ba7443aaa31879f56ca4aad1`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:57.555299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b110354-7d9d-40df-bf48-31428051b534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:57.555933 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b110354-7d9d-40df-bf48-31428051b534 service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:57.556264 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b110354-7d9d-40df-bf48-31428051b534 service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:57.556358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9c10e7fa-5ea9-4989-a970-abba72e39429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:57.556549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b110354-7d9d-40df-bf48-31428051b534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:57.580537 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b110354-7d9d-40df-bf48-31428051b534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:57.582519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b110354-7d9d-40df-bf48-31428051b534 service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:57.582699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 819/1651] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Aug 29 22:57:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:57.592004 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10e7fa-5ea9-4989-a970-abba72e39429 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:57.614057 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10e7fa-5ea9-4989-a970-abba72e39429 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:57.627088 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96250477-dbc1-4924-aec3-8b09ffc2cf39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:57.627662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96250477-dbc1-4924-aec3-8b09ffc2cf39 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:57.629980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96250477-dbc1-4924-aec3-8b09ffc2cf39 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:57.630454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96250477-dbc1-4924-aec3-8b09ffc2cf39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:57.637213 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 833/1652] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:57:57.666618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96250477-dbc1-4924-aec3-8b09ffc2cf39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:57.671252 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96250477-dbc1-4924-aec3-8b09ffc2cf39 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:57.711923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 820/1653] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:58.347066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa876cc-eae7-4c9c-9acc-03e19d1fd22b None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:58.347355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa876cc-eae7-4c9c-9acc-03e19d1fd22b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:58.348665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa876cc-eae7-4c9c-9acc-03e19d1fd22b None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:58.349307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 834/1654] 10.222.0.72 () {54 vars in 912 bytes} [Mon Aug 29 22:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:57:58.357270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b88536-aa55-4b37-9650-dc6c5647da41 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:58.357787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b88536-aa55-4b37-9650-dc6c5647da41 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:58.357879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b88536-aa55-4b37-9650-dc6c5647da41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:58.411252 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:58.437278 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-40b88536-aa55-4b37-9650-dc6c5647da41 None None] MFA Rules not processed for user `380c6683b4ab4d08a6cf377e620439e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:58.438467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-40b88536-aa55-4b37-9650-dc6c5647da41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:58.608951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 821/1655] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Aug 29 22:57:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:57:58.661444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa876cc-eae7-4c9c-9acc-03e19d1fd22b None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:58.690006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa876cc-eae7-4c9c-9acc-03e19d1fd22b None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:58.705504 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5aed99-3be0-4d1a-9433-c3a70417d3b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:58.717652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aed99-3be0-4d1a-9433-c3a70417d3b7 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:58.717652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aed99-3be0-4d1a-9433-c3a70417d3b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:58.717652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aed99-3be0-4d1a-9433-c3a70417d3b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:58.744447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5aed99-3be0-4d1a-9433-c3a70417d3b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:58.748009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5aed99-3be0-4d1a-9433-c3a70417d3b7 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:58.780226 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 835/1656] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:59.703617 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b88536-aa55-4b37-9650-dc6c5647da41 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:59.714707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b88536-aa55-4b37-9650-dc6c5647da41 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:59.728555 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bd5a3-83e3-4d2c-9670-58b847fda1fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:59.729191 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bd5a3-83e3-4d2c-9670-58b847fda1fc service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:59.729470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bd5a3-83e3-4d2c-9670-58b847fda1fc service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:59.729751 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bd5a3-83e3-4d2c-9670-58b847fda1fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:59.845192 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bd5a3-83e3-4d2c-9670-58b847fda1fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:59.846996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bd5a3-83e3-4d2c-9670-58b847fda1fc service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:59.859758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 822/1657] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:00.156137 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5aed99-3be0-4d1a-9433-c3a70417d3b7 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:00.303740 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5aed99-3be0-4d1a-9433-c3a70417d3b7 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:00.316078 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e7b9b-95b7-40c1-b737-1ae7c90cad5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5fb88d96640089eba545f4c8d3c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:00.323651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e7b9b-95b7-40c1-b737-1ae7c90cad5a service placement] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:00.324222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e7b9b-95b7-40c1-b737-1ae7c90cad5a service placement] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:00.324585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e7b9b-95b7-40c1-b737-1ae7c90cad5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:00.327494 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-969e7b9b-95b7-40c1-b737-1ae7c90cad5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:00.378522 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e7b9b-95b7-40c1-b737-1ae7c90cad5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:00.378522 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e7b9b-95b7-40c1-b737-1ae7c90cad5a service placement] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:00.381582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 836/1658] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:01.098511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bd5a3-83e3-4d2c-9670-58b847fda1fc service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:01.423093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bd5a3-83e3-4d2c-9670-58b847fda1fc service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:01.440518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b2a85-1119-4f9d-97ab-d94abca9b8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:01.441205 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b2a85-1119-4f9d-97ab-d94abca9b8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:01.445861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b2a85-1119-4f9d-97ab-d94abca9b8af admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:01.445861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b2a85-1119-4f9d-97ab-d94abca9b8af admin admin] PATH_INFO: `/v3/users/d8be000ad55e4f868c72845c839b3788` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:01.445861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b2a85-1119-4f9d-97ab-d94abca9b8af admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8be000ad55e4f868c72845c839b3788)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:01.454099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b2a85-1119-4f9d-97ab-d94abca9b8af admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:01.716969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-913b2a85-1119-4f9d-97ab-d94abca9b8af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8be000ad55e4f868c72845c839b3788'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:01.717681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-913b2a85-1119-4f9d-97ab-d94abca9b8af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8be000ad55e4f868c72845c839b3788'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:01.718311 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-913b2a85-1119-4f9d-97ab-d94abca9b8af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8be000ad55e4f868c72845c839b3788'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:01.722813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:01.754145 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-913b2a85-1119-4f9d-97ab-d94abca9b8af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8be000ad55e4f868c72845c839b3788'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:01.766951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-913b2a85-1119-4f9d-97ab-d94abca9b8af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8be000ad55e4f868c72845c839b3788'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:01.896774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 823/1659] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:01 2022] DELETE /identity/v3/users/d8be000ad55e4f868c72845c839b3788 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:01.911592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f82923-d8ab-4315-8d6f-66d9d5388e8f None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:01.912175 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f82923-d8ab-4315-8d6f-66d9d5388e8f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:01.912725 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f82923-d8ab-4315-8d6f-66d9d5388e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:01.955367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-82f82923-d8ab-4315-8d6f-66d9d5388e8f None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:01.956866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-82f82923-d8ab-4315-8d6f-66d9d5388e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:02.158839 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 837/1660] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:02.196588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b2a85-1119-4f9d-97ab-d94abca9b8af admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:02.205039 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-913b2a85-1119-4f9d-97ab-d94abca9b8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:02.351775 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b2a85-1119-4f9d-97ab-d94abca9b8af admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:02.362380 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cee737-d29c-4ad8-b375-d1efb7a24629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:02.363238 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cee737-d29c-4ad8-b375-d1efb7a24629 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:02.363684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cee737-d29c-4ad8-b375-d1efb7a24629 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:02.364118 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cee737-d29c-4ad8-b375-d1efb7a24629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:02.384400 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cee737-d29c-4ad8-b375-d1efb7a24629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:02.385859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cee737-d29c-4ad8-b375-d1efb7a24629 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:02.418860 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 824/1661] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:04.623461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f82923-d8ab-4315-8d6f-66d9d5388e8f None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:04.628258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-82f82923-d8ab-4315-8d6f-66d9d5388e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:04.653973 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f82923-d8ab-4315-8d6f-66d9d5388e8f None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:04.696970 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81470f13-14da-4b54-8e28-04ae113392fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:04.702620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81470f13-14da-4b54-8e28-04ae113392fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:04.711398 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81470f13-14da-4b54-8e28-04ae113392fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:04.719185 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81470f13-14da-4b54-8e28-04ae113392fe admin admin] PATH_INFO: `/v3/projects/5512afbfff474f508c981c3d4b282c72` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:04.725534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81470f13-14da-4b54-8e28-04ae113392fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5512afbfff474f508c981c3d4b282c72)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:04.737530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81470f13-14da-4b54-8e28-04ae113392fe admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:04.794278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:04.907323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-81470f13-14da-4b54-8e28-04ae113392fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5512afbfff474f508c981c3d4b282c72', 'request_id': 'req-81470f13-14da-4b54-8e28-04ae113392fe'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:04.911510 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-81470f13-14da-4b54-8e28-04ae113392fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5512afbfff474f508c981c3d4b282c72', 'request_id': 'req-81470f13-14da-4b54-8e28-04ae113392fe'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:04.937984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-81470f13-14da-4b54-8e28-04ae113392fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5512afbfff474f508c981c3d4b282c72', 'request_id': 'req-81470f13-14da-4b54-8e28-04ae113392fe'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:05.018023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-81470f13-14da-4b54-8e28-04ae113392fe admin admin] The token cache is being invalidate because project 5512afbfff474f508c981c3d4b282c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:05.020898 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-81470f13-14da-4b54-8e28-04ae113392fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:05.026299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-81470f13-14da-4b54-8e28-04ae113392fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:05.042853 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310df46-6d2a-4d00-b2bc-ceb919be3a0a None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:05.044166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310df46-6d2a-4d00-b2bc-ceb919be3a0a None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:05.044790 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310df46-6d2a-4d00-b2bc-ceb919be3a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:05.071237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 838/1662] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:04 2022] DELETE /identity/v3/projects/5512afbfff474f508c981c3d4b282c72 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:05.110283 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-3310df46-6d2a-4d00-b2bc-ceb919be3a0a None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:05.113140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-3310df46-6d2a-4d00-b2bc-ceb919be3a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:05.287586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd55d8-34a7-434b-b141-fe6e1e00223e None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:05.288168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd55d8-34a7-434b-b141-fe6e1e00223e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:05.289223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd55d8-34a7-434b-b141-fe6e1e00223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:05.303191 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 825/1663] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:05.343942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-5cfd55d8-34a7-434b-b141-fe6e1e00223e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:05.348791 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-5cfd55d8-34a7-434b-b141-fe6e1e00223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:05.382844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310df46-6d2a-4d00-b2bc-ceb919be3a0a None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:05.394914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 839/1664] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:05.404903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310df46-6d2a-4d00-b2bc-ceb919be3a0a None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:05.417833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b25a6-ad4d-4b4f-92dc-49fcde8a632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:05.421205 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b25a6-ad4d-4b4f-92dc-49fcde8a632f admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:05.422036 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b25a6-ad4d-4b4f-92dc-49fcde8a632f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:05.422530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b25a6-ad4d-4b4f-92dc-49fcde8a632f admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:05.425965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b25a6-ad4d-4b4f-92dc-49fcde8a632f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:05.426878 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b25a6-ad4d-4b4f-92dc-49fcde8a632f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:05.432760 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b25a6-ad4d-4b4f-92dc-49fcde8a632f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:05.460876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd55d8-34a7-434b-b141-fe6e1e00223e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:05.464986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 826/1665] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:58:05.475028 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd55d8-34a7-434b-b141-fe6e1e00223e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:05.489515 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5783e-b24f-4508-a7ef-1a3cb21d1ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:05.490330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5783e-b24f-4508-a7ef-1a3cb21d1ffd admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:05.490798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5783e-b24f-4508-a7ef-1a3cb21d1ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:05.491332 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5783e-b24f-4508-a7ef-1a3cb21d1ffd admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:05.492377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5783e-b24f-4508-a7ef-1a3cb21d1ffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:05.499336 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5783e-b24f-4508-a7ef-1a3cb21d1ffd admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:05.652959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 840/1666] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:05 2022] POST /identity/v3/projects => generated 403 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:05.657012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b25a6-ad4d-4b4f-92dc-49fcde8a632f admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:05.687546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b25a6-ad4d-4b4f-92dc-49fcde8a632f admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:05.863567 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:05.882903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c21e86-e42a-4569-8006-5b93fc219069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:05.885121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c21e86-e42a-4569-8006-5b93fc219069 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:05.885121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c21e86-e42a-4569-8006-5b93fc219069 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:05.885121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c21e86-e42a-4569-8006-5b93fc219069 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:05.885121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c21e86-e42a-4569-8006-5b93fc219069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:05.904748 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c21e86-e42a-4569-8006-5b93fc219069 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:06.073684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 827/1667] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:05 2022] POST /identity/v3/users => generated 302 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:06.077146 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5783e-b24f-4508-a7ef-1a3cb21d1ffd admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:06.104246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5783e-b24f-4508-a7ef-1a3cb21d1ffd admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:06.131067 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a29bc-1bb3-43ad-9e44-6eb418b66caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:06.131775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a29bc-1bb3-43ad-9e44-6eb418b66caa admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:06.132068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a29bc-1bb3-43ad-9e44-6eb418b66caa admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:06.132488 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a29bc-1bb3-43ad-9e44-6eb418b66caa admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:06.142988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a29bc-1bb3-43ad-9e44-6eb418b66caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:06.147639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a29bc-1bb3-43ad-9e44-6eb418b66caa admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:06.176210 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 841/1668] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:06.180244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c21e86-e42a-4569-8006-5b93fc219069 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:06.197798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c21e86-e42a-4569-8006-5b93fc219069 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:06.209581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384376ab-1e6b-44ee-a351-1b943b17d048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:06.212977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384376ab-1e6b-44ee-a351-1b943b17d048 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:06.213431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384376ab-1e6b-44ee-a351-1b943b17d048 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:06.213860 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384376ab-1e6b-44ee-a351-1b943b17d048 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:06.217355 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384376ab-1e6b-44ee-a351-1b943b17d048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:06.223019 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384376ab-1e6b-44ee-a351-1b943b17d048 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:06.254792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 828/1669] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:06.259006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a29bc-1bb3-43ad-9e44-6eb418b66caa admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:06.287693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a29bc-1bb3-43ad-9e44-6eb418b66caa admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:06.315406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04529eee-c440-47d3-987d-05562a27350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:06.319842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04529eee-c440-47d3-987d-05562a27350e admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:06.319842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04529eee-c440-47d3-987d-05562a27350e admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:06.319842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04529eee-c440-47d3-987d-05562a27350e admin admin] PATH_INFO: `/v3/projects/2498ce13f35c457395fb1fe580cd8faa/users/936e95552ce24b89b1ccb2cbfa7b7ca1/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:06.385174 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04529eee-c440-47d3-987d-05562a27350e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2498ce13f35c457395fb1fe580cd8faa, user_id=936e95552ce24b89b1ccb2cbfa7b7ca1, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:06.393162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04529eee-c440-47d3-987d-05562a27350e admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:06.418441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af8b46-a42b-452e-8b74-118401cf68f3 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:06.420154 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af8b46-a42b-452e-8b74-118401cf68f3 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:06.420673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af8b46-a42b-452e-8b74-118401cf68f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:06.512615 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 842/1670] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:06 2022] PUT /identity/v3/projects/2498ce13f35c457395fb1fe580cd8faa/users/936e95552ce24b89b1ccb2cbfa7b7ca1/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:06.523574 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682cc77-a167-4f60-bb71-61dbee753d5e None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:06.524118 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682cc77-a167-4f60-bb71-61dbee753d5e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:06.524698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682cc77-a167-4f60-bb71-61dbee753d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:06.527196 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-c2af8b46-a42b-452e-8b74-118401cf68f3 None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:06.531158 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c2af8b46-a42b-452e-8b74-118401cf68f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:06.617915 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-b682cc77-a167-4f60-bb71-61dbee753d5e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:06.625235 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b682cc77-a167-4f60-bb71-61dbee753d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:06.860811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 829/1671] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Aug 29 22:58:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:58:06.923377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 843/1672] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:58:07.169648 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af8b46-a42b-452e-8b74-118401cf68f3 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:07.171633 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c2af8b46-a42b-452e-8b74-118401cf68f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:07.276735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682cc77-a167-4f60-bb71-61dbee753d5e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:07.278457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b682cc77-a167-4f60-bb71-61dbee753d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:07.445635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af8b46-a42b-452e-8b74-118401cf68f3 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:07.468035 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a737002-1f4e-411b-8cc9-574ee3dd46cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:07.470374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a737002-1f4e-411b-8cc9-574ee3dd46cc service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:07.470843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a737002-1f4e-411b-8cc9-574ee3dd46cc service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:07.471322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a737002-1f4e-411b-8cc9-574ee3dd46cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:07.477054 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:07.492482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682cc77-a167-4f60-bb71-61dbee753d5e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:07.498929 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6212b7-e6fc-4b26-ba7e-390fa701dfd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:07.499654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6212b7-e6fc-4b26-ba7e-390fa701dfd2 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:07.500104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6212b7-e6fc-4b26-ba7e-390fa701dfd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:07.500671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6212b7-e6fc-4b26-ba7e-390fa701dfd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:07.509117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-5c6212b7-e6fc-4b26-ba7e-390fa701dfd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:07.510312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a737002-1f4e-411b-8cc9-574ee3dd46cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:07.522003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a737002-1f4e-411b-8cc9-574ee3dd46cc service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:07.564618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 830/1673] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:07.568306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a737002-1f4e-411b-8cc9-574ee3dd46cc service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:07.571937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5a737002-1f4e-411b-8cc9-574ee3dd46cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:07.690613 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6212b7-e6fc-4b26-ba7e-390fa701dfd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:07.692820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6212b7-e6fc-4b26-ba7e-390fa701dfd2 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:07.730924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 844/1674] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:58:07.765680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:07.890094 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a737002-1f4e-411b-8cc9-574ee3dd46cc service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:07.904247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba890db-5507-48e5-b1b9-efcfcc1cc0d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:07.904896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba890db-5507-48e5-b1b9-efcfcc1cc0d0 service swift] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:07.905181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba890db-5507-48e5-b1b9-efcfcc1cc0d0 service swift] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:07.907775 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba890db-5507-48e5-b1b9-efcfcc1cc0d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:07.931013 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba890db-5507-48e5-b1b9-efcfcc1cc0d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:07.933569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba890db-5507-48e5-b1b9-efcfcc1cc0d0 service swift] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:07.957508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 831/1675] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 22:58:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:58:08.401713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b61559-95ce-49d7-b149-4725d7da5b7d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:08.405931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b61559-95ce-49d7-b149-4725d7da5b7d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:08.405931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b61559-95ce-49d7-b149-4725d7da5b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:08.520174 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-75b61559-95ce-49d7-b149-4725d7da5b7d None None] MFA Rules not processed for user `24dbd95c579d44cd8c95ca63669fca24`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:08.529266 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-75b61559-95ce-49d7-b149-4725d7da5b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:08.771393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 845/1676] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:08.783683 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba890db-5507-48e5-b1b9-efcfcc1cc0d0 service swift] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:08.786345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-dba890db-5507-48e5-b1b9-efcfcc1cc0d0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:09.114067 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba890db-5507-48e5-b1b9-efcfcc1cc0d0 service swift] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:09.130259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eef0af-36d5-4a6d-8761-06b601cd8c6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:09.130478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eef0af-36d5-4a6d-8761-06b601cd8c6c service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:09.130887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eef0af-36d5-4a6d-8761-06b601cd8c6c service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:09.131853 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eef0af-36d5-4a6d-8761-06b601cd8c6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:09.160723 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eef0af-36d5-4a6d-8761-06b601cd8c6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:09.163382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eef0af-36d5-4a6d-8761-06b601cd8c6c service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:09.200746 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 832/1677] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:09.625694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a52e1-d8a8-4255-9c3c-cd624b928239 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:09.626764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a52e1-d8a8-4255-9c3c-cd624b928239 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:09.627111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a52e1-d8a8-4255-9c3c-cd624b928239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:09.711513 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-913a52e1-d8a8-4255-9c3c-cd624b928239 None None] MFA Rules not processed for user `12245620ca0e4579890a93e4492e4fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:09.713065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-913a52e1-d8a8-4255-9c3c-cd624b928239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:09.858565 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 846/1678] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:09.876036 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eef0af-36d5-4a6d-8761-06b601cd8c6c service nova] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:09.918231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eef0af-36d5-4a6d-8761-06b601cd8c6c service nova] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:09.944353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb00a24-69e7-40bb-94f9-7fa6d9097cb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:09.945620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb00a24-69e7-40bb-94f9-7fa6d9097cb1 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:09.946074 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb00a24-69e7-40bb-94f9-7fa6d9097cb1 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:09.946421 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb00a24-69e7-40bb-94f9-7fa6d9097cb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:09.962542 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb00a24-69e7-40bb-94f9-7fa6d9097cb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:09.964940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb00a24-69e7-40bb-94f9-7fa6d9097cb1 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:10.008809 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 833/1679] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:10.961335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a52e1-d8a8-4255-9c3c-cd624b928239 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:10.964215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-913a52e1-d8a8-4255-9c3c-cd624b928239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:10.988653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a52e1-d8a8-4255-9c3c-cd624b928239 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:11.042780 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b239c-56b7-4293-840b-32b1700e20b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:11.043880 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b239c-56b7-4293-840b-32b1700e20b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:11.044270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b239c-56b7-4293-840b-32b1700e20b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:11.044565 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b239c-56b7-4293-840b-32b1700e20b3 admin admin] PATH_INFO: `/v3/users/d8c798ecc0bd44c58e597c8859ccb777` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:11.051813 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b239c-56b7-4293-840b-32b1700e20b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c798ecc0bd44c58e597c8859ccb777)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:11.058075 dv-cinder-854271-4-smb devstack@keystone.service[88552]: WARNING py.warnings [None req-4a9b239c-56b7-4293-840b-32b1700e20b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:58:11.058075 dv-cinder-854271-4-smb devstack@keystone.service[88552]: warnings.warn(msg) Aug 29 22:58:11.058075 dv-cinder-854271-4-smb devstack@keystone.service[88552]: Aug 29 22:58:11.066112 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b239c-56b7-4293-840b-32b1700e20b3 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:11.186110 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:11.529038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4a9b239c-56b7-4293-840b-32b1700e20b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c798ecc0bd44c58e597c8859ccb777'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:11.567718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4a9b239c-56b7-4293-840b-32b1700e20b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c798ecc0bd44c58e597c8859ccb777'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:11.665329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4a9b239c-56b7-4293-840b-32b1700e20b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c798ecc0bd44c58e597c8859ccb777'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:11.666245 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4a9b239c-56b7-4293-840b-32b1700e20b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c798ecc0bd44c58e597c8859ccb777'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:11.715082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4a9b239c-56b7-4293-840b-32b1700e20b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c798ecc0bd44c58e597c8859ccb777'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:11.755694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 847/1680] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:10 2022] DELETE /identity/v3/users/d8c798ecc0bd44c58e597c8859ccb777 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:11.758727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfc5e1-86bc-4b70-9fb2-c1ee235477b6 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:11.759703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfc5e1-86bc-4b70-9fb2-c1ee235477b6 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:11.760131 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfc5e1-86bc-4b70-9fb2-c1ee235477b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:11.811717 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-1bbfc5e1-86bc-4b70-9fb2-c1ee235477b6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:11.815110 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1bbfc5e1-86bc-4b70-9fb2-c1ee235477b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:11.996641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 834/1681] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:58:12.105369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b239c-56b7-4293-840b-32b1700e20b3 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:12.105369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4a9b239c-56b7-4293-840b-32b1700e20b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:12.309759 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfc5e1-86bc-4b70-9fb2-c1ee235477b6 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:12.312072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1bbfc5e1-86bc-4b70-9fb2-c1ee235477b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:12.332147 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfc5e1-86bc-4b70-9fb2-c1ee235477b6 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:12.339433 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94146794-5f8e-4ef6-813d-662606e94efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:12.340894 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94146794-5f8e-4ef6-813d-662606e94efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:12.341681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94146794-5f8e-4ef6-813d-662606e94efa admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:12.342162 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94146794-5f8e-4ef6-813d-662606e94efa admin admin] PATH_INFO: `/v3/users/7691d2a2fde741f9a66293b24bd9299b` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:12.344297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94146794-5f8e-4ef6-813d-662606e94efa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7691d2a2fde741f9a66293b24bd9299b)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:12.351699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94146794-5f8e-4ef6-813d-662606e94efa admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:12.378195 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b239c-56b7-4293-840b-32b1700e20b3 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:12.398391 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548895a-de7b-4d32-9534-c1cb3f006ba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:12.399178 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548895a-de7b-4d32-9534-c1cb3f006ba0 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:12.400766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548895a-de7b-4d32-9534-c1cb3f006ba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:12.401126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548895a-de7b-4d32-9534-c1cb3f006ba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:12.439165 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548895a-de7b-4d32-9534-c1cb3f006ba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:12.443863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548895a-de7b-4d32-9534-c1cb3f006ba0 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:12.470704 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 848/1682] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:12.615944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:12.753969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-94146794-5f8e-4ef6-813d-662606e94efa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7691d2a2fde741f9a66293b24bd9299b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:12.754603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-94146794-5f8e-4ef6-813d-662606e94efa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7691d2a2fde741f9a66293b24bd9299b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:12.755230 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-94146794-5f8e-4ef6-813d-662606e94efa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7691d2a2fde741f9a66293b24bd9299b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:12.789599 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-94146794-5f8e-4ef6-813d-662606e94efa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7691d2a2fde741f9a66293b24bd9299b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:12.830753 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-94146794-5f8e-4ef6-813d-662606e94efa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7691d2a2fde741f9a66293b24bd9299b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:12.951563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 835/1683] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:12 2022] DELETE /identity/v3/users/7691d2a2fde741f9a66293b24bd9299b => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:58:12.956405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f10d1-c735-43b2-bc4f-0fb756eaba61 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:12.956658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f10d1-c735-43b2-bc4f-0fb756eaba61 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:12.957253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f10d1-c735-43b2-bc4f-0fb756eaba61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:13.028971 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-772f10d1-c735-43b2-bc4f-0fb756eaba61 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:13.030420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-772f10d1-c735-43b2-bc4f-0fb756eaba61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:13.214772 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 849/1684] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:13.296035 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1de758-577f-4fdb-b6f3-2bb3254ccf2e None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:13.296948 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1de758-577f-4fdb-b6f3-2bb3254ccf2e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:13.297439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1de758-577f-4fdb-b6f3-2bb3254ccf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:13.320106 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f10d1-c735-43b2-bc4f-0fb756eaba61 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:13.320951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-772f10d1-c735-43b2-bc4f-0fb756eaba61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:13.379484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-3a1de758-577f-4fdb-b6f3-2bb3254ccf2e None None] MFA Rules not processed for user `380c6683b4ab4d08a6cf377e620439e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:13.381127 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-3a1de758-577f-4fdb-b6f3-2bb3254ccf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:13.501324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:13.543272 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f10d1-c735-43b2-bc4f-0fb756eaba61 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:13.549945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9756c-1672-4412-9f92-f757baa4e6c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:13.551373 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9756c-1672-4412-9f92-f757baa4e6c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:13.551670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9756c-1672-4412-9f92-f757baa4e6c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:13.551949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9756c-1672-4412-9f92-f757baa4e6c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:13.576899 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 836/1685] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Aug 29 22:58:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:13.586331 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9756c-1672-4412-9f92-f757baa4e6c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:13.587850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9756c-1672-4412-9f92-f757baa4e6c6 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:13.616179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 850/1686] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:13.722106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1de758-577f-4fdb-b6f3-2bb3254ccf2e None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:13.724773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-3a1de758-577f-4fdb-b6f3-2bb3254ccf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:13.764679 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1de758-577f-4fdb-b6f3-2bb3254ccf2e None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:13.783735 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:13.786566 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:13.787239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:13.788750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655 admin admin] PATH_INFO: `/v3/projects/e4d081ad209d4ab19fa7173a85a7bb8e` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:13.796831 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d081ad209d4ab19fa7173a85a7bb8e)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:13.796831 dv-cinder-854271-4-smb devstack@keystone.service[88553]: WARNING py.warnings [None req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:58:13.796831 dv-cinder-854271-4-smb devstack@keystone.service[88553]: warnings.warn(msg) Aug 29 22:58:13.796831 dv-cinder-854271-4-smb devstack@keystone.service[88553]: Aug 29 22:58:13.816604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:13.826092 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a9dd0-1781-4941-ac0e-18b8a5ff15e7 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:13.826377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a9dd0-1781-4941-ac0e-18b8a5ff15e7 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:13.826657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a9dd0-1781-4941-ac0e-18b8a5ff15e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:13.905511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-831a9dd0-1781-4941-ac0e-18b8a5ff15e7 None None] MFA Rules not processed for user `936e95552ce24b89b1ccb2cbfa7b7ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:13.906791 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-831a9dd0-1781-4941-ac0e-18b8a5ff15e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:14.101039 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 851/1687] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:13 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:58:14.106856 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a9dd0-1781-4941-ac0e-18b8a5ff15e7 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:14.108463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-831a9dd0-1781-4941-ac0e-18b8a5ff15e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:14.125824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d081ad209d4ab19fa7173a85a7bb8e', 'request_id': 'req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:14.149517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a9dd0-1781-4941-ac0e-18b8a5ff15e7 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:14.190117 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d081ad209d4ab19fa7173a85a7bb8e', 'request_id': 'req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:14.255322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d081ad209d4ab19fa7173a85a7bb8e', 'request_id': 'req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:14.298448 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655 admin admin] The token cache is being invalidate because project e4d081ad209d4ab19fa7173a85a7bb8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:14.299739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:14.301876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6eec0ad9-919d-4aff-bd1d-d7c1a6266655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:14.304845 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 837/1688] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:13 2022] DELETE /identity/v3/projects/e4d081ad209d4ab19fa7173a85a7bb8e => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:14.311736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97108f77-ba2a-4495-9e10-c933821071de None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:14.311736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97108f77-ba2a-4495-9e10-c933821071de None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:14.311736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97108f77-ba2a-4495-9e10-c933821071de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:14.316296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bb720-8a91-4b53-87f1-5d25dd059c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:14.317640 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bb720-8a91-4b53-87f1-5d25dd059c77 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:14.318133 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bb720-8a91-4b53-87f1-5d25dd059c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:14.318575 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bb720-8a91-4b53-87f1-5d25dd059c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:14.321571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-5c8bb720-8a91-4b53-87f1-5d25dd059c77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:14.333742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bb720-8a91-4b53-87f1-5d25dd059c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:14.335813 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bb720-8a91-4b53-87f1-5d25dd059c77 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:14.349757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 852/1689] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:14.353603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bb720-8a91-4b53-87f1-5d25dd059c77 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:14.365054 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-5c8bb720-8a91-4b53-87f1-5d25dd059c77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:14.376846 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-97108f77-ba2a-4495-9e10-c933821071de None None] MFA Rules not processed for user `c50a3ef2f80040f9a4372568ee984096`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:14.378273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-97108f77-ba2a-4495-9e10-c933821071de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:14.435761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:14.526636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bb720-8a91-4b53-87f1-5d25dd059c77 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:14.537487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7446c0-c508-436a-92ca-7d6c69bf94b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:14.539057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7446c0-c508-436a-92ca-7d6c69bf94b9 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:14.539344 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7446c0-c508-436a-92ca-7d6c69bf94b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:14.539694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7446c0-c508-436a-92ca-7d6c69bf94b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:14.540683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7446c0-c508-436a-92ca-7d6c69bf94b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:14.544311 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7446c0-c508-436a-92ca-7d6c69bf94b9 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:14.594513 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 838/1690] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:14.595488 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97108f77-ba2a-4495-9e10-c933821071de None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:14.597379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-97108f77-ba2a-4495-9e10-c933821071de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:14.616753 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97108f77-ba2a-4495-9e10-c933821071de None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:14.623486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede93ee-2dae-460b-83c3-a8be51b3fa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:14.624164 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede93ee-2dae-460b-83c3-a8be51b3fa69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:14.624495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede93ee-2dae-460b-83c3-a8be51b3fa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:14.624773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede93ee-2dae-460b-83c3-a8be51b3fa69 admin admin] PATH_INFO: `/v3/users/13a239f0c47c49e097b1b46a69245e6f` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:14.626477 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede93ee-2dae-460b-83c3-a8be51b3fa69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a239f0c47c49e097b1b46a69245e6f)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:14.629584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede93ee-2dae-460b-83c3-a8be51b3fa69 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:14.681973 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 853/1691] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:14 2022] POST /identity/v3/projects => generated 405 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:14.683574 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7446c0-c508-436a-92ca-7d6c69bf94b9 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:14.700244 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-0a7446c0-c508-436a-92ca-7d6c69bf94b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:14.828703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:14.908716 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fede93ee-2dae-460b-83c3-a8be51b3fa69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a239f0c47c49e097b1b46a69245e6f'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:14.912050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fede93ee-2dae-460b-83c3-a8be51b3fa69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a239f0c47c49e097b1b46a69245e6f'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:14.916676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fede93ee-2dae-460b-83c3-a8be51b3fa69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a239f0c47c49e097b1b46a69245e6f'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:14.941004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7446c0-c508-436a-92ca-7d6c69bf94b9 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:14.956830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52b799-fc52-48dd-9088-77d41f9c0a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:14.957620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52b799-fc52-48dd-9088-77d41f9c0a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:14.957991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52b799-fc52-48dd-9088-77d41f9c0a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:14.958341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52b799-fc52-48dd-9088-77d41f9c0a8d admin admin] PATH_INFO: `/v3/users/e0f7ca399464427b8c6ed5c3c38e60e9` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:14.959794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52b799-fc52-48dd-9088-77d41f9c0a8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f7ca399464427b8c6ed5c3c38e60e9)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:14.961869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52b799-fc52-48dd-9088-77d41f9c0a8d admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:14.988138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fede93ee-2dae-460b-83c3-a8be51b3fa69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a239f0c47c49e097b1b46a69245e6f'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:15.022562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fede93ee-2dae-460b-83c3-a8be51b3fa69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a239f0c47c49e097b1b46a69245e6f'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:15.148350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 839/1692] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:14 2022] DELETE /identity/v3/users/13a239f0c47c49e097b1b46a69245e6f => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:15.149152 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db1b4a-4b91-4e53-989b-8a0d4b8c01d1 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:15.149448 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db1b4a-4b91-4e53-989b-8a0d4b8c01d1 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:15.149725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db1b4a-4b91-4e53-989b-8a0d4b8c01d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:15.201575 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-04db1b4a-4b91-4e53-989b-8a0d4b8c01d1 None None] MFA Rules not processed for user `c50a3ef2f80040f9a4372568ee984096`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:15.203537 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-04db1b4a-4b91-4e53-989b-8a0d4b8c01d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:15.269751 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5d52b799-fc52-48dd-9088-77d41f9c0a8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f7ca399464427b8c6ed5c3c38e60e9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:15.310058 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5d52b799-fc52-48dd-9088-77d41f9c0a8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f7ca399464427b8c6ed5c3c38e60e9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:15.357883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 840/1693] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:15.358793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db1b4a-4b91-4e53-989b-8a0d4b8c01d1 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:15.362516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-04db1b4a-4b91-4e53-989b-8a0d4b8c01d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:15.407005 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5d52b799-fc52-48dd-9088-77d41f9c0a8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f7ca399464427b8c6ed5c3c38e60e9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:15.407998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5d52b799-fc52-48dd-9088-77d41f9c0a8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f7ca399464427b8c6ed5c3c38e60e9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:15.478514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5d52b799-fc52-48dd-9088-77d41f9c0a8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f7ca399464427b8c6ed5c3c38e60e9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:15.505829 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 854/1694] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:14 2022] DELETE /identity/v3/users/e0f7ca399464427b8c6ed5c3c38e60e9 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:15.507512 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5849-fef5-4b98-81b0-c708bb4ac7d9 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:15.507668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5849-fef5-4b98-81b0-c708bb4ac7d9 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:15.507939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5849-fef5-4b98-81b0-c708bb4ac7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:15.551657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:15.584977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-bd9b5849-fef5-4b98-81b0-c708bb4ac7d9 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:15.586228 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-bd9b5849-fef5-4b98-81b0-c708bb4ac7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:15.599581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db1b4a-4b91-4e53-989b-8a0d4b8c01d1 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:15.723893 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718dd29-f4c2-4c83-8f1a-c06ed09a4c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:15.727828 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718dd29-f4c2-4c83-8f1a-c06ed09a4c9e admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:15.728364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718dd29-f4c2-4c83-8f1a-c06ed09a4c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:15.730007 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718dd29-f4c2-4c83-8f1a-c06ed09a4c9e admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:15.731485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718dd29-f4c2-4c83-8f1a-c06ed09a4c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:15.743056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718dd29-f4c2-4c83-8f1a-c06ed09a4c9e admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:15.811934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 855/1695] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:15.814043 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5849-fef5-4b98-81b0-c708bb4ac7d9 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:15.819930 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-bd9b5849-fef5-4b98-81b0-c708bb4ac7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:15.850837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5849-fef5-4b98-81b0-c708bb4ac7d9 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:15.859289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f569fd1-52ad-4ce7-9db8-1393261dae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:15.861107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 841/1696] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:15 2022] POST /identity/v3/users => generated 309 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:15.862312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718dd29-f4c2-4c83-8f1a-c06ed09a4c9e admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:15.864734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8718dd29-f4c2-4c83-8f1a-c06ed09a4c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:15.865567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f569fd1-52ad-4ce7-9db8-1393261dae17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:15.866346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f569fd1-52ad-4ce7-9db8-1393261dae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:15.866887 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f569fd1-52ad-4ce7-9db8-1393261dae17 admin admin] PATH_INFO: `/v3/projects/033df2188b1b46fdaf017312574e1b8c` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:15.868992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f569fd1-52ad-4ce7-9db8-1393261dae17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=033df2188b1b46fdaf017312574e1b8c)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:15.872137 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f569fd1-52ad-4ce7-9db8-1393261dae17 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:15.966488 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:16.050567 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718dd29-f4c2-4c83-8f1a-c06ed09a4c9e admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:16.065096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5f569fd1-52ad-4ce7-9db8-1393261dae17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033df2188b1b46fdaf017312574e1b8c', 'request_id': 'req-5f569fd1-52ad-4ce7-9db8-1393261dae17'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:16.081084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5f569fd1-52ad-4ce7-9db8-1393261dae17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033df2188b1b46fdaf017312574e1b8c', 'request_id': 'req-5f569fd1-52ad-4ce7-9db8-1393261dae17'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:16.093622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5f569fd1-52ad-4ce7-9db8-1393261dae17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033df2188b1b46fdaf017312574e1b8c', 'request_id': 'req-5f569fd1-52ad-4ce7-9db8-1393261dae17'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:16.166795 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5f569fd1-52ad-4ce7-9db8-1393261dae17 admin admin] The token cache is being invalidate because project 033df2188b1b46fdaf017312574e1b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:16.167104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5f569fd1-52ad-4ce7-9db8-1393261dae17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:16.169823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5f569fd1-52ad-4ce7-9db8-1393261dae17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:16.175767 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 856/1697] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:15 2022] DELETE /identity/v3/projects/033df2188b1b46fdaf017312574e1b8c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:16.178532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f569fd1-52ad-4ce7-9db8-1393261dae17 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:16.182912 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-5f569fd1-52ad-4ce7-9db8-1393261dae17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:16.347363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f569fd1-52ad-4ce7-9db8-1393261dae17 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:16.357221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620911a-544d-4956-86ac-347f23a94ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:16.358048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620911a-544d-4956-86ac-347f23a94ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:16.358334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620911a-544d-4956-86ac-347f23a94ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:16.358699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620911a-544d-4956-86ac-347f23a94ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:16.363948 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68309c-1fe0-4f5c-ad22-51746dbb1010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:16.363948 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68309c-1fe0-4f5c-ad22-51746dbb1010 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:16.363948 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68309c-1fe0-4f5c-ad22-51746dbb1010 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:16.363948 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68309c-1fe0-4f5c-ad22-51746dbb1010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:16.366275 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-7620911a-544d-4956-86ac-347f23a94ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:16.375274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-ea68309c-1fe0-4f5c-ad22-51746dbb1010 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:16.566608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620911a-544d-4956-86ac-347f23a94ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:16.568392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620911a-544d-4956-86ac-347f23a94ff1 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:16.585658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 857/1698] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:16.587101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620911a-544d-4956-86ac-347f23a94ff1 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:16.589500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-7620911a-544d-4956-86ac-347f23a94ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:16.600460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68309c-1fe0-4f5c-ad22-51746dbb1010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:16.602950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68309c-1fe0-4f5c-ad22-51746dbb1010 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:16.614618 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620911a-544d-4956-86ac-347f23a94ff1 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:16.625244 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf489490-3a54-4e45-8067-1506bdcbde67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:16.625888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf489490-3a54-4e45-8067-1506bdcbde67 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:16.626171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf489490-3a54-4e45-8067-1506bdcbde67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:16.626447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf489490-3a54-4e45-8067-1506bdcbde67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:16.627111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf489490-3a54-4e45-8067-1506bdcbde67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:16.644772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 842/1699] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:15 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 783 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:16.648042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6e9f2-f1a1-4b96-adcc-112d9c5ff382 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:16.648426 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6e9f2-f1a1-4b96-adcc-112d9c5ff382 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:16.648636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6e9f2-f1a1-4b96-adcc-112d9c5ff382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:16.658714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf489490-3a54-4e45-8067-1506bdcbde67 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:16.687213 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 858/1700] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:16.688171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf489490-3a54-4e45-8067-1506bdcbde67 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:16.691308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-cf489490-3a54-4e45-8067-1506bdcbde67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:16.712943 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-01a6e9f2-f1a1-4b96-adcc-112d9c5ff382 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:16.718138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-01a6e9f2-f1a1-4b96-adcc-112d9c5ff382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:16.719925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf489490-3a54-4e45-8067-1506bdcbde67 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:16.732883 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da9d78-b414-4d8c-a0cf-65650b90410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:16.733569 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da9d78-b414-4d8c-a0cf-65650b90410c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:16.734029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da9d78-b414-4d8c-a0cf-65650b90410c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:16.734318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da9d78-b414-4d8c-a0cf-65650b90410c admin admin] PATH_INFO: `/v3/projects/f90009890aff47f992e58ace947886d4` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:16.736625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da9d78-b414-4d8c-a0cf-65650b90410c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f90009890aff47f992e58ace947886d4)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:16.738599 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da9d78-b414-4d8c-a0cf-65650b90410c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:16.747275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 843/1701] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:16.750386 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6e9f2-f1a1-4b96-adcc-112d9c5ff382 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:16.797980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6e9f2-f1a1-4b96-adcc-112d9c5ff382 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:16.824944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337ebbc-ebc3-4d62-babe-c77e91780fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:16.825749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337ebbc-ebc3-4d62-babe-c77e91780fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:16.826112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337ebbc-ebc3-4d62-babe-c77e91780fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:16.826843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337ebbc-ebc3-4d62-babe-c77e91780fcb admin admin] PATH_INFO: `/v3/projects/03f9a7826d9c49afb1dd693c089203cd/users/b948e2672fb9478f943fdd3ff78c999c/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:16.873218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337ebbc-ebc3-4d62-babe-c77e91780fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f9a7826d9c49afb1dd693c089203cd, user_id=b948e2672fb9478f943fdd3ff78c999c, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:16.880888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337ebbc-ebc3-4d62-babe-c77e91780fcb admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:16.910452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-66da9d78-b414-4d8c-a0cf-65650b90410c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90009890aff47f992e58ace947886d4', 'request_id': 'req-66da9d78-b414-4d8c-a0cf-65650b90410c'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:16.930678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-66da9d78-b414-4d8c-a0cf-65650b90410c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90009890aff47f992e58ace947886d4', 'request_id': 'req-66da9d78-b414-4d8c-a0cf-65650b90410c'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:16.954296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-66da9d78-b414-4d8c-a0cf-65650b90410c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90009890aff47f992e58ace947886d4', 'request_id': 'req-66da9d78-b414-4d8c-a0cf-65650b90410c'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:16.962283 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 844/1702] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:16 2022] PUT /identity/v3/projects/03f9a7826d9c49afb1dd693c089203cd/users/b948e2672fb9478f943fdd3ff78c999c/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:16.964338 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34527f-2304-4e6a-b6b8-92af62f0a861 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:16.964911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34527f-2304-4e6a-b6b8-92af62f0a861 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:16.969523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:16.970150 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34527f-2304-4e6a-b6b8-92af62f0a861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:17.015567 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-8f34527f-2304-4e6a-b6b8-92af62f0a861 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:17.018692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8f34527f-2304-4e6a-b6b8-92af62f0a861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:17.060382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-66da9d78-b414-4d8c-a0cf-65650b90410c admin admin] The token cache is being invalidate because project f90009890aff47f992e58ace947886d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:17.061138 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-66da9d78-b414-4d8c-a0cf-65650b90410c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.062379 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-66da9d78-b414-4d8c-a0cf-65650b90410c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.072436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 859/1703] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:16 2022] DELETE /identity/v3/projects/f90009890aff47f992e58ace947886d4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:17.074233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da9d78-b414-4d8c-a0cf-65650b90410c admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:17.089284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-66da9d78-b414-4d8c-a0cf-65650b90410c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:17.199653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 845/1704] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:17.199653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e62884-3891-4484-911f-8c03e709c048 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:17.199653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e62884-3891-4484-911f-8c03e709c048 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:17.210747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e62884-3891-4484-911f-8c03e709c048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:17.241358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:17.283700 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-75e62884-3891-4484-911f-8c03e709c048 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:17.285418 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-75e62884-3891-4484-911f-8c03e709c048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:17.301187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da9d78-b414-4d8c-a0cf-65650b90410c admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:17.319845 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 846/1705] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:17.321095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e62884-3891-4484-911f-8c03e709c048 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:17.323625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021aad6-f07d-4a73-aab0-45779b4ae88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:17.324723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021aad6-f07d-4a73-aab0-45779b4ae88f admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:17.325081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021aad6-f07d-4a73-aab0-45779b4ae88f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:17.325367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021aad6-f07d-4a73-aab0-45779b4ae88f admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:17.326196 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021aad6-f07d-4a73-aab0-45779b4ae88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:17.327940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021aad6-f07d-4a73-aab0-45779b4ae88f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:17.346252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 860/1706] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:17.346252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c11cc-a02d-40fa-9d71-26fbe0c11ea9 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:17.346252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c11cc-a02d-40fa-9d71-26fbe0c11ea9 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:17.346252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c11cc-a02d-40fa-9d71-26fbe0c11ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:17.358501 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e62884-3891-4484-911f-8c03e709c048 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:17.382396 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-809c11cc-a02d-40fa-9d71-26fbe0c11ea9 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:17.384011 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-809c11cc-a02d-40fa-9d71-26fbe0c11ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:17.391079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c3cea-83d6-4895-897b-c2ff6a0253ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:17.393922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c3cea-83d6-4895-897b-c2ff6a0253ca admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:17.396837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c3cea-83d6-4895-897b-c2ff6a0253ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:17.397296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c3cea-83d6-4895-897b-c2ff6a0253ca admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:17.398214 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c3cea-83d6-4895-897b-c2ff6a0253ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:17.399944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c3cea-83d6-4895-897b-c2ff6a0253ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:17.404598 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 861/1707] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:17.405809 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c11cc-a02d-40fa-9d71-26fbe0c11ea9 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:17.423259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c3cea-83d6-4895-897b-c2ff6a0253ca admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:17.423450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c11cc-a02d-40fa-9d71-26fbe0c11ea9 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:17.433592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95360e-15fe-4d81-bf85-e8df08b224d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:17.434466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95360e-15fe-4d81-bf85-e8df08b224d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:17.434750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95360e-15fe-4d81-bf85-e8df08b224d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:17.435025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95360e-15fe-4d81-bf85-e8df08b224d8 admin admin] PATH_INFO: `/v3/projects/03f9a7826d9c49afb1dd693c089203cd/users/b948e2672fb9478f943fdd3ff78c999c/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:17.437743 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95360e-15fe-4d81-bf85-e8df08b224d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f9a7826d9c49afb1dd693c089203cd, user_id=b948e2672fb9478f943fdd3ff78c999c, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:17.440876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95360e-15fe-4d81-bf85-e8df08b224d8 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:17.461713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 862/1708] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:17 2022] PUT /identity/v3/projects/03f9a7826d9c49afb1dd693c089203cd/users/b948e2672fb9478f943fdd3ff78c999c/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:17.461713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95360e-15fe-4d81-bf85-e8df08b224d8 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:17.474322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 847/1709] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:58:17.480032 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c3cea-83d6-4895-897b-c2ff6a0253ca admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:17.499240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c3cea-83d6-4895-897b-c2ff6a0253ca admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:17.611461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95360e-15fe-4d81-bf85-e8df08b224d8 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:17.618166 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62adcb-f3dc-4c49-997b-b08fdf4c2b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:17.619251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62adcb-f3dc-4c49-997b-b08fdf4c2b74 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:17.620853 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62adcb-f3dc-4c49-997b-b08fdf4c2b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:17.622072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62adcb-f3dc-4c49-997b-b08fdf4c2b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:17.624421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62adcb-f3dc-4c49-997b-b08fdf4c2b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:17.625008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62adcb-f3dc-4c49-997b-b08fdf4c2b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:17.628046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62adcb-f3dc-4c49-997b-b08fdf4c2b74 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:17.641561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 863/1710] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:58:17.647508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62adcb-f3dc-4c49-997b-b08fdf4c2b74 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:17.671787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62adcb-f3dc-4c49-997b-b08fdf4c2b74 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:17.684912 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a814f36-01fb-46b4-a07f-7465760a07fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:17.685731 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a814f36-01fb-46b4-a07f-7465760a07fb admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:17.687154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a814f36-01fb-46b4-a07f-7465760a07fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:17.687451 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a814f36-01fb-46b4-a07f-7465760a07fb admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:17.688357 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a814f36-01fb-46b4-a07f-7465760a07fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:17.690928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a814f36-01fb-46b4-a07f-7465760a07fb admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:17.744640 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d65126-8e27-430e-8698-20724c684f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:17.745288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d65126-8e27-430e-8698-20724c684f03 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:17.745562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d65126-8e27-430e-8698-20724c684f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:17.745838 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d65126-8e27-430e-8698-20724c684f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:17.746484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d65126-8e27-430e-8698-20724c684f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:17.749551 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d65126-8e27-430e-8698-20724c684f03 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:17.796223 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:17.819021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 864/1711] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:17 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:17.819021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a814f36-01fb-46b4-a07f-7465760a07fb admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:17.823934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-3a814f36-01fb-46b4-a07f-7465760a07fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:17.936374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 848/1712] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:17 2022] POST /identity/v3/projects => generated 403 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:17.938131 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d65126-8e27-430e-8698-20724c684f03 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:17.997239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a814f36-01fb-46b4-a07f-7465760a07fb admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:18.122271 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d65126-8e27-430e-8698-20724c684f03 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:18.139726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f81570-269d-4205-844f-95ff04bb276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:18.141797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f81570-269d-4205-844f-95ff04bb276a admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:18.142209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f81570-269d-4205-844f-95ff04bb276a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:18.142486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f81570-269d-4205-844f-95ff04bb276a admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:18.144600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f81570-269d-4205-844f-95ff04bb276a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:18.148471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f81570-269d-4205-844f-95ff04bb276a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:18.189903 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:18.191471 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:18.192100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:18.193471 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d admin admin] PATH_INFO: `/v3/projects/ca5c16201afb471ab6e07f06e0231649` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:18.195006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca5c16201afb471ab6e07f06e0231649)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:18.198917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:18.312480 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 849/1713] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:17 2022] POST /identity/v3/users => generated 286 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:18.314375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f81570-269d-4205-844f-95ff04bb276a admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:18.363840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f81570-269d-4205-844f-95ff04bb276a admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:18.392878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca5c16201afb471ab6e07f06e0231649', 'request_id': 'req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:18.414932 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca5c16201afb471ab6e07f06e0231649', 'request_id': 'req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:18.438507 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca5c16201afb471ab6e07f06e0231649', 'request_id': 'req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:18.546511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d admin admin] The token cache is being invalidate because project ca5c16201afb471ab6e07f06e0231649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:18.547179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:18.548468 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:18.552457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 865/1714] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:17 2022] DELETE /identity/v3/projects/ca5c16201afb471ab6e07f06e0231649 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:18.554459 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:18.559774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:18.620870 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac89129-b445-41bb-b22e-5970e9d0be29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:18.623591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac89129-b445-41bb-b22e-5970e9d0be29 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:18.625031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac89129-b445-41bb-b22e-5970e9d0be29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:18.625893 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac89129-b445-41bb-b22e-5970e9d0be29 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:18.628353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac89129-b445-41bb-b22e-5970e9d0be29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:18.635779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac89129-b445-41bb-b22e-5970e9d0be29 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:18.653873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:18.761089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a818ab-e47d-4c5d-b5ee-ed686a17db1d admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:18.773269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff0723-a489-47f2-a7d4-332da4ebd533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:18.777487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff0723-a489-47f2-a7d4-332da4ebd533 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:18.777906 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff0723-a489-47f2-a7d4-332da4ebd533 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:18.780371 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff0723-a489-47f2-a7d4-332da4ebd533 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:18.781310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff0723-a489-47f2-a7d4-332da4ebd533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:18.783376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff0723-a489-47f2-a7d4-332da4ebd533 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:18.821439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 850/1715] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:18 2022] POST /identity/v3/users => generated 302 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:18.827402 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac89129-b445-41bb-b22e-5970e9d0be29 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:18.837391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1ac89129-b445-41bb-b22e-5970e9d0be29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:18.845238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 866/1716] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:18.846385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff0723-a489-47f2-a7d4-332da4ebd533 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:18.851326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-12ff0723-a489-47f2-a7d4-332da4ebd533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:18.872409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff0723-a489-47f2-a7d4-332da4ebd533 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:18.879319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e8c6e-97b6-4afb-9566-f395cfdfcbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:18.880490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e8c6e-97b6-4afb-9566-f395cfdfcbbe admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:18.880879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e8c6e-97b6-4afb-9566-f395cfdfcbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:18.881222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e8c6e-97b6-4afb-9566-f395cfdfcbbe admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:18.885862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e8c6e-97b6-4afb-9566-f395cfdfcbbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:18.885862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e8c6e-97b6-4afb-9566-f395cfdfcbbe admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:18.886288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac89129-b445-41bb-b22e-5970e9d0be29 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:18.911102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de585a3f-f3d2-4175-a5d4-57118322ced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:18.911777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de585a3f-f3d2-4175-a5d4-57118322ced0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:18.920155 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de585a3f-f3d2-4175-a5d4-57118322ced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:18.920155 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de585a3f-f3d2-4175-a5d4-57118322ced0 admin admin] PATH_INFO: `/v3/users/aa2402a9a7c648f889a1f94eded83bec` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:18.925878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 867/1717] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:18.926010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de585a3f-f3d2-4175-a5d4-57118322ced0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2402a9a7c648f889a1f94eded83bec)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:18.926085 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e8c6e-97b6-4afb-9566-f395cfdfcbbe admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:18.928366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de585a3f-f3d2-4175-a5d4-57118322ced0 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:18.983319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e8c6e-97b6-4afb-9566-f395cfdfcbbe admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:18.997307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfbf73-a704-4230-9c49-6b944c75bd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:19.004714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfbf73-a704-4230-9c49-6b944c75bd22 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:19.004714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfbf73-a704-4230-9c49-6b944c75bd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:19.004714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfbf73-a704-4230-9c49-6b944c75bd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:19.004714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfbf73-a704-4230-9c49-6b944c75bd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:19.006436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfbf73-a704-4230-9c49-6b944c75bd22 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:19.042059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 868/1718] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:19.043364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfbf73-a704-4230-9c49-6b944c75bd22 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:19.060103 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfbf73-a704-4230-9c49-6b944c75bd22 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:19.082042 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ad417-a037-4b72-af5c-e9996d7de05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:19.082746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ad417-a037-4b72-af5c-e9996d7de05b admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:19.083090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ad417-a037-4b72-af5c-e9996d7de05b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:19.083380 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ad417-a037-4b72-af5c-e9996d7de05b admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:19.084040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ad417-a037-4b72-af5c-e9996d7de05b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:19.085973 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ad417-a037-4b72-af5c-e9996d7de05b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:19.125544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 869/1719] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:19.134470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137f06a-1965-4537-8809-2f9b065a794d None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:19.134643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137f06a-1965-4537-8809-2f9b065a794d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:19.134862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137f06a-1965-4537-8809-2f9b065a794d None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:19.137016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 870/1720] 10.222.0.72 () {54 vars in 921 bytes} [Mon Aug 29 22:58:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:58:19.141490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137f06a-1965-4537-8809-2f9b065a794d None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:19.180166 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137f06a-1965-4537-8809-2f9b065a794d None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:19.183093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-de585a3f-f3d2-4175-a5d4-57118322ced0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2402a9a7c648f889a1f94eded83bec'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:19.186087 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-de585a3f-f3d2-4175-a5d4-57118322ced0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2402a9a7c648f889a1f94eded83bec'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:19.186087 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-de585a3f-f3d2-4175-a5d4-57118322ced0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2402a9a7c648f889a1f94eded83bec'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:19.194057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbcb03-072c-4ced-90c8-c94117a4dc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:19.194925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbcb03-072c-4ced-90c8-c94117a4dc32 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:19.195302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbcb03-072c-4ced-90c8-c94117a4dc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:19.196512 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbcb03-072c-4ced-90c8-c94117a4dc32 admin admin] PATH_INFO: `/v3/projects/20a401ff7e9f4225a8f6154940193b74/users/4385f21c406f4db78aa51571cade8a30/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:19.233919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbcb03-072c-4ced-90c8-c94117a4dc32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a401ff7e9f4225a8f6154940193b74, user_id=4385f21c406f4db78aa51571cade8a30, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:19.240408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbcb03-072c-4ced-90c8-c94117a4dc32 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:19.268180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-de585a3f-f3d2-4175-a5d4-57118322ced0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2402a9a7c648f889a1f94eded83bec'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:19.272025 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=84,keystone:INSERT=7,keystone:DELETE=9 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:19.310352 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-de585a3f-f3d2-4175-a5d4-57118322ced0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2402a9a7c648f889a1f94eded83bec'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:19.374663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 871/1721] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:19 2022] PUT /identity/v3/projects/20a401ff7e9f4225a8f6154940193b74/users/4385f21c406f4db78aa51571cade8a30/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:19.375593 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbcb03-072c-4ced-90c8-c94117a4dc32 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:19.377369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-53bbcb03-072c-4ced-90c8-c94117a4dc32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:19.475606 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 851/1722] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:18 2022] DELETE /identity/v3/users/aa2402a9a7c648f889a1f94eded83bec => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:19.475606 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b55f9-559a-430c-bd97-2de02e35e77f None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:19.475606 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b55f9-559a-430c-bd97-2de02e35e77f None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:19.475606 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b55f9-559a-430c-bd97-2de02e35e77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:19.539121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbcb03-072c-4ced-90c8-c94117a4dc32 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:19.590384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-897b55f9-559a-430c-bd97-2de02e35e77f None None] MFA Rules not processed for user `4385f21c406f4db78aa51571cade8a30`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:19.597177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-897b55f9-559a-430c-bd97-2de02e35e77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:19.748570 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c97388-3446-4b19-8e1a-66e0963b5df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:19.749745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c97388-3446-4b19-8e1a-66e0963b5df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:19.750339 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c97388-3446-4b19-8e1a-66e0963b5df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:19.750795 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c97388-3446-4b19-8e1a-66e0963b5df8 admin admin] PATH_INFO: `/v3/projects/d8b9af797fe6439299a78870ec0b42fb/users/a33e52bb30094dbea5ba7be52822abd9/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:19.806075 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c97388-3446-4b19-8e1a-66e0963b5df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b9af797fe6439299a78870ec0b42fb, user_id=a33e52bb30094dbea5ba7be52822abd9, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:19.823678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c97388-3446-4b19-8e1a-66e0963b5df8 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:19.940562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 872/1723] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:19 2022] PUT /identity/v3/projects/d8b9af797fe6439299a78870ec0b42fb/users/a33e52bb30094dbea5ba7be52822abd9/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:19.951284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d318ebe-e072-41b9-8cf8-d6f6b351789c None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:19.961268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d318ebe-e072-41b9-8cf8-d6f6b351789c None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:19.961858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d318ebe-e072-41b9-8cf8-d6f6b351789c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:20.008149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 852/1724] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 539 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:20.010885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1985d08-3966-4af5-b5a8-dc9ebd8f902d None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:20.011813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1985d08-3966-4af5-b5a8-dc9ebd8f902d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:20.012347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1985d08-3966-4af5-b5a8-dc9ebd8f902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:20.078031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-4d318ebe-e072-41b9-8cf8-d6f6b351789c None None] MFA Rules not processed for user `0be09bd9ba7443aaa31879f56ca4aad1`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:20.085552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4d318ebe-e072-41b9-8cf8-d6f6b351789c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:20.115637 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-e1985d08-3966-4af5-b5a8-dc9ebd8f902d None None] MFA Rules not processed for user `a33e52bb30094dbea5ba7be52822abd9`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:20.120501 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e1985d08-3966-4af5-b5a8-dc9ebd8f902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:20.175227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:20.221045 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 853/1725] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:20 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:20.222454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1985d08-3966-4af5-b5a8-dc9ebd8f902d None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:20.224277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e1985d08-3966-4af5-b5a8-dc9ebd8f902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:20.363938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1985d08-3966-4af5-b5a8-dc9ebd8f902d None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:20.376375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb6b63-e53a-4a2d-8d96-8b6af692c6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:20.378753 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6b63-e53a-4a2d-8d96-8b6af692c6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:20.379213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6b63-e53a-4a2d-8d96-8b6af692c6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:20.380526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6b63-e53a-4a2d-8d96-8b6af692c6d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:20.382317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb6b63-e53a-4a2d-8d96-8b6af692c6d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:20.399687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb6b63-e53a-4a2d-8d96-8b6af692c6d7 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:20.534327 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:20.546313 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 854/1726] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:20 2022] POST /identity/v3/projects => generated 371 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:20.547342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb6b63-e53a-4a2d-8d96-8b6af692c6d7 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:20.570997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 873/1727] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Aug 29 22:58:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 618 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:20.573510 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b23d6-6df8-4c36-a345-669deaf9eef9 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:20.574121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b23d6-6df8-4c36-a345-669deaf9eef9 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:20.574618 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b23d6-6df8-4c36-a345-669deaf9eef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:20.684461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-420b23d6-6df8-4c36-a345-669deaf9eef9 None None] MFA Rules not processed for user `24dbd95c579d44cd8c95ca63669fca24`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:20.696407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-420b23d6-6df8-4c36-a345-669deaf9eef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:20.735349 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb6b63-e53a-4a2d-8d96-8b6af692c6d7 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:20.752223 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57770bb7-5b4d-4efe-8719-02c7fff448e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:20.752223 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770bb7-5b4d-4efe-8719-02c7fff448e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:20.752962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770bb7-5b4d-4efe-8719-02c7fff448e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:20.752962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770bb7-5b4d-4efe-8719-02c7fff448e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:20.753763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57770bb7-5b4d-4efe-8719-02c7fff448e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:20.755899 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57770bb7-5b4d-4efe-8719-02c7fff448e1 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:20.839118 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:20.908823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 855/1728] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:20 2022] POST /identity/v3/projects => generated 403 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:20.910020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57770bb7-5b4d-4efe-8719-02c7fff448e1 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:21.019322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 874/1729] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:21.022255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca833de9-6cb1-4785-bec5-3f5f37323b21 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:21.022934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca833de9-6cb1-4785-bec5-3f5f37323b21 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:21.023404 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca833de9-6cb1-4785-bec5-3f5f37323b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:21.086491 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57770bb7-5b4d-4efe-8719-02c7fff448e1 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:21.093177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15909bf3-23a7-4795-8063-fab81396a30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:21.093907 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909bf3-23a7-4795-8063-fab81396a30b admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:21.094257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909bf3-23a7-4795-8063-fab81396a30b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:21.094606 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909bf3-23a7-4795-8063-fab81396a30b admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:21.095488 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15909bf3-23a7-4795-8063-fab81396a30b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:21.098171 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15909bf3-23a7-4795-8063-fab81396a30b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:21.158036 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-ca833de9-6cb1-4785-bec5-3f5f37323b21 None None] MFA Rules not processed for user `b948e2672fb9478f943fdd3ff78c999c`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:21.160588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ca833de9-6cb1-4785-bec5-3f5f37323b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:21.239501 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 856/1730] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:20 2022] POST /identity/v3/users => generated 292 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:21.240772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15909bf3-23a7-4795-8063-fab81396a30b admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:21.244360 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-15909bf3-23a7-4795-8063-fab81396a30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:21.271157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15909bf3-23a7-4795-8063-fab81396a30b admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:21.277986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f342dd6-7e35-482a-b899-cca5e0f81716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:21.278644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f342dd6-7e35-482a-b899-cca5e0f81716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:21.278977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f342dd6-7e35-482a-b899-cca5e0f81716 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:21.280350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f342dd6-7e35-482a-b899-cca5e0f81716 admin admin] PATH_INFO: `/v3/projects/27dbcb9d05a74745891bc339fba3f440` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:21.281296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f342dd6-7e35-482a-b899-cca5e0f81716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27dbcb9d05a74745891bc339fba3f440)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:21.284930 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f342dd6-7e35-482a-b899-cca5e0f81716 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:21.378743 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 875/1731] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:21 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:21.379893 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca833de9-6cb1-4785-bec5-3f5f37323b21 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:21.488665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca833de9-6cb1-4785-bec5-3f5f37323b21 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:21.504207 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2f342dd6-7e35-482a-b899-cca5e0f81716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27dbcb9d05a74745891bc339fba3f440', 'request_id': 'req-2f342dd6-7e35-482a-b899-cca5e0f81716'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:21.624438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:21.637139 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2f342dd6-7e35-482a-b899-cca5e0f81716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27dbcb9d05a74745891bc339fba3f440', 'request_id': 'req-2f342dd6-7e35-482a-b899-cca5e0f81716'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:21.641344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:21.655328 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2f342dd6-7e35-482a-b899-cca5e0f81716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27dbcb9d05a74745891bc339fba3f440', 'request_id': 'req-2f342dd6-7e35-482a-b899-cca5e0f81716'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:21.677441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2f342dd6-7e35-482a-b899-cca5e0f81716 admin admin] The token cache is being invalidate because project 27dbcb9d05a74745891bc339fba3f440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:21.679264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2f342dd6-7e35-482a-b899-cca5e0f81716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:21.681108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2f342dd6-7e35-482a-b899-cca5e0f81716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:21.689819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 857/1732] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:21 2022] DELETE /identity/v3/projects/27dbcb9d05a74745891bc339fba3f440 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:21.695249 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f342dd6-7e35-482a-b899-cca5e0f81716 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:21.703205 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2f342dd6-7e35-482a-b899-cca5e0f81716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:21.735021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a696cf-973b-46d3-a68d-0f78be8eba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:21.737063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a696cf-973b-46d3-a68d-0f78be8eba90 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:21.740158 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a696cf-973b-46d3-a68d-0f78be8eba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:21.742162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a696cf-973b-46d3-a68d-0f78be8eba90 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:21.743305 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a696cf-973b-46d3-a68d-0f78be8eba90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:21.751739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a696cf-973b-46d3-a68d-0f78be8eba90 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:21.902821 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f342dd6-7e35-482a-b899-cca5e0f81716 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:21.911675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 876/1733] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:21 2022] POST /identity/v3/users => generated 308 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:21.912259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0debc5-aa16-4eae-98ba-ec932df137d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:21.912259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0debc5-aa16-4eae-98ba-ec932df137d4 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:21.912259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0debc5-aa16-4eae-98ba-ec932df137d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:21.912259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0debc5-aa16-4eae-98ba-ec932df137d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:21.914120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1c0debc5-aa16-4eae-98ba-ec932df137d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:21.916162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fea948-6cf2-4480-b21a-fa1e2a349b67 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:21.919569 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fea948-6cf2-4480-b21a-fa1e2a349b67 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:21.921081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fea948-6cf2-4480-b21a-fa1e2a349b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:21.938211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0debc5-aa16-4eae-98ba-ec932df137d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:21.940481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0debc5-aa16-4eae-98ba-ec932df137d4 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:21.969747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 858/1734] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:21.971104 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0debc5-aa16-4eae-98ba-ec932df137d4 service nova] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:21.978052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1c0debc5-aa16-4eae-98ba-ec932df137d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:22.008707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0debc5-aa16-4eae-98ba-ec932df137d4 service nova] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:22.013899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-84fea948-6cf2-4480-b21a-fa1e2a349b67 None None] MFA Rules not processed for user `c50a3ef2f80040f9a4372568ee984096`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:22.015446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-84fea948-6cf2-4480-b21a-fa1e2a349b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:22.021203 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e62498-e036-4d22-9fc3-51898bbf9dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:22.023956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e62498-e036-4d22-9fc3-51898bbf9dae admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:22.024642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e62498-e036-4d22-9fc3-51898bbf9dae admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:22.025226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e62498-e036-4d22-9fc3-51898bbf9dae admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:22.027438 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e62498-e036-4d22-9fc3-51898bbf9dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:22.030757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e62498-e036-4d22-9fc3-51898bbf9dae admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:22.055595 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 859/1735] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:22.056871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e62498-e036-4d22-9fc3-51898bbf9dae admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:22.061125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-39e62498-e036-4d22-9fc3-51898bbf9dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:22.084519 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e62498-e036-4d22-9fc3-51898bbf9dae admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:22.097383 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36351-a14b-4515-8cef-67f6492f6bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:22.098146 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36351-a14b-4515-8cef-67f6492f6bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:22.098532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36351-a14b-4515-8cef-67f6492f6bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:22.098771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36351-a14b-4515-8cef-67f6492f6bd9 admin admin] PATH_INFO: `/v3/users/7b062bdcdcf94529941dfdb78968adbb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:22.100450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa36351-a14b-4515-8cef-67f6492f6bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b062bdcdcf94529941dfdb78968adbb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:22.104608 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa36351-a14b-4515-8cef-67f6492f6bd9 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:22.268805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 877/1736] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:22.268805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fea948-6cf2-4480-b21a-fa1e2a349b67 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:22.269202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-84fea948-6cf2-4480-b21a-fa1e2a349b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:22.306330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fea948-6cf2-4480-b21a-fa1e2a349b67 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:22.321951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9884bb-5807-4ec5-bac9-e8f8475db3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:22.323242 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9884bb-5807-4ec5-bac9-e8f8475db3ba admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:22.323510 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9884bb-5807-4ec5-bac9-e8f8475db3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:22.323800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9884bb-5807-4ec5-bac9-e8f8475db3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:22.324695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9884bb-5807-4ec5-bac9-e8f8475db3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:22.326212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9884bb-5807-4ec5-bac9-e8f8475db3ba admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:22.355703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 878/1737] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:22.357114 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9884bb-5807-4ec5-bac9-e8f8475db3ba admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:22.380233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9884bb-5807-4ec5-bac9-e8f8475db3ba admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:22.396935 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5435b97-ae61-41ee-b8ac-7901e4af8d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:22.397691 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435b97-ae61-41ee-b8ac-7901e4af8d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:22.397977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435b97-ae61-41ee-b8ac-7901e4af8d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:22.398385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435b97-ae61-41ee-b8ac-7901e4af8d8e admin admin] PATH_INFO: `/v3/projects/9e55f29abf0f4f9ebb0e40a01dd98e55/users/c94402e49aeb46dcb89ab29f4d049304/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:22.405647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-cfa36351-a14b-4515-8cef-67f6492f6bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b062bdcdcf94529941dfdb78968adbb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:22.408348 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-cfa36351-a14b-4515-8cef-67f6492f6bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b062bdcdcf94529941dfdb78968adbb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:22.409628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-cfa36351-a14b-4515-8cef-67f6492f6bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b062bdcdcf94529941dfdb78968adbb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:22.457242 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5435b97-ae61-41ee-b8ac-7901e4af8d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e55f29abf0f4f9ebb0e40a01dd98e55, user_id=c94402e49aeb46dcb89ab29f4d049304, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:22.460046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5435b97-ae61-41ee-b8ac-7901e4af8d8e admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:22.490850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-cfa36351-a14b-4515-8cef-67f6492f6bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b062bdcdcf94529941dfdb78968adbb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:22.508617 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-cfa36351-a14b-4515-8cef-67f6492f6bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b062bdcdcf94529941dfdb78968adbb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:22.563997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 879/1738] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:22 2022] PUT /identity/v3/projects/9e55f29abf0f4f9ebb0e40a01dd98e55/users/c94402e49aeb46dcb89ab29f4d049304/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:22.567575 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5435b97-ae61-41ee-b8ac-7901e4af8d8e admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:22.571917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f5435b97-ae61-41ee-b8ac-7901e4af8d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:22.620872 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 860/1739] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:22 2022] DELETE /identity/v3/users/7b062bdcdcf94529941dfdb78968adbb => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:22.622722 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ac345-7e8e-4bd6-9281-24784b0d52a1 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:22.623160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ac345-7e8e-4bd6-9281-24784b0d52a1 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:22.623548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ac345-7e8e-4bd6-9281-24784b0d52a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:22.676474 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-749ac345-7e8e-4bd6-9281-24784b0d52a1 None None] MFA Rules not processed for user `12245620ca0e4579890a93e4492e4fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:22.678519 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-749ac345-7e8e-4bd6-9281-24784b0d52a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:22.749524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:22.799481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 861/1740] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:22.805244 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5435b97-ae61-41ee-b8ac-7901e4af8d8e admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:22.810581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ac345-7e8e-4bd6-9281-24784b0d52a1 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:22.819280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-749ac345-7e8e-4bd6-9281-24784b0d52a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:22.922888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:22.935447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048d68e-ced1-457c-8786-a99e3a696ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:22.936115 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048d68e-ced1-457c-8786-a99e3a696ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:22.936425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048d68e-ced1-457c-8786-a99e3a696ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:22.936963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048d68e-ced1-457c-8786-a99e3a696ffb admin admin] PATH_INFO: `/v3/projects/73620965a981421e8310695f9daef3ae/users/c23f6843520b493aaa1ac846fb0b5f83/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:22.960475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048d68e-ced1-457c-8786-a99e3a696ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=73620965a981421e8310695f9daef3ae, user_id=c23f6843520b493aaa1ac846fb0b5f83, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:22.963980 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048d68e-ced1-457c-8786-a99e3a696ffb admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:23.082372 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ac345-7e8e-4bd6-9281-24784b0d52a1 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:23.098741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 880/1741] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:22 2022] PUT /identity/v3/projects/73620965a981421e8310695f9daef3ae/users/c23f6843520b493aaa1ac846fb0b5f83/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:23.104303 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048d68e-ced1-457c-8786-a99e3a696ffb admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:23.117355 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eef4a-0fec-4ea8-b7a0-0f6f2ebc0b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:23.118360 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eef4a-0fec-4ea8-b7a0-0f6f2ebc0b05 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:23.118643 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eef4a-0fec-4ea8-b7a0-0f6f2ebc0b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:23.118921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eef4a-0fec-4ea8-b7a0-0f6f2ebc0b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:23.119702 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1eef4a-0fec-4ea8-b7a0-0f6f2ebc0b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:23.124882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1eef4a-0fec-4ea8-b7a0-0f6f2ebc0b05 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:23.155408 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 862/1742] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:23.156346 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eef4a-0fec-4ea8-b7a0-0f6f2ebc0b05 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:23.187118 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eef4a-0fec-4ea8-b7a0-0f6f2ebc0b05 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:23.323219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048d68e-ced1-457c-8786-a99e3a696ffb admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:23.339043 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ed8a4-7959-4297-b569-63388a19e730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:23.340048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ed8a4-7959-4297-b569-63388a19e730 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:23.340811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ed8a4-7959-4297-b569-63388a19e730 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:23.341163 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ed8a4-7959-4297-b569-63388a19e730 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:23.342419 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ed8a4-7959-4297-b569-63388a19e730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:23.351163 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ed8a4-7959-4297-b569-63388a19e730 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:23.367332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cf9eb-c7f6-444f-bdec-0f958760dfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:23.368354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cf9eb-c7f6-444f-bdec-0f958760dfaa admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:23.368647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cf9eb-c7f6-444f-bdec-0f958760dfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:23.370986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cf9eb-c7f6-444f-bdec-0f958760dfaa admin admin] PATH_INFO: `/v3/projects/9e55f29abf0f4f9ebb0e40a01dd98e55/users/c94402e49aeb46dcb89ab29f4d049304/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:23.372747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 881/1743] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:58:23.379046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55017b-c5de-48cf-9406-cd9db0787055 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:23.379232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cf9eb-c7f6-444f-bdec-0f958760dfaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e55f29abf0f4f9ebb0e40a01dd98e55, user_id=c94402e49aeb46dcb89ab29f4d049304, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:23.379467 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55017b-c5de-48cf-9406-cd9db0787055 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:23.380388 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55017b-c5de-48cf-9406-cd9db0787055 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:23.382360 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cf9eb-c7f6-444f-bdec-0f958760dfaa admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:23.391939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 882/1744] 10.222.0.72 () {54 vars in 912 bytes} [Mon Aug 29 22:58:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:58:23.391939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55017b-c5de-48cf-9406-cd9db0787055 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:23.426387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55017b-c5de-48cf-9406-cd9db0787055 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:23.426568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 863/1745] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:23 2022] PUT /identity/v3/projects/9e55f29abf0f4f9ebb0e40a01dd98e55/users/c94402e49aeb46dcb89ab29f4d049304/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:23.429085 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559c4bf-9de7-43f6-bcea-37cf0f728b70 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:23.429757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559c4bf-9de7-43f6-bcea-37cf0f728b70 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:23.430039 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559c4bf-9de7-43f6-bcea-37cf0f728b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:23.465430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-6559c4bf-9de7-43f6-bcea-37cf0f728b70 None None] MFA Rules not processed for user `380c6683b4ab4d08a6cf377e620439e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:23.466920 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-6559c4bf-9de7-43f6-bcea-37cf0f728b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:23.660307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 864/1746] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Aug 29 22:58:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:23.664232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd21647-08a8-48f5-9bdd-1ac6f8719ecf None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:23.667639 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd21647-08a8-48f5-9bdd-1ac6f8719ecf None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:23.668168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd21647-08a8-48f5-9bdd-1ac6f8719ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:23.712667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afc5d1-1806-48ac-a7a8-64afe5b16249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:23.714053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afc5d1-1806-48ac-a7a8-64afe5b16249 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:23.714682 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afc5d1-1806-48ac-a7a8-64afe5b16249 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:23.714848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afc5d1-1806-48ac-a7a8-64afe5b16249 admin admin] PATH_INFO: `/v3/projects/73620965a981421e8310695f9daef3ae/users/c23f6843520b493aaa1ac846fb0b5f83/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:23.723368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afc5d1-1806-48ac-a7a8-64afe5b16249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73620965a981421e8310695f9daef3ae, user_id=c23f6843520b493aaa1ac846fb0b5f83, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:23.734836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afc5d1-1806-48ac-a7a8-64afe5b16249 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:23.755387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-7dd21647-08a8-48f5-9bdd-1ac6f8719ecf None None] MFA Rules not processed for user `c94402e49aeb46dcb89ab29f4d049304`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:23.756911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7dd21647-08a8-48f5-9bdd-1ac6f8719ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:23.763693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:23.771314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 883/1747] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:23 2022] PUT /identity/v3/projects/73620965a981421e8310695f9daef3ae/users/c23f6843520b493aaa1ac846fb0b5f83/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:23.786302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c3a49-2d5a-490d-8585-badaf94c1f4b None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:23.787255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c3a49-2d5a-490d-8585-badaf94c1f4b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:23.791072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c3a49-2d5a-490d-8585-badaf94c1f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:23.895437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-ac0c3a49-2d5a-490d-8585-badaf94c1f4b None None] MFA Rules not processed for user `c23f6843520b493aaa1ac846fb0b5f83`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:23.909692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ac0c3a49-2d5a-490d-8585-badaf94c1f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:23.984571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 865/1748] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:23.985757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd21647-08a8-48f5-9bdd-1ac6f8719ecf None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:23.989064 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7dd21647-08a8-48f5-9bdd-1ac6f8719ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:24.057604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:24.109987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 884/1749] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:23 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:58:24.109987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c3a49-2d5a-490d-8585-badaf94c1f4b None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:24.131066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ac0c3a49-2d5a-490d-8585-badaf94c1f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:24.180530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd21647-08a8-48f5-9bdd-1ac6f8719ecf None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:24.196165 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114779b8-c825-413f-849d-cd68e982d588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:24.196832 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114779b8-c825-413f-849d-cd68e982d588 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:24.197320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114779b8-c825-413f-849d-cd68e982d588 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:24.197451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114779b8-c825-413f-849d-cd68e982d588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:24.210679 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114779b8-c825-413f-849d-cd68e982d588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:24.220550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114779b8-c825-413f-849d-cd68e982d588 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:24.235789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 866/1750] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:24.237774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114779b8-c825-413f-849d-cd68e982d588 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:24.241889 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-114779b8-c825-413f-849d-cd68e982d588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:24.265531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c3a49-2d5a-490d-8585-badaf94c1f4b None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:24.277681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f506af-b486-48f6-a29d-dd3ddcdc15b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:24.279490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f506af-b486-48f6-a29d-dd3ddcdc15b1 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:24.280303 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f506af-b486-48f6-a29d-dd3ddcdc15b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:24.280756 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f506af-b486-48f6-a29d-dd3ddcdc15b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:24.314644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f506af-b486-48f6-a29d-dd3ddcdc15b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:24.316454 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f506af-b486-48f6-a29d-dd3ddcdc15b1 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:24.340697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 885/1751] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:24.343597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adf269-ef2a-452a-b256-476e74d88d55 None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:24.345374 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adf269-ef2a-452a-b256-476e74d88d55 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:24.346241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adf269-ef2a-452a-b256-476e74d88d55 None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:24.352067 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 886/1752] 10.222.0.72 () {54 vars in 921 bytes} [Mon Aug 29 22:58:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:58:24.366817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447c193-0f7b-4a38-a7e6-0344c7121496 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:24.367366 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447c193-0f7b-4a38-a7e6-0344c7121496 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:24.367819 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447c193-0f7b-4a38-a7e6-0344c7121496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:24.465715 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-3447c193-0f7b-4a38-a7e6-0344c7121496 None None] MFA Rules not processed for user `83c5fb88d96640089eba545f4c8d3c44`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:24.467253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-3447c193-0f7b-4a38-a7e6-0344c7121496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:24.480180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114779b8-c825-413f-849d-cd68e982d588 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:24.495589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f4418-29d1-4544-9456-a10c1938eb47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:24.496128 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f4418-29d1-4544-9456-a10c1938eb47 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:24.496833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f4418-29d1-4544-9456-a10c1938eb47 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:24.496833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f4418-29d1-4544-9456-a10c1938eb47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:24.527572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f4418-29d1-4544-9456-a10c1938eb47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:24.529377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f4418-29d1-4544-9456-a10c1938eb47 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:24.557088 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 867/1753] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:24 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:24.665066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 887/1754] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Aug 29 22:58:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:24.691706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55be427-c4e0-44bc-a5aa-4d76e7d98e69 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:24.692125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55be427-c4e0-44bc-a5aa-4d76e7d98e69 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:24.692565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55be427-c4e0-44bc-a5aa-4d76e7d98e69 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:24.694557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 868/1755] 10.222.0.72 () {54 vars in 961 bytes} [Mon Aug 29 22:58:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:58:24.702013 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470553b2-6dfd-4336-8c0d-79fb74ae5276 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:24.703219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470553b2-6dfd-4336-8c0d-79fb74ae5276 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:24.703626 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470553b2-6dfd-4336-8c0d-79fb74ae5276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:24.765632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-470553b2-6dfd-4336-8c0d-79fb74ae5276 None None] MFA Rules not processed for user `83c5fb88d96640089eba545f4c8d3c44`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:24.767480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-470553b2-6dfd-4336-8c0d-79fb74ae5276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:24.798645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 888/1756] 10.222.0.72 () {58 vars in 1058 bytes} [Mon Aug 29 22:58:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:24.809523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55be427-c4e0-44bc-a5aa-4d76e7d98e69 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:24.817518 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470553b2-6dfd-4336-8c0d-79fb74ae5276 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:24.834639 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55be427-c4e0-44bc-a5aa-4d76e7d98e69 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:24.865982 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26821a68-8d1a-4810-aeb0-fbea85717431 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5fb88d96640089eba545f4c8d3c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:24.866659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26821a68-8d1a-4810-aeb0-fbea85717431 service placement] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:24.868618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26821a68-8d1a-4810-aeb0-fbea85717431 service placement] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:24.868618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26821a68-8d1a-4810-aeb0-fbea85717431 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:24.890559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26821a68-8d1a-4810-aeb0-fbea85717431 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:24.894488 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26821a68-8d1a-4810-aeb0-fbea85717431 service placement] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:24.925818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 869/1757] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:25.005553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470553b2-6dfd-4336-8c0d-79fb74ae5276 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:25.019639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e1485-19da-44fd-b043-d73ce4145441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:25.020239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e1485-19da-44fd-b043-d73ce4145441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:25.020629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e1485-19da-44fd-b043-d73ce4145441 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:25.021232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e1485-19da-44fd-b043-d73ce4145441 admin admin] PATH_INFO: `/v3/users/a33e52bb30094dbea5ba7be52822abd9` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:25.023156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e1485-19da-44fd-b043-d73ce4145441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a33e52bb30094dbea5ba7be52822abd9)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:25.026480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e1485-19da-44fd-b043-d73ce4145441 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:25.056625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:25.272556 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-028e1485-19da-44fd-b043-d73ce4145441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a33e52bb30094dbea5ba7be52822abd9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:25.293922 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-028e1485-19da-44fd-b043-d73ce4145441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a33e52bb30094dbea5ba7be52822abd9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:25.407162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-028e1485-19da-44fd-b043-d73ce4145441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a33e52bb30094dbea5ba7be52822abd9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:25.408273 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-028e1485-19da-44fd-b043-d73ce4145441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a33e52bb30094dbea5ba7be52822abd9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:25.418485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26821a68-8d1a-4810-aeb0-fbea85717431 service placement] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:25.419587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-26821a68-8d1a-4810-aeb0-fbea85717431 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:25.451213 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-028e1485-19da-44fd-b043-d73ce4145441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a33e52bb30094dbea5ba7be52822abd9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:25.461295 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26821a68-8d1a-4810-aeb0-fbea85717431 service placement] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:25.471714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 889/1758] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:24 2022] DELETE /identity/v3/users/a33e52bb30094dbea5ba7be52822abd9 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:25.475941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2936d-add6-4b27-9b83-05718f48144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:25.480483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9174aa9-47bc-48b5-863d-722031ec0577 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:25.480483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9174aa9-47bc-48b5-863d-722031ec0577 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:25.480697 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2936d-add6-4b27-9b83-05718f48144a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:25.480697 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2936d-add6-4b27-9b83-05718f48144a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:25.480845 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9174aa9-47bc-48b5-863d-722031ec0577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:25.480931 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2936d-add6-4b27-9b83-05718f48144a admin admin] PATH_INFO: `/v3/projects/262fe5de35014c5faee34f4137520854` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:25.482610 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2936d-add6-4b27-9b83-05718f48144a admin admin] RBAC: Authorizing `identity:delete_project(project_id=262fe5de35014c5faee34f4137520854)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:25.487260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2936d-add6-4b27-9b83-05718f48144a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:25.503004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-c9174aa9-47bc-48b5-863d-722031ec0577 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:25.505121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c9174aa9-47bc-48b5-863d-722031ec0577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:25.672639 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:25.692348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 890/1759] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:25.705610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9174aa9-47bc-48b5-863d-722031ec0577 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:25.709830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c9174aa9-47bc-48b5-863d-722031ec0577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:25.712589 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-4ed2936d-add6-4b27-9b83-05718f48144a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262fe5de35014c5faee34f4137520854', 'request_id': 'req-4ed2936d-add6-4b27-9b83-05718f48144a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:25.820614 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9174aa9-47bc-48b5-863d-722031ec0577 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:25.842110 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-4ed2936d-add6-4b27-9b83-05718f48144a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262fe5de35014c5faee34f4137520854', 'request_id': 'req-4ed2936d-add6-4b27-9b83-05718f48144a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:25.860878 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-4ed2936d-add6-4b27-9b83-05718f48144a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262fe5de35014c5faee34f4137520854', 'request_id': 'req-4ed2936d-add6-4b27-9b83-05718f48144a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:25.898403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-4ed2936d-add6-4b27-9b83-05718f48144a admin admin] The token cache is being invalidate because project 262fe5de35014c5faee34f4137520854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:25.898784 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-4ed2936d-add6-4b27-9b83-05718f48144a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:25.905515 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-4ed2936d-add6-4b27-9b83-05718f48144a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:25.917656 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 870/1760] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:25 2022] DELETE /identity/v3/projects/262fe5de35014c5faee34f4137520854 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:25.918776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2936d-add6-4b27-9b83-05718f48144a admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:25.927879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4ed2936d-add6-4b27-9b83-05718f48144a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:26.021919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3314e5-30cd-45ee-8d37-c9eabd3ea012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:26.022706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3314e5-30cd-45ee-8d37-c9eabd3ea012 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:26.023096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3314e5-30cd-45ee-8d37-c9eabd3ea012 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:26.023440 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3314e5-30cd-45ee-8d37-c9eabd3ea012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:26.029689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-fa3314e5-30cd-45ee-8d37-c9eabd3ea012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:26.045430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:26.113783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2936d-add6-4b27-9b83-05718f48144a admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:26.122667 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf452186-58d8-4e1e-9bb0-3b354fc806f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:26.123340 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf452186-58d8-4e1e-9bb0-3b354fc806f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:26.123618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf452186-58d8-4e1e-9bb0-3b354fc806f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:26.123892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf452186-58d8-4e1e-9bb0-3b354fc806f5 admin admin] PATH_INFO: `/v3/users/4385f21c406f4db78aa51571cade8a30` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:26.129852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf452186-58d8-4e1e-9bb0-3b354fc806f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4385f21c406f4db78aa51571cade8a30)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:26.131885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf452186-58d8-4e1e-9bb0-3b354fc806f5 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:26.230464 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3314e5-30cd-45ee-8d37-c9eabd3ea012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:26.232312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3314e5-30cd-45ee-8d37-c9eabd3ea012 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:26.243264 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 891/1761] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:26.244016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3314e5-30cd-45ee-8d37-c9eabd3ea012 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:26.246695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-fa3314e5-30cd-45ee-8d37-c9eabd3ea012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:26.258555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3314e5-30cd-45ee-8d37-c9eabd3ea012 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:26.266280 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613da090-686b-4f71-9ca9-0efc259ea70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:26.267217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613da090-686b-4f71-9ca9-0efc259ea70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:26.267842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613da090-686b-4f71-9ca9-0efc259ea70e admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:26.267940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613da090-686b-4f71-9ca9-0efc259ea70e admin admin] PATH_INFO: `/v3/users/936e95552ce24b89b1ccb2cbfa7b7ca1` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:26.269271 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613da090-686b-4f71-9ca9-0efc259ea70e admin admin] RBAC: Authorizing `identity:delete_user(user_id=936e95552ce24b89b1ccb2cbfa7b7ca1)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:26.271843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613da090-686b-4f71-9ca9-0efc259ea70e admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:26.433768 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-cf452186-58d8-4e1e-9bb0-3b354fc806f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4385f21c406f4db78aa51571cade8a30'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:26.434471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-cf452186-58d8-4e1e-9bb0-3b354fc806f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4385f21c406f4db78aa51571cade8a30'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:26.435460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-cf452186-58d8-4e1e-9bb0-3b354fc806f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4385f21c406f4db78aa51571cade8a30'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:26.480994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-cf452186-58d8-4e1e-9bb0-3b354fc806f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4385f21c406f4db78aa51571cade8a30'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:26.505220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-cf452186-58d8-4e1e-9bb0-3b354fc806f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4385f21c406f4db78aa51571cade8a30'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:26.555239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-613da090-686b-4f71-9ca9-0efc259ea70e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936e95552ce24b89b1ccb2cbfa7b7ca1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:26.568182 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-613da090-686b-4f71-9ca9-0efc259ea70e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936e95552ce24b89b1ccb2cbfa7b7ca1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:26.636458 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 871/1762] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:25 2022] DELETE /identity/v3/users/4385f21c406f4db78aa51571cade8a30 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:26.638121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6d335-3efc-41a7-b706-e44e47a40e06 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:26.638419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6d335-3efc-41a7-b706-e44e47a40e06 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:26.641755 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6d335-3efc-41a7-b706-e44e47a40e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:26.673407 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-0fc6d335-3efc-41a7-b706-e44e47a40e06 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:26.674815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0fc6d335-3efc-41a7-b706-e44e47a40e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:26.715889 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-613da090-686b-4f71-9ca9-0efc259ea70e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936e95552ce24b89b1ccb2cbfa7b7ca1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:26.719030 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-613da090-686b-4f71-9ca9-0efc259ea70e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936e95552ce24b89b1ccb2cbfa7b7ca1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:26.740429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:26.760577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-613da090-686b-4f71-9ca9-0efc259ea70e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936e95552ce24b89b1ccb2cbfa7b7ca1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:26.778288 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 892/1763] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:26 2022] DELETE /identity/v3/users/936e95552ce24b89b1ccb2cbfa7b7ca1 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:26.781278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87887f-2b62-4578-b32b-c7910906b03f None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:26.781278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87887f-2b62-4578-b32b-c7910906b03f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:26.781892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87887f-2b62-4578-b32b-c7910906b03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:26.800314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 872/1764] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:26.805883 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-eb87887f-2b62-4578-b32b-c7910906b03f None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:26.807493 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-eb87887f-2b62-4578-b32b-c7910906b03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:26.809444 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ab50e-d16a-49c0-970a-f338f26339ee None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:26.810323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ab50e-d16a-49c0-970a-f338f26339ee None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:26.810323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ab50e-d16a-49c0-970a-f338f26339ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:26.847875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-bb8ab50e-d16a-49c0-970a-f338f26339ee None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:26.849957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-bb8ab50e-d16a-49c0-970a-f338f26339ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:26.909579 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 893/1765] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:26.919744 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87887f-2b62-4578-b32b-c7910906b03f None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:26.922868 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-eb87887f-2b62-4578-b32b-c7910906b03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:26.958703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 873/1766] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:26.958899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:26.960590 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ab50e-d16a-49c0-970a-f338f26339ee None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:26.976476 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ab50e-d16a-49c0-970a-f338f26339ee None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:26.992207 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d203e9d-2ce7-4f8d-84ab-f2645c3dfa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:26.993061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d203e9d-2ce7-4f8d-84ab-f2645c3dfa5c admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:26.993407 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d203e9d-2ce7-4f8d-84ab-f2645c3dfa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:26.996143 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d203e9d-2ce7-4f8d-84ab-f2645c3dfa5c admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:26.996933 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d203e9d-2ce7-4f8d-84ab-f2645c3dfa5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:26.997248 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d203e9d-2ce7-4f8d-84ab-f2645c3dfa5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:26.999320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d203e9d-2ce7-4f8d-84ab-f2645c3dfa5c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:27.046890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 874/1767] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:58:27.059776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d203e9d-2ce7-4f8d-84ab-f2645c3dfa5c admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:27.073298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87887f-2b62-4578-b32b-c7910906b03f None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:27.084455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3207c3-f834-43a6-a6b0-bebbf972a74e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:27.085881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3207c3-f834-43a6-a6b0-bebbf972a74e service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:27.087136 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3207c3-f834-43a6-a6b0-bebbf972a74e service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:27.089408 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d203e9d-2ce7-4f8d-84ab-f2645c3dfa5c admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:27.090198 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3207c3-f834-43a6-a6b0-bebbf972a74e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:27.103988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8496d0c-1633-48cc-8561-292001b90881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:27.107431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8496d0c-1633-48cc-8561-292001b90881 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:27.107431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8496d0c-1633-48cc-8561-292001b90881 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:27.107431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8496d0c-1633-48cc-8561-292001b90881 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:27.107431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8496d0c-1633-48cc-8561-292001b90881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:27.108328 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8496d0c-1633-48cc-8561-292001b90881 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:27.110735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3207c3-f834-43a6-a6b0-bebbf972a74e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:27.112862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3207c3-f834-43a6-a6b0-bebbf972a74e service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:27.151118 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 894/1768] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:27.346529 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 875/1769] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:27 2022] POST /identity/v3/projects => generated 379 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:27.352031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3207c3-f834-43a6-a6b0-bebbf972a74e service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:27.384676 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3207c3-f834-43a6-a6b0-bebbf972a74e service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:27.475452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6b4c7-d575-42c3-bc52-4c1ffa8533ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:27.476140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6b4c7-d575-42c3-bc52-4c1ffa8533ce admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:27.476453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6b4c7-d575-42c3-bc52-4c1ffa8533ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:27.476884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6b4c7-d575-42c3-bc52-4c1ffa8533ce admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:27.477670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6b4c7-d575-42c3-bc52-4c1ffa8533ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:27.481036 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6b4c7-d575-42c3-bc52-4c1ffa8533ce admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:27.526102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8496d0c-1633-48cc-8561-292001b90881 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:27.528575 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e8496d0c-1633-48cc-8561-292001b90881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:27.559428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8496d0c-1633-48cc-8561-292001b90881 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:27.565848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:27.566071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:27.566284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:27.566728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe admin admin] PATH_INFO: `/v3/projects/d8b9af797fe6439299a78870ec0b42fb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:27.568620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b9af797fe6439299a78870ec0b42fb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:27.575354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:27.595438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 895/1770] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:27 2022] POST /identity/v3/users => generated 290 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:27.599111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6b4c7-d575-42c3-bc52-4c1ffa8533ce admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:27.676042 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6b4c7-d575-42c3-bc52-4c1ffa8533ce admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:27.716021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcdde5-9752-43ea-a9f5-24039113751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:27.716021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcdde5-9752-43ea-a9f5-24039113751b admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:27.716021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcdde5-9752-43ea-a9f5-24039113751b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:27.716021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcdde5-9752-43ea-a9f5-24039113751b admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:27.716631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcdde5-9752-43ea-a9f5-24039113751b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:27.716631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcdde5-9752-43ea-a9f5-24039113751b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:27.745250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 896/1771] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:27.750462 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcdde5-9752-43ea-a9f5-24039113751b admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:27.758825 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-94bcdde5-9752-43ea-a9f5-24039113751b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:27.782872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcdde5-9752-43ea-a9f5-24039113751b admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:27.796556 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ae068-49f0-4e65-a960-bded6dec1dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:27.797983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ae068-49f0-4e65-a960-bded6dec1dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:27.798431 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ae068-49f0-4e65-a960-bded6dec1dee admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:27.814745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ae068-49f0-4e65-a960-bded6dec1dee admin admin] PATH_INFO: `/v3/projects/2498ce13f35c457395fb1fe580cd8faa` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:27.817142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ae068-49f0-4e65-a960-bded6dec1dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2498ce13f35c457395fb1fe580cd8faa)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:27.827727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ae068-49f0-4e65-a960-bded6dec1dee admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:27.891817 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b9af797fe6439299a78870ec0b42fb', 'request_id': 'req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:27.992583 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-eb1ae068-49f0-4e65-a960-bded6dec1dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2498ce13f35c457395fb1fe580cd8faa', 'request_id': 'req-eb1ae068-49f0-4e65-a960-bded6dec1dee'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.000804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b9af797fe6439299a78870ec0b42fb', 'request_id': 'req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.009141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-eb1ae068-49f0-4e65-a960-bded6dec1dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2498ce13f35c457395fb1fe580cd8faa', 'request_id': 'req-eb1ae068-49f0-4e65-a960-bded6dec1dee'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.016126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b9af797fe6439299a78870ec0b42fb', 'request_id': 'req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.023634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-eb1ae068-49f0-4e65-a960-bded6dec1dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2498ce13f35c457395fb1fe580cd8faa', 'request_id': 'req-eb1ae068-49f0-4e65-a960-bded6dec1dee'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.047888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe admin admin] The token cache is being invalidate because project d8b9af797fe6439299a78870ec0b42fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:28.047888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.047888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.049549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 876/1772] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:27 2022] DELETE /identity/v3/projects/d8b9af797fe6439299a78870ec0b42fb => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:28.055061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:28.058181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:28.110889 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:28.166984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-eb1ae068-49f0-4e65-a960-bded6dec1dee admin admin] The token cache is being invalidate because project 2498ce13f35c457395fb1fe580cd8faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:28.167329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-eb1ae068-49f0-4e65-a960-bded6dec1dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.168006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-eb1ae068-49f0-4e65-a960-bded6dec1dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.170249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 897/1773] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:27 2022] DELETE /identity/v3/projects/2498ce13f35c457395fb1fe580cd8faa => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:28.170765 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ae068-49f0-4e65-a960-bded6dec1dee admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:28.172388 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-eb1ae068-49f0-4e65-a960-bded6dec1dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:28.174627 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af6b7e-4d74-4b4c-bb89-9fa7869e9dbe admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:28.220283 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:28.278547 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6df48-4644-41d9-9f96-95a771c30145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:28.279246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6df48-4644-41d9-9f96-95a771c30145 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:28.279591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6df48-4644-41d9-9f96-95a771c30145 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:28.279877 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6df48-4644-41d9-9f96-95a771c30145 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:28.280574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6df48-4644-41d9-9f96-95a771c30145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:28.282331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6df48-4644-41d9-9f96-95a771c30145 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:28.307493 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ae068-49f0-4e65-a960-bded6dec1dee admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:28.316680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 877/1774] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:28.316928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef23be7-ffc3-4201-b551-d06d0cbeed11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:28.317121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6df48-4644-41d9-9f96-95a771c30145 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:28.317246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef23be7-ffc3-4201-b551-d06d0cbeed11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:28.317246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef23be7-ffc3-4201-b551-d06d0cbeed11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:28.317246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef23be7-ffc3-4201-b551-d06d0cbeed11 admin admin] PATH_INFO: `/v3/users/c23f6843520b493aaa1ac846fb0b5f83` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:28.320729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef23be7-ffc3-4201-b551-d06d0cbeed11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c23f6843520b493aaa1ac846fb0b5f83)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:28.322516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-28a6df48-4644-41d9-9f96-95a771c30145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:28.323609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef23be7-ffc3-4201-b551-d06d0cbeed11 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:28.346183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6df48-4644-41d9-9f96-95a771c30145 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:28.366374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93eb38-22f3-47b4-a069-9b2e80c218b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:28.366374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93eb38-22f3-47b4-a069-9b2e80c218b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:28.366374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93eb38-22f3-47b4-a069-9b2e80c218b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:28.366374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93eb38-22f3-47b4-a069-9b2e80c218b8 admin admin] PATH_INFO: `/v3/users/b948e2672fb9478f943fdd3ff78c999c` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:28.366798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93eb38-22f3-47b4-a069-9b2e80c218b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b948e2672fb9478f943fdd3ff78c999c)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:28.367984 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93eb38-22f3-47b4-a069-9b2e80c218b8 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:28.555983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-cef23be7-ffc3-4201-b551-d06d0cbeed11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c23f6843520b493aaa1ac846fb0b5f83'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.577039 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-cef23be7-ffc3-4201-b551-d06d0cbeed11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c23f6843520b493aaa1ac846fb0b5f83'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.635257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5d93eb38-22f3-47b4-a069-9b2e80c218b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b948e2672fb9478f943fdd3ff78c999c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.636317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5d93eb38-22f3-47b4-a069-9b2e80c218b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b948e2672fb9478f943fdd3ff78c999c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.636957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5d93eb38-22f3-47b4-a069-9b2e80c218b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b948e2672fb9478f943fdd3ff78c999c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.652260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-cef23be7-ffc3-4201-b551-d06d0cbeed11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c23f6843520b493aaa1ac846fb0b5f83'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.653911 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-cef23be7-ffc3-4201-b551-d06d0cbeed11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c23f6843520b493aaa1ac846fb0b5f83'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.661955 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5d93eb38-22f3-47b4-a069-9b2e80c218b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b948e2672fb9478f943fdd3ff78c999c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.675965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5d93eb38-22f3-47b4-a069-9b2e80c218b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b948e2672fb9478f943fdd3ff78c999c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.686666 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-cef23be7-ffc3-4201-b551-d06d0cbeed11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c23f6843520b493aaa1ac846fb0b5f83'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:28.695301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 898/1775] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:28 2022] DELETE /identity/v3/users/c23f6843520b493aaa1ac846fb0b5f83 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:28.696717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef23be7-ffc3-4201-b551-d06d0cbeed11 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:28.699782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-cef23be7-ffc3-4201-b551-d06d0cbeed11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:28.787505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 878/1776] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:28 2022] DELETE /identity/v3/users/b948e2672fb9478f943fdd3ff78c999c => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:28.788735 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93eb38-22f3-47b4-a069-9b2e80c218b8 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:28.791868 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5d93eb38-22f3-47b4-a069-9b2e80c218b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:28.794432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef23be7-ffc3-4201-b551-d06d0cbeed11 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:28.973875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:28.977796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24765605-2b93-4b1e-ad74-f03b960985a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:28.978823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24765605-2b93-4b1e-ad74-f03b960985a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:28.979338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24765605-2b93-4b1e-ad74-f03b960985a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:28.979639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24765605-2b93-4b1e-ad74-f03b960985a6 admin admin] PATH_INFO: `/v3/projects/20a401ff7e9f4225a8f6154940193b74` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:28.981210 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24765605-2b93-4b1e-ad74-f03b960985a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a401ff7e9f4225a8f6154940193b74)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:28.984100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24765605-2b93-4b1e-ad74-f03b960985a6 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:28.995581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93eb38-22f3-47b4-a069-9b2e80c218b8 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:29.015374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aa582-8f5f-4ded-be92-5124824ccdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:29.016761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aa582-8f5f-4ded-be92-5124824ccdbf admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:29.017048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aa582-8f5f-4ded-be92-5124824ccdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:29.017323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aa582-8f5f-4ded-be92-5124824ccdbf admin admin] PATH_INFO: `/v3/projects/0db75c90c8a04911859391528992d578/users/c47cc5f800da45c9bd5eca983ab55ddb/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:29.058609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2aa582-8f5f-4ded-be92-5124824ccdbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db75c90c8a04911859391528992d578, user_id=c47cc5f800da45c9bd5eca983ab55ddb, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:29.062535 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2aa582-8f5f-4ded-be92-5124824ccdbf admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:29.215526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 879/1777] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:28 2022] PUT /identity/v3/projects/0db75c90c8a04911859391528992d578/users/c47cc5f800da45c9bd5eca983ab55ddb/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:29.231663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24765605-2b93-4b1e-ad74-f03b960985a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a401ff7e9f4225a8f6154940193b74', 'request_id': 'req-24765605-2b93-4b1e-ad74-f03b960985a6'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:29.237156 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ab6b2-471b-4689-8a6e-5f114cef5ce1 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:29.237156 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ab6b2-471b-4689-8a6e-5f114cef5ce1 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:29.237425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ab6b2-471b-4689-8a6e-5f114cef5ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:29.247818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24765605-2b93-4b1e-ad74-f03b960985a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a401ff7e9f4225a8f6154940193b74', 'request_id': 'req-24765605-2b93-4b1e-ad74-f03b960985a6'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:29.262750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:29.269111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24765605-2b93-4b1e-ad74-f03b960985a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a401ff7e9f4225a8f6154940193b74', 'request_id': 'req-24765605-2b93-4b1e-ad74-f03b960985a6'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:29.301882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-232ab6b2-471b-4689-8a6e-5f114cef5ce1 None None] MFA Rules not processed for user `c47cc5f800da45c9bd5eca983ab55ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:29.303221 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-232ab6b2-471b-4689-8a6e-5f114cef5ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:29.333781 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24765605-2b93-4b1e-ad74-f03b960985a6 admin admin] The token cache is being invalidate because project 20a401ff7e9f4225a8f6154940193b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:29.335390 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24765605-2b93-4b1e-ad74-f03b960985a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:29.336272 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24765605-2b93-4b1e-ad74-f03b960985a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:29.338066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 899/1778] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:28 2022] DELETE /identity/v3/projects/20a401ff7e9f4225a8f6154940193b74 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:29.343145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24765605-2b93-4b1e-ad74-f03b960985a6 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:29.344923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-24765605-2b93-4b1e-ad74-f03b960985a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:29.459955 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24765605-2b93-4b1e-ad74-f03b960985a6 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:29.462094 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 880/1779] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:29.462983 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ab6b2-471b-4689-8a6e-5f114cef5ce1 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:29.465009 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-232ab6b2-471b-4689-8a6e-5f114cef5ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:29.469914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3a6a7-e5ae-41ca-8254-4176b0cd1dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:29.472484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a6a7-e5ae-41ca-8254-4176b0cd1dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:29.473913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a6a7-e5ae-41ca-8254-4176b0cd1dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:29.474583 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a6a7-e5ae-41ca-8254-4176b0cd1dd3 admin admin] PATH_INFO: `/v3/users/c94402e49aeb46dcb89ab29f4d049304` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:29.477917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3a6a7-e5ae-41ca-8254-4176b0cd1dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c94402e49aeb46dcb89ab29f4d049304)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:29.480897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3a6a7-e5ae-41ca-8254-4176b0cd1dd3 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:29.486260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ab6b2-471b-4689-8a6e-5f114cef5ce1 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:29.495332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:29.496502 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:29.496502 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:29.496815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd admin admin] PATH_INFO: `/v3/projects/03f9a7826d9c49afb1dd693c089203cd` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:29.499387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f9a7826d9c49afb1dd693c089203cd)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:29.504261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:29.717803 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f9a7826d9c49afb1dd693c089203cd', 'request_id': 'req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:29.729506 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-71a3a6a7-e5ae-41ca-8254-4176b0cd1dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c94402e49aeb46dcb89ab29f4d049304'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:29.741735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-71a3a6a7-e5ae-41ca-8254-4176b0cd1dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c94402e49aeb46dcb89ab29f4d049304'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:29.789559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f9a7826d9c49afb1dd693c089203cd', 'request_id': 'req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:29.802514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f9a7826d9c49afb1dd693c089203cd', 'request_id': 'req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:29.824326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd admin admin] The token cache is being invalidate because project 03f9a7826d9c49afb1dd693c089203cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:29.828166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:29.828166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:29.831054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 881/1780] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:29 2022] DELETE /identity/v3/projects/03f9a7826d9c49afb1dd693c089203cd => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:29.832185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:29.833923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:29.876061 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-71a3a6a7-e5ae-41ca-8254-4176b0cd1dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c94402e49aeb46dcb89ab29f4d049304'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:29.876931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-71a3a6a7-e5ae-41ca-8254-4176b0cd1dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c94402e49aeb46dcb89ab29f4d049304'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:29.900990 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-71a3a6a7-e5ae-41ca-8254-4176b0cd1dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c94402e49aeb46dcb89ab29f4d049304'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:29.924309 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 900/1781] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:29 2022] DELETE /identity/v3/users/c94402e49aeb46dcb89ab29f4d049304 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:29.924309 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3a6a7-e5ae-41ca-8254-4176b0cd1dd3 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:29.927160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-71a3a6a7-e5ae-41ca-8254-4176b0cd1dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:29.989766 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:29.992227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2e00e-cded-4558-ad6d-a2dcb05452bd admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:30.077213 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:30.102734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3a6a7-e5ae-41ca-8254-4176b0cd1dd3 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:30.109549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8e824-5916-4169-9d26-b690d48afc1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:30.110946 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8e824-5916-4169-9d26-b690d48afc1b service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:30.111953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8e824-5916-4169-9d26-b690d48afc1b service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:30.112661 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8e824-5916-4169-9d26-b690d48afc1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:30.115049 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f32cc3-2cc9-4880-be22-e30ec9993d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:30.115848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f32cc3-2cc9-4880-be22-e30ec9993d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:30.116474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f32cc3-2cc9-4880-be22-e30ec9993d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:30.117385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-26a8e824-5916-4169-9d26-b690d48afc1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:30.117740 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f32cc3-2cc9-4880-be22-e30ec9993d63 admin admin] PATH_INFO: `/v3/projects/73620965a981421e8310695f9daef3ae` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:30.120884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f32cc3-2cc9-4880-be22-e30ec9993d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73620965a981421e8310695f9daef3ae)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:30.124431 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f32cc3-2cc9-4880-be22-e30ec9993d63 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:30.300480 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8e824-5916-4169-9d26-b690d48afc1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:30.303195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8e824-5916-4169-9d26-b690d48afc1b service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:30.348582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 882/1782] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:30.350138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e702c1-c924-490e-a451-02f971047664 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:30.350732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e702c1-c924-490e-a451-02f971047664 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:30.351135 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e702c1-c924-490e-a451-02f971047664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:30.389054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-d9e702c1-c924-490e-a451-02f971047664 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:30.396083 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d9e702c1-c924-490e-a451-02f971047664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:30.410516 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24f32cc3-2cc9-4880-be22-e30ec9993d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73620965a981421e8310695f9daef3ae', 'request_id': 'req-24f32cc3-2cc9-4880-be22-e30ec9993d63'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:30.426107 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24f32cc3-2cc9-4880-be22-e30ec9993d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73620965a981421e8310695f9daef3ae', 'request_id': 'req-24f32cc3-2cc9-4880-be22-e30ec9993d63'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:30.457909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24f32cc3-2cc9-4880-be22-e30ec9993d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73620965a981421e8310695f9daef3ae', 'request_id': 'req-24f32cc3-2cc9-4880-be22-e30ec9993d63'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:30.557401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24f32cc3-2cc9-4880-be22-e30ec9993d63 admin admin] The token cache is being invalidate because project 73620965a981421e8310695f9daef3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:30.559877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24f32cc3-2cc9-4880-be22-e30ec9993d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:30.562586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24f32cc3-2cc9-4880-be22-e30ec9993d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:30.568012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 901/1783] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:29 2022] DELETE /identity/v3/projects/73620965a981421e8310695f9daef3ae => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:30.574773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5d18d-db6d-4008-a3e2-9eb56c5590fd None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:30.577738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5d18d-db6d-4008-a3e2-9eb56c5590fd None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:30.577738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5d18d-db6d-4008-a3e2-9eb56c5590fd None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:30.580360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 902/1784] 10.222.0.72 () {54 vars in 921 bytes} [Mon Aug 29 22:58:30 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:58:30.583983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e8d80-e973-42da-83e0-a3edfb59c779 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:30.585314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e8d80-e973-42da-83e0-a3edfb59c779 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:30.585806 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e8d80-e973-42da-83e0-a3edfb59c779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:30.621305 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 883/1785] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:30.623229 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb17d1-6867-44d9-aacd-e82975744fc1 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:30.626958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb17d1-6867-44d9-aacd-e82975744fc1 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:30.627562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb17d1-6867-44d9-aacd-e82975744fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:30.639892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-4a9e8d80-e973-42da-83e0-a3edfb59c779 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:30.642995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4a9e8d80-e973-42da-83e0-a3edfb59c779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:30.653261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-76fb17d1-6867-44d9-aacd-e82975744fc1 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:30.654802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-76fb17d1-6867-44d9-aacd-e82975744fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:30.663826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 884/1786] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:30.665107 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 903/1787] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:30.669018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb17d1-6867-44d9-aacd-e82975744fc1 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:30.676998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31eba1-3140-4c45-9e71-69b7524fe56f None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:30.677277 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31eba1-3140-4c45-9e71-69b7524fe56f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:30.677586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31eba1-3140-4c45-9e71-69b7524fe56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:30.703816 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb17d1-6867-44d9-aacd-e82975744fc1 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:30.724225 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cce3d1-88d2-4635-a415-a02b7ed7a39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:30.724990 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cce3d1-88d2-4635-a415-a02b7ed7a39a admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:30.727868 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cce3d1-88d2-4635-a415-a02b7ed7a39a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:30.728719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cce3d1-88d2-4635-a415-a02b7ed7a39a admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:30.731895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cce3d1-88d2-4635-a415-a02b7ed7a39a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:30.732737 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cce3d1-88d2-4635-a415-a02b7ed7a39a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:30.736598 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-ad31eba1-3140-4c45-9e71-69b7524fe56f None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:30.738290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cce3d1-88d2-4635-a415-a02b7ed7a39a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:30.740011 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ad31eba1-3140-4c45-9e71-69b7524fe56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:30.767210 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 904/1788] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:30.771638 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01d742-9512-43fe-8bb4-365797bfb53a None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:30.772334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01d742-9512-43fe-8bb4-365797bfb53a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:30.772842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01d742-9512-43fe-8bb4-365797bfb53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:30.777842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 885/1789] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:58:30.778812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cce3d1-88d2-4635-a415-a02b7ed7a39a admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:30.790123 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cce3d1-88d2-4635-a415-a02b7ed7a39a admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:30.798463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b409b0-d050-47bb-aa3d-14c0c9d4c90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:30.799134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b409b0-d050-47bb-aa3d-14c0c9d4c90a admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:30.799420 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b409b0-d050-47bb-aa3d-14c0c9d4c90a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:30.799696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b409b0-d050-47bb-aa3d-14c0c9d4c90a admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:30.800401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b409b0-d050-47bb-aa3d-14c0c9d4c90a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:30.800551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-8a01d742-9512-43fe-8bb4-365797bfb53a None None] MFA Rules not processed for user `0be09bd9ba7443aaa31879f56ca4aad1`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:30.800757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b409b0-d050-47bb-aa3d-14c0c9d4c90a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:30.801933 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8a01d742-9512-43fe-8bb4-365797bfb53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:30.802523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b409b0-d050-47bb-aa3d-14c0c9d4c90a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:30.827602 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 886/1790] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:58:30.829130 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b409b0-d050-47bb-aa3d-14c0c9d4c90a admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:30.852891 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b409b0-d050-47bb-aa3d-14c0c9d4c90a admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:30.863644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace9174-645b-4061-bd35-f64d6152be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:30.864365 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace9174-645b-4061-bd35-f64d6152be1b admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:30.864647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace9174-645b-4061-bd35-f64d6152be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:30.864923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace9174-645b-4061-bd35-f64d6152be1b admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:30.865571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace9174-645b-4061-bd35-f64d6152be1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:30.871676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace9174-645b-4061-bd35-f64d6152be1b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:30.890347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:30.951382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 905/1791] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Aug 29 22:58:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:30.952490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01d742-9512-43fe-8bb4-365797bfb53a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:30.964726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01d742-9512-43fe-8bb4-365797bfb53a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:30.969614 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe9d47-e53f-4549-a1bd-b3e651fbf530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:30.970358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe9d47-e53f-4549-a1bd-b3e651fbf530 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:30.970741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe9d47-e53f-4549-a1bd-b3e651fbf530 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:30.972025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe9d47-e53f-4549-a1bd-b3e651fbf530 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:30.972818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe9d47-e53f-4549-a1bd-b3e651fbf530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:30.974846 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe9d47-e53f-4549-a1bd-b3e651fbf530 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:31.046353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 887/1792] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:30 2022] POST /identity/v3/projects => generated 379 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:31.047749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace9174-645b-4061-bd35-f64d6152be1b admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:31.050031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-dace9174-645b-4061-bd35-f64d6152be1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:31.110150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 906/1793] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:30 2022] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:31.111786 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe9d47-e53f-4549-a1bd-b3e651fbf530 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:31.126518 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:31.199826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace9174-645b-4061-bd35-f64d6152be1b admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:31.221400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe9d47-e53f-4549-a1bd-b3e651fbf530 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:31.234896 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac1125-7d94-4b2d-a872-8c885b2fd608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:31.234896 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac1125-7d94-4b2d-a872-8c885b2fd608 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:31.235125 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac1125-7d94-4b2d-a872-8c885b2fd608 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:31.236050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac1125-7d94-4b2d-a872-8c885b2fd608 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:31.236050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac1125-7d94-4b2d-a872-8c885b2fd608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:31.237924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac1125-7d94-4b2d-a872-8c885b2fd608 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:31.324020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 907/1794] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:31 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:31.324020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac1125-7d94-4b2d-a872-8c885b2fd608 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:31.326692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d7796-8ae7-499d-8ad5-c6a6548c798f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:31.327445 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d7796-8ae7-499d-8ad5-c6a6548c798f service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:31.327806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d7796-8ae7-499d-8ad5-c6a6548c798f service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:31.328147 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d7796-8ae7-499d-8ad5-c6a6548c798f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:31.342791 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d7796-8ae7-499d-8ad5-c6a6548c798f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:31.345580 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d7796-8ae7-499d-8ad5-c6a6548c798f service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:31.345834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac1125-7d94-4b2d-a872-8c885b2fd608 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:31.367383 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 888/1795] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:31.369296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d7796-8ae7-499d-8ad5-c6a6548c798f service nova] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:31.373322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-675d7796-8ae7-499d-8ad5-c6a6548c798f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:31.386796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf560b0-5bf2-4cae-bdb0-9bcdf88ebfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:31.387908 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf560b0-5bf2-4cae-bdb0-9bcdf88ebfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:31.388453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf560b0-5bf2-4cae-bdb0-9bcdf88ebfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:31.388639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf560b0-5bf2-4cae-bdb0-9bcdf88ebfe7 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:31.390268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf560b0-5bf2-4cae-bdb0-9bcdf88ebfe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:31.395864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf560b0-5bf2-4cae-bdb0-9bcdf88ebfe7 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:31.414279 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d7796-8ae7-499d-8ad5-c6a6548c798f service nova] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:31.457874 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215819f-16c9-461a-a2bc-ea07caac51fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:31.463817 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215819f-16c9-461a-a2bc-ea07caac51fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:31.463817 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215819f-16c9-461a-a2bc-ea07caac51fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:31.470323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215819f-16c9-461a-a2bc-ea07caac51fc admin admin] PATH_INFO: `/v3/projects/9e55f29abf0f4f9ebb0e40a01dd98e55` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:31.480814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215819f-16c9-461a-a2bc-ea07caac51fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e55f29abf0f4f9ebb0e40a01dd98e55)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:31.491922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215819f-16c9-461a-a2bc-ea07caac51fc admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:31.502775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 908/1796] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:31 2022] POST /identity/v3/users => generated 282 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:31.502775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf560b0-5bf2-4cae-bdb0-9bcdf88ebfe7 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:31.539566 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf560b0-5bf2-4cae-bdb0-9bcdf88ebfe7 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:31.558117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849843da-8e50-4e4c-80e6-7ac3b4a9a1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:31.567200 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849843da-8e50-4e4c-80e6-7ac3b4a9a1aa admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:31.567511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849843da-8e50-4e4c-80e6-7ac3b4a9a1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:31.567794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849843da-8e50-4e4c-80e6-7ac3b4a9a1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:31.571467 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849843da-8e50-4e4c-80e6-7ac3b4a9a1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:31.571467 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849843da-8e50-4e4c-80e6-7ac3b4a9a1aa admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:31.617191 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 909/1797] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:31.617897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849843da-8e50-4e4c-80e6-7ac3b4a9a1aa admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:31.645638 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849843da-8e50-4e4c-80e6-7ac3b4a9a1aa admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:31.658653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafdb0e-d503-4883-a391-a1cee9063a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:31.659343 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafdb0e-d503-4883-a391-a1cee9063a36 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:31.659631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafdb0e-d503-4883-a391-a1cee9063a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:31.659910 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafdb0e-d503-4883-a391-a1cee9063a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:31.660604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafdb0e-d503-4883-a391-a1cee9063a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:31.662300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafdb0e-d503-4883-a391-a1cee9063a36 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:31.680831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 910/1798] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:31.682667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafdb0e-d503-4883-a391-a1cee9063a36 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:31.699928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafdb0e-d503-4883-a391-a1cee9063a36 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:31.705548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c792a-a183-4ef7-ac27-df3dcd8f2822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:31.706228 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c792a-a183-4ef7-ac27-df3dcd8f2822 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:31.706508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c792a-a183-4ef7-ac27-df3dcd8f2822 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:31.706782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c792a-a183-4ef7-ac27-df3dcd8f2822 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:31.707484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c792a-a183-4ef7-ac27-df3dcd8f2822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:31.709160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c792a-a183-4ef7-ac27-df3dcd8f2822 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:31.726860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 911/1799] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:31.730677 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c792a-a183-4ef7-ac27-df3dcd8f2822 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:31.742714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c792a-a183-4ef7-ac27-df3dcd8f2822 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:31.765951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b215819f-16c9-461a-a2bc-ea07caac51fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e55f29abf0f4f9ebb0e40a01dd98e55', 'request_id': 'req-b215819f-16c9-461a-a2bc-ea07caac51fc'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:31.874541 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8631239-ada7-4733-9b24-8c203c86c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:31.875503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8631239-ada7-4733-9b24-8c203c86c9bb admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:31.876007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8631239-ada7-4733-9b24-8c203c86c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:31.876328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8631239-ada7-4733-9b24-8c203c86c9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:31.877948 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b215819f-16c9-461a-a2bc-ea07caac51fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e55f29abf0f4f9ebb0e40a01dd98e55', 'request_id': 'req-b215819f-16c9-461a-a2bc-ea07caac51fc'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:31.887127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8631239-ada7-4733-9b24-8c203c86c9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:31.888719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8631239-ada7-4733-9b24-8c203c86c9bb admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:31.890943 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b215819f-16c9-461a-a2bc-ea07caac51fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e55f29abf0f4f9ebb0e40a01dd98e55', 'request_id': 'req-b215819f-16c9-461a-a2bc-ea07caac51fc'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:31.916822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 912/1800] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:31.916822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8631239-ada7-4733-9b24-8c203c86c9bb admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:31.919661 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:31.933527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8631239-ada7-4733-9b24-8c203c86c9bb admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:31.934406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b215819f-16c9-461a-a2bc-ea07caac51fc admin admin] The token cache is being invalidate because project 9e55f29abf0f4f9ebb0e40a01dd98e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:31.936090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b215819f-16c9-461a-a2bc-ea07caac51fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:31.937473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b215819f-16c9-461a-a2bc-ea07caac51fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:31.939938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26894650-bcbf-41e3-b1a8-28b75ed600e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:31.940922 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26894650-bcbf-41e3-b1a8-28b75ed600e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:31.941216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26894650-bcbf-41e3-b1a8-28b75ed600e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:31.943981 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26894650-bcbf-41e3-b1a8-28b75ed600e5 admin admin] PATH_INFO: `/v3/projects/e7e55cb4661f40a48d1b980dd71ead2f/users/617cf199c555468db6173b4ca67dc4fb/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:31.950145 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 889/1801] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:31 2022] DELETE /identity/v3/projects/9e55f29abf0f4f9ebb0e40a01dd98e55 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:31.956178 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215819f-16c9-461a-a2bc-ea07caac51fc admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:31.956178 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b215819f-16c9-461a-a2bc-ea07caac51fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:31.969852 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26894650-bcbf-41e3-b1a8-28b75ed600e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e55cb4661f40a48d1b980dd71ead2f, user_id=617cf199c555468db6173b4ca67dc4fb, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:31.975276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26894650-bcbf-41e3-b1a8-28b75ed600e5 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:31.979344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215819f-16c9-461a-a2bc-ea07caac51fc admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:31.988310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db0b77-98e8-4e12-bb57-01da2449f428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:31.989401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db0b77-98e8-4e12-bb57-01da2449f428 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:31.989752 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db0b77-98e8-4e12-bb57-01da2449f428 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:31.990209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db0b77-98e8-4e12-bb57-01da2449f428 admin admin] PATH_INFO: `/v3/projects/aea60bf3e97c406faad49942bdd5511e/users/7f23504aae9b48ee9913af8427455a10/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:32.022798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db0b77-98e8-4e12-bb57-01da2449f428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea60bf3e97c406faad49942bdd5511e, user_id=7f23504aae9b48ee9913af8427455a10, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:32.027423 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db0b77-98e8-4e12-bb57-01da2449f428 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:32.077927 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 913/1802] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:31 2022] PUT /identity/v3/projects/e7e55cb4661f40a48d1b980dd71ead2f/users/617cf199c555468db6173b4ca67dc4fb/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:32.079262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7535c8c-4a0b-43ca-8f9b-42ef41ba0037 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:32.079954 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7535c8c-4a0b-43ca-8f9b-42ef41ba0037 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:32.079954 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7535c8c-4a0b-43ca-8f9b-42ef41ba0037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:32.098987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 890/1803] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:31 2022] PUT /identity/v3/projects/aea60bf3e97c406faad49942bdd5511e/users/7f23504aae9b48ee9913af8427455a10/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:32.100421 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cbd8a-949b-4826-8994-a0eea8401b39 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:32.100845 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cbd8a-949b-4826-8994-a0eea8401b39 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:32.101548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cbd8a-949b-4826-8994-a0eea8401b39 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:32.103037 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 891/1804] 10.222.0.72 () {54 vars in 921 bytes} [Mon Aug 29 22:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:58:32.115811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc7264-1575-4547-a444-eff20529eabe None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:32.115811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc7264-1575-4547-a444-eff20529eabe None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:32.115811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc7264-1575-4547-a444-eff20529eabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:32.132367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f7535c8c-4a0b-43ca-8f9b-42ef41ba0037 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:32.134425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f7535c8c-4a0b-43ca-8f9b-42ef41ba0037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:32.158363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-f9dc7264-1575-4547-a444-eff20529eabe None None] MFA Rules not processed for user `617cf199c555468db6173b4ca67dc4fb`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:32.159830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f9dc7264-1575-4547-a444-eff20529eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:32.167273 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:32.269113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 914/1805] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:32.271290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ebea3-1b72-47a6-bdea-10ad5e0f7e5d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:32.271574 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ebea3-1b72-47a6-bdea-10ad5e0f7e5d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:32.274227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 892/1806] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:32.275808 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ebea3-1b72-47a6-bdea-10ad5e0f7e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:32.279371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e468f5b-8ab6-47d9-9c04-01ca5e0d5547 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:32.279654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e468f5b-8ab6-47d9-9c04-01ca5e0d5547 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:32.280073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e468f5b-8ab6-47d9-9c04-01ca5e0d5547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:32.322197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-323ebea3-1b72-47a6-bdea-10ad5e0f7e5d None None] MFA Rules not processed for user `0be09bd9ba7443aaa31879f56ca4aad1`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:32.324806 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-323ebea3-1b72-47a6-bdea-10ad5e0f7e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:32.336559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-1e468f5b-8ab6-47d9-9c04-01ca5e0d5547 None None] MFA Rules not processed for user `7f23504aae9b48ee9913af8427455a10`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:32.339454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1e468f5b-8ab6-47d9-9c04-01ca5e0d5547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:32.440521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 915/1807] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Aug 29 22:58:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:32.441877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb910d2-cd13-4fac-9f57-146f1aaaef2e None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:32.442288 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb910d2-cd13-4fac-9f57-146f1aaaef2e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:32.442549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb910d2-cd13-4fac-9f57-146f1aaaef2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:32.486478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-afb910d2-cd13-4fac-9f57-146f1aaaef2e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:32.487568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-afb910d2-cd13-4fac-9f57-146f1aaaef2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:32.499709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 916/1808] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:32.499709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb910d2-cd13-4fac-9f57-146f1aaaef2e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:32.506463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-afb910d2-cd13-4fac-9f57-146f1aaaef2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:32.522867 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb910d2-cd13-4fac-9f57-146f1aaaef2e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:32.529954 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe9d7f-2554-46de-b641-a35cc08b21e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:32.530455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe9d7f-2554-46de-b641-a35cc08b21e0 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:32.530798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe9d7f-2554-46de-b641-a35cc08b21e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:32.531361 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe9d7f-2554-46de-b641-a35cc08b21e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:32.532302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe9d7f-2554-46de-b641-a35cc08b21e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:32.534400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe9d7f-2554-46de-b641-a35cc08b21e0 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:32.554140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 893/1809] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:32.554140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e468f5b-8ab6-47d9-9c04-01ca5e0d5547 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:32.554140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1e468f5b-8ab6-47d9-9c04-01ca5e0d5547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:32.582354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e468f5b-8ab6-47d9-9c04-01ca5e0d5547 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:32.597187 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222bfc-12a0-49b1-8b9f-1ff04fc46021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:32.608885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222bfc-12a0-49b1-8b9f-1ff04fc46021 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:32.608885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222bfc-12a0-49b1-8b9f-1ff04fc46021 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:32.608885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222bfc-12a0-49b1-8b9f-1ff04fc46021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:32.621557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03222bfc-12a0-49b1-8b9f-1ff04fc46021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:32.624338 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03222bfc-12a0-49b1-8b9f-1ff04fc46021 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:32.645308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 917/1810] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:32 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:32.645550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe9d7f-2554-46de-b641-a35cc08b21e0 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:32.684829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 894/1811] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:32.684829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222bfc-12a0-49b1-8b9f-1ff04fc46021 service nova] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:32.726512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222bfc-12a0-49b1-8b9f-1ff04fc46021 service nova] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:32.860695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:32.870062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe9d7f-2554-46de-b641-a35cc08b21e0 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:32.882162 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:32.909264 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269e3a9-1b57-4f47-a169-5eb513ec0bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:32.910425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269e3a9-1b57-4f47-a169-5eb513ec0bcc admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:32.910970 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269e3a9-1b57-4f47-a169-5eb513ec0bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:32.911434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269e3a9-1b57-4f47-a169-5eb513ec0bcc admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:32.940260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269e3a9-1b57-4f47-a169-5eb513ec0bcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:32.940512 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269e3a9-1b57-4f47-a169-5eb513ec0bcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:32.942183 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269e3a9-1b57-4f47-a169-5eb513ec0bcc admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:32.955803 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46419e0-b850-4225-97d1-7ee8e4ae8952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:32.956888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46419e0-b850-4225-97d1-7ee8e4ae8952 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:32.958741 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46419e0-b850-4225-97d1-7ee8e4ae8952 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:32.959217 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46419e0-b850-4225-97d1-7ee8e4ae8952 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:32.968169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46419e0-b850-4225-97d1-7ee8e4ae8952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:32.972104 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46419e0-b850-4225-97d1-7ee8e4ae8952 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:32.996460 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 918/1812] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:58:32.997453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269e3a9-1b57-4f47-a169-5eb513ec0bcc admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:33.022702 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269e3a9-1b57-4f47-a169-5eb513ec0bcc admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:33.046141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a3cb4-7c25-4785-9a13-26b9ed8bddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:33.048184 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3cb4-7c25-4785-9a13-26b9ed8bddde admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:33.048184 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3cb4-7c25-4785-9a13-26b9ed8bddde admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:33.048534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3cb4-7c25-4785-9a13-26b9ed8bddde admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:33.051654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a3cb4-7c25-4785-9a13-26b9ed8bddde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:33.058633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a3cb4-7c25-4785-9a13-26b9ed8bddde admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:33.145970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 895/1813] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:32 2022] POST /identity/v3/projects => generated 365 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:33.152793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46419e0-b850-4225-97d1-7ee8e4ae8952 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:33.215626 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 919/1814] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:32 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:33.219638 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a3cb4-7c25-4785-9a13-26b9ed8bddde admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:33.265940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a3cb4-7c25-4785-9a13-26b9ed8bddde admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:33.330889 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46419e0-b850-4225-97d1-7ee8e4ae8952 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:33.338510 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdb42a-8e02-4c65-8eca-924a00a1d6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:33.339837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdb42a-8e02-4c65-8eca-924a00a1d6ec admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:33.340330 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdb42a-8e02-4c65-8eca-924a00a1d6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:33.340750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdb42a-8e02-4c65-8eca-924a00a1d6ec admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:33.342108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdb42a-8e02-4c65-8eca-924a00a1d6ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:33.344938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdb42a-8e02-4c65-8eca-924a00a1d6ec admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:33.376001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8c165-5288-42b6-9f10-880aba0313c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:33.376670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8c165-5288-42b6-9f10-880aba0313c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:33.376938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8c165-5288-42b6-9f10-880aba0313c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:33.377212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8c165-5288-42b6-9f10-880aba0313c0 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:33.377856 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8c165-5288-42b6-9f10-880aba0313c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:33.380228 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8c165-5288-42b6-9f10-880aba0313c0 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:33.490570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 896/1815] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:33 2022] POST /identity/v3/projects => generated 377 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:33.496815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 920/1816] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:33 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:33.497196 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdb42a-8e02-4c65-8eca-924a00a1d6ec admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:33.497753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8c165-5288-42b6-9f10-880aba0313c0 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:33.539881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8c165-5288-42b6-9f10-880aba0313c0 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:33.637835 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdb42a-8e02-4c65-8eca-924a00a1d6ec admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:33.644573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c87b93-f4fb-4283-bad2-2738f6ad1da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:33.645389 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c87b93-f4fb-4283-bad2-2738f6ad1da4 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:33.645774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c87b93-f4fb-4283-bad2-2738f6ad1da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:33.646162 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c87b93-f4fb-4283-bad2-2738f6ad1da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:33.646933 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c87b93-f4fb-4283-bad2-2738f6ad1da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:33.649136 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c87b93-f4fb-4283-bad2-2738f6ad1da4 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:33.671475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff86da-4233-43b4-abbe-8e25bb8b1806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:33.672581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 897/1817] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:33.673293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff86da-4233-43b4-abbe-8e25bb8b1806 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:33.673721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c87b93-f4fb-4283-bad2-2738f6ad1da4 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:33.673837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff86da-4233-43b4-abbe-8e25bb8b1806 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:33.674482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff86da-4233-43b4-abbe-8e25bb8b1806 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:33.675600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff86da-4233-43b4-abbe-8e25bb8b1806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:33.680551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff86da-4233-43b4-abbe-8e25bb8b1806 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:33.686595 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c87b93-f4fb-4283-bad2-2738f6ad1da4 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:33.692177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b875ed-6b53-4ca6-97a7-d23e071ff14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:33.693200 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b875ed-6b53-4ca6-97a7-d23e071ff14c admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:33.693578 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b875ed-6b53-4ca6-97a7-d23e071ff14c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:33.693878 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b875ed-6b53-4ca6-97a7-d23e071ff14c admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:33.694603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b875ed-6b53-4ca6-97a7-d23e071ff14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:33.697189 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b875ed-6b53-4ca6-97a7-d23e071ff14c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:33.713512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 898/1818] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:33.718444 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b875ed-6b53-4ca6-97a7-d23e071ff14c admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:33.725630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b875ed-6b53-4ca6-97a7-d23e071ff14c admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:33.732327 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc88c2-8d99-4321-a4eb-072f36e0f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:33.733804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc88c2-8d99-4321-a4eb-072f36e0f219 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:33.734194 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc88c2-8d99-4321-a4eb-072f36e0f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:33.734486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc88c2-8d99-4321-a4eb-072f36e0f219 admin admin] PATH_INFO: `/v3/projects/63bfd58b00d54962a9fbd63e3dfcb2a2/users/2c8ace04656e4a9c9c81af41d4bf517f/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:33.770204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc88c2-8d99-4321-a4eb-072f36e0f219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63bfd58b00d54962a9fbd63e3dfcb2a2, user_id=2c8ace04656e4a9c9c81af41d4bf517f, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:33.776632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc88c2-8d99-4321-a4eb-072f36e0f219 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:33.814532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 921/1819] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:33 2022] POST /identity/v3/users => generated 289 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:33.815616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff86da-4233-43b4-abbe-8e25bb8b1806 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:33.827899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff86da-4233-43b4-abbe-8e25bb8b1806 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:33.836770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73221c1d-ce8d-4f8d-b737-7cfb165eac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:33.837467 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73221c1d-ce8d-4f8d-b737-7cfb165eac71 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:33.837842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73221c1d-ce8d-4f8d-b737-7cfb165eac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:33.838138 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73221c1d-ce8d-4f8d-b737-7cfb165eac71 admin admin] PATH_INFO: `/v3/projects/d2c2e5278153415aa82cbe98f3b58136/users/0df5c4afb1c8470295f50172f02c445b/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:33.866406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73221c1d-ce8d-4f8d-b737-7cfb165eac71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c2e5278153415aa82cbe98f3b58136, user_id=0df5c4afb1c8470295f50172f02c445b, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:33.872356 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73221c1d-ce8d-4f8d-b737-7cfb165eac71 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:33.947069 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 899/1820] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:33 2022] PUT /identity/v3/projects/63bfd58b00d54962a9fbd63e3dfcb2a2/users/2c8ace04656e4a9c9c81af41d4bf517f/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:33.948788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc88c2-8d99-4321-a4eb-072f36e0f219 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:33.989853 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:33.997133 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 922/1821] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:33 2022] PUT /identity/v3/projects/d2c2e5278153415aa82cbe98f3b58136/users/0df5c4afb1c8470295f50172f02c445b/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:33.999319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73221c1d-ce8d-4f8d-b737-7cfb165eac71 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.111462 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:34.163000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc88c2-8d99-4321-a4eb-072f36e0f219 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.177439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330c237-c67a-4644-a8a2-a44e707adbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.178178 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330c237-c67a-4644-a8a2-a44e707adbae admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.178621 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330c237-c67a-4644-a8a2-a44e707adbae admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.179008 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330c237-c67a-4644-a8a2-a44e707adbae admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.179996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330c237-c67a-4644-a8a2-a44e707adbae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.182509 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330c237-c67a-4644-a8a2-a44e707adbae admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.190812 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73221c1d-ce8d-4f8d-b737-7cfb165eac71 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.202867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 900/1822] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:34.202867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330c237-c67a-4644-a8a2-a44e707adbae admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.203426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e10ca6-0026-4bff-b540-cae87c8e0a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.203426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e10ca6-0026-4bff-b540-cae87c8e0a5d admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.203426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e10ca6-0026-4bff-b540-cae87c8e0a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.203426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e10ca6-0026-4bff-b540-cae87c8e0a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.203962 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e10ca6-0026-4bff-b540-cae87c8e0a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.207978 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e10ca6-0026-4bff-b540-cae87c8e0a5d admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.219099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330c237-c67a-4644-a8a2-a44e707adbae admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.225734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 923/1823] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:34.226621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e10ca6-0026-4bff-b540-cae87c8e0a5d admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.236238 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f424b-7515-4362-9c27-e6cea349186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.236515 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f424b-7515-4362-9c27-e6cea349186c admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.236796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f424b-7515-4362-9c27-e6cea349186c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.237037 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f424b-7515-4362-9c27-e6cea349186c admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.237841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f424b-7515-4362-9c27-e6cea349186c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.239799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f424b-7515-4362-9c27-e6cea349186c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.250062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e10ca6-0026-4bff-b540-cae87c8e0a5d admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.258384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 901/1824] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:34.263136 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f424b-7515-4362-9c27-e6cea349186c admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.266578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09f598-1752-4ce6-8061-7b9ffac3a35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.266764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09f598-1752-4ce6-8061-7b9ffac3a35f admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.266985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09f598-1752-4ce6-8061-7b9ffac3a35f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.267857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09f598-1752-4ce6-8061-7b9ffac3a35f admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.267857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09f598-1752-4ce6-8061-7b9ffac3a35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.269527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09f598-1752-4ce6-8061-7b9ffac3a35f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.282651 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f424b-7515-4362-9c27-e6cea349186c admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.289286 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd52d2-8634-4567-a838-971f70d44f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.291697 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd52d2-8634-4567-a838-971f70d44f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.291986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd52d2-8634-4567-a838-971f70d44f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.293359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd52d2-8634-4567-a838-971f70d44f28 admin admin] PATH_INFO: `/v3/projects/63bfd58b00d54962a9fbd63e3dfcb2a2/users/2c8ace04656e4a9c9c81af41d4bf517f/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.298007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 924/1825] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:34.298984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09f598-1752-4ce6-8061-7b9ffac3a35f admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.299501 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd52d2-8634-4567-a838-971f70d44f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63bfd58b00d54962a9fbd63e3dfcb2a2, user_id=2c8ace04656e4a9c9c81af41d4bf517f, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.302659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd52d2-8634-4567-a838-971f70d44f28 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.318221 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 902/1826] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:34 2022] PUT /identity/v3/projects/63bfd58b00d54962a9fbd63e3dfcb2a2/users/2c8ace04656e4a9c9c81af41d4bf517f/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:34.319076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd52d2-8634-4567-a838-971f70d44f28 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.320935 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09f598-1752-4ce6-8061-7b9ffac3a35f admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.425226 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5d2d3-8458-4e32-94e3-68a2fce84b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.428598 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5d2d3-8458-4e32-94e3-68a2fce84b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.428749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd52d2-8634-4567-a838-971f70d44f28 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.428887 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5d2d3-8458-4e32-94e3-68a2fce84b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.429297 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5d2d3-8458-4e32-94e3-68a2fce84b23 admin admin] PATH_INFO: `/v3/projects/d2c2e5278153415aa82cbe98f3b58136/users/0df5c4afb1c8470295f50172f02c445b/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.432198 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5d2d3-8458-4e32-94e3-68a2fce84b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c2e5278153415aa82cbe98f3b58136, user_id=0df5c4afb1c8470295f50172f02c445b, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.434827 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091fcfb-55e2-43f6-bd5b-44c8d167f93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.435025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5d2d3-8458-4e32-94e3-68a2fce84b23 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.435443 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091fcfb-55e2-43f6-bd5b-44c8d167f93d admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.435862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091fcfb-55e2-43f6-bd5b-44c8d167f93d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.436149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091fcfb-55e2-43f6-bd5b-44c8d167f93d admin admin] PATH_INFO: `/v3/projects/59c36aa0c6784366ad2f51bc07813124/users/07d08290883240d29e7c8f4064770435/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.451877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 925/1827] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:34 2022] PUT /identity/v3/projects/d2c2e5278153415aa82cbe98f3b58136/users/0df5c4afb1c8470295f50172f02c445b/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:34.454647 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50687301-b53b-4019-b97f-910a9b6f4ec2 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.455883 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50687301-b53b-4019-b97f-910a9b6f4ec2 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.461336 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50687301-b53b-4019-b97f-910a9b6f4ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.465160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091fcfb-55e2-43f6-bd5b-44c8d167f93d admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c36aa0c6784366ad2f51bc07813124, user_id=07d08290883240d29e7c8f4064770435, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.468393 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091fcfb-55e2-43f6-bd5b-44c8d167f93d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.500706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-50687301-b53b-4019-b97f-910a9b6f4ec2 None None] MFA Rules not processed for user `2c8ace04656e4a9c9c81af41d4bf517f`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:34.501993 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-50687301-b53b-4019-b97f-910a9b6f4ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:34.579158 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 903/1828] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:34 2022] PUT /identity/v3/projects/59c36aa0c6784366ad2f51bc07813124/users/07d08290883240d29e7c8f4064770435/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:34.580618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426987df-ff26-4608-b6e7-107446af2f9a None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.580865 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426987df-ff26-4608-b6e7-107446af2f9a None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.581144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426987df-ff26-4608-b6e7-107446af2f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.615607 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 926/1829] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:34.618552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fadd50-40a9-46db-981c-b92bf544c2b6 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.618996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fadd50-40a9-46db-981c-b92bf544c2b6 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.619503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fadd50-40a9-46db-981c-b92bf544c2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.633820 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-426987df-ff26-4608-b6e7-107446af2f9a None None] MFA Rules not processed for user `0df5c4afb1c8470295f50172f02c445b`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:34.635791 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-426987df-ff26-4608-b6e7-107446af2f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:34.668390 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-b5fadd50-40a9-46db-981c-b92bf544c2b6 None None] MFA Rules not processed for user `07d08290883240d29e7c8f4064770435`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:34.681333 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b5fadd50-40a9-46db-981c-b92bf544c2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:34.741827 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 904/1830] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:34.746799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426987df-ff26-4608-b6e7-107446af2f9a None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.746942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-426987df-ff26-4608-b6e7-107446af2f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:34.789252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 927/1831] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:34.794874 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fadd50-40a9-46db-981c-b92bf544c2b6 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.827055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426987df-ff26-4608-b6e7-107446af2f9a None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.842760 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41478533-142d-403f-bc73-c46ed863f2c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.843422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41478533-142d-403f-bc73-c46ed863f2c2 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.843702 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41478533-142d-403f-bc73-c46ed863f2c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.843977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41478533-142d-403f-bc73-c46ed863f2c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.902021 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:34.913083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fadd50-40a9-46db-981c-b92bf544c2b6 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.919824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521135b-62c2-473f-85e3-111466349b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.920488 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521135b-62c2-473f-85e3-111466349b78 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.920834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521135b-62c2-473f-85e3-111466349b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.921121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521135b-62c2-473f-85e3-111466349b78 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.921774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521135b-62c2-473f-85e3-111466349b78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.924217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521135b-62c2-473f-85e3-111466349b78 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.932184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41478533-142d-403f-bc73-c46ed863f2c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.934006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41478533-142d-403f-bc73-c46ed863f2c2 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.947936 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 905/1832] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:34.949098 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41478533-142d-403f-bc73-c46ed863f2c2 service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.951529 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-41478533-142d-403f-bc73-c46ed863f2c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:34.968104 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41478533-142d-403f-bc73-c46ed863f2c2 service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.973308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925ffd6-801d-4d68-96a6-2abf553db836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.973855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925ffd6-801d-4d68-96a6-2abf553db836 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.975070 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925ffd6-801d-4d68-96a6-2abf553db836 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.975368 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925ffd6-801d-4d68-96a6-2abf553db836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.988274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925ffd6-801d-4d68-96a6-2abf553db836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.990371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925ffd6-801d-4d68-96a6-2abf553db836 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:35.017909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:35.021451 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 928/1833] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:34 2022] POST /identity/v3/projects => generated 375 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:58:35.028599 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521135b-62c2-473f-85e3-111466349b78 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:35.036777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 906/1834] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:35.164347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521135b-62c2-473f-85e3-111466349b78 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:35.170865 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7798f67-dbf0-4793-b147-72e47322b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:35.171439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7798f67-dbf0-4793-b147-72e47322b80f admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:35.171720 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7798f67-dbf0-4793-b147-72e47322b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:35.171995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7798f67-dbf0-4793-b147-72e47322b80f admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:35.172697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7798f67-dbf0-4793-b147-72e47322b80f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:35.174893 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7798f67-dbf0-4793-b147-72e47322b80f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:35.338346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 929/1835] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:35 2022] POST /identity/v3/users => generated 294 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:35.347510 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925ffd6-801d-4d68-96a6-2abf553db836 service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:35.360319 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925ffd6-801d-4d68-96a6-2abf553db836 service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:35.384930 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bc926-de22-40aa-bde4-cd282366638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:35.388241 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bc926-de22-40aa-bde4-cd282366638a admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:35.392258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bc926-de22-40aa-bde4-cd282366638a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:35.394943 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bc926-de22-40aa-bde4-cd282366638a admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:35.396022 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bc926-de22-40aa-bde4-cd282366638a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:35.405013 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bc926-de22-40aa-bde4-cd282366638a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:35.435625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 907/1836] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:35.439967 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7798f67-dbf0-4793-b147-72e47322b80f admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:35.453813 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7798f67-dbf0-4793-b147-72e47322b80f admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:35.464309 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4636dd1-6fbe-42b1-ba8f-4bb75afee0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:35.465407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4636dd1-6fbe-42b1-ba8f-4bb75afee0ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:35.466291 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4636dd1-6fbe-42b1-ba8f-4bb75afee0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:35.468368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4636dd1-6fbe-42b1-ba8f-4bb75afee0ba admin admin] PATH_INFO: `/v3/projects/d4257f6c3c4e4c5d93bc162c0f238475/users/639cdfd62a404c2bbe31a449664dcc31/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:35.504295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4636dd1-6fbe-42b1-ba8f-4bb75afee0ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4257f6c3c4e4c5d93bc162c0f238475, user_id=639cdfd62a404c2bbe31a449664dcc31, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:35.509930 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4636dd1-6fbe-42b1-ba8f-4bb75afee0ba admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:35.596230 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 930/1837] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:35 2022] PUT /identity/v3/projects/d4257f6c3c4e4c5d93bc162c0f238475/users/639cdfd62a404c2bbe31a449664dcc31/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:35.600452 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bc926-de22-40aa-bde4-cd282366638a admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:35.616326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bc926-de22-40aa-bde4-cd282366638a admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:35.726006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4eb000-c069-4ef3-8a32-99a852776201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:35.726793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4eb000-c069-4ef3-8a32-99a852776201 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:35.727178 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4eb000-c069-4ef3-8a32-99a852776201 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:35.727553 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4eb000-c069-4ef3-8a32-99a852776201 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:35.728968 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4eb000-c069-4ef3-8a32-99a852776201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:35.731133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4eb000-c069-4ef3-8a32-99a852776201 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:35.749266 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 908/1838] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:35.753073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4636dd1-6fbe-42b1-ba8f-4bb75afee0ba admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:35.787133 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4636dd1-6fbe-42b1-ba8f-4bb75afee0ba admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:35.819502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d3ae2-db9f-45db-a807-1a215943490c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:35.820212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d3ae2-db9f-45db-a807-1a215943490c admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:35.821024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d3ae2-db9f-45db-a807-1a215943490c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:35.821477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d3ae2-db9f-45db-a807-1a215943490c admin admin] PATH_INFO: `/v3/projects/d4257f6c3c4e4c5d93bc162c0f238475/users/639cdfd62a404c2bbe31a449664dcc31/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:35.825460 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d3ae2-db9f-45db-a807-1a215943490c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4257f6c3c4e4c5d93bc162c0f238475, user_id=639cdfd62a404c2bbe31a449664dcc31, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:35.828173 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d3ae2-db9f-45db-a807-1a215943490c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:35.855034 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 931/1839] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:35 2022] PUT /identity/v3/projects/d4257f6c3c4e4c5d93bc162c0f238475/users/639cdfd62a404c2bbe31a449664dcc31/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:35.867397 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8acb89-b6ce-4e1e-8bd2-47d498090261 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:35.869841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8acb89-b6ce-4e1e-8bd2-47d498090261 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:35.870219 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8acb89-b6ce-4e1e-8bd2-47d498090261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:35.908182 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:35.913453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-5c8acb89-b6ce-4e1e-8bd2-47d498090261 None None] MFA Rules not processed for user `639cdfd62a404c2bbe31a449664dcc31`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:35.914731 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5c8acb89-b6ce-4e1e-8bd2-47d498090261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:35.996311 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:36.042178 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 909/1840] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:37.609784 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d3ae2-db9f-45db-a807-1a215943490c admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:37.704164 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d3ae2-db9f-45db-a807-1a215943490c admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:37.713164 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22895e-f4f2-4024-a818-acbbeaaa36c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:37.719834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22895e-f4f2-4024-a818-acbbeaaa36c1 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:37.726801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22895e-f4f2-4024-a818-acbbeaaa36c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:37.727100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22895e-f4f2-4024-a818-acbbeaaa36c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:37.832294 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22895e-f4f2-4024-a818-acbbeaaa36c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:37.837897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22895e-f4f2-4024-a818-acbbeaaa36c1 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:37.850063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 932/1841] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:38.157272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8acb89-b6ce-4e1e-8bd2-47d498090261 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:38.249110 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8acb89-b6ce-4e1e-8bd2-47d498090261 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:38.258359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ff2d4-81fb-4000-ab89-adb0945def76 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8ace04656e4a9c9c81af41d4bf517f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63bfd58b00d54962a9fbd63e3dfcb2a2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:38.260789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ff2d4-81fb-4000-ab89-adb0945def76 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:38.260789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ff2d4-81fb-4000-ab89-adb0945def76 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:38.261578 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ff2d4-81fb-4000-ab89-adb0945def76 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:38.262962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ff2d4-81fb-4000-ab89-adb0945def76 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:38.263961 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ff2d4-81fb-4000-ab89-adb0945def76 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:38.266044 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ff2d4-81fb-4000-ab89-adb0945def76 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:38.283505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 910/1842] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:58:38.284703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22895e-f4f2-4024-a818-acbbeaaa36c1 service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:38.296345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22895e-f4f2-4024-a818-acbbeaaa36c1 service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:38.301476 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bfde4-909a-47e0-b40a-e4e8b8d71b3a tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8ace04656e4a9c9c81af41d4bf517f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63bfd58b00d54962a9fbd63e3dfcb2a2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:38.302154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bfde4-909a-47e0-b40a-e4e8b8d71b3a tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:38.302491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bfde4-909a-47e0-b40a-e4e8b8d71b3a tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:38.303094 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bfde4-909a-47e0-b40a-e4e8b8d71b3a tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:38.303440 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bfde4-909a-47e0-b40a-e4e8b8d71b3a tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:38.305481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bfde4-909a-47e0-b40a-e4e8b8d71b3a tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:38.423822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 933/1843] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:38 2022] POST /identity/v3/projects => generated 353 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:38.428125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ff2d4-81fb-4000-ab89-adb0945def76 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:38.441744 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ff2d4-81fb-4000-ab89-adb0945def76 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:38.510671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a428044-6f84-4728-856a-4df3d0a7f5d2 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8ace04656e4a9c9c81af41d4bf517f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63bfd58b00d54962a9fbd63e3dfcb2a2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:38.511002 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428044-6f84-4728-856a-4df3d0a7f5d2 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:38.511287 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428044-6f84-4728-856a-4df3d0a7f5d2 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:38.511568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428044-6f84-4728-856a-4df3d0a7f5d2 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:38.512317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a428044-6f84-4728-856a-4df3d0a7f5d2 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:38.512624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a428044-6f84-4728-856a-4df3d0a7f5d2 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:38.514235 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a428044-6f84-4728-856a-4df3d0a7f5d2 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:38.529313 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 911/1844] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:58:38.709979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bfde4-909a-47e0-b40a-e4e8b8d71b3a tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:38.722144 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bfde4-909a-47e0-b40a-e4e8b8d71b3a tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:38.731467 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c11435-5721-4b81-ba55-09c7c5131073 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8ace04656e4a9c9c81af41d4bf517f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63bfd58b00d54962a9fbd63e3dfcb2a2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:38.734611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c11435-5721-4b81-ba55-09c7c5131073 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:38.735194 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c11435-5721-4b81-ba55-09c7c5131073 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:38.735922 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c11435-5721-4b81-ba55-09c7c5131073 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] PATH_INFO: `/v3/projects/995eade935fe4f94a466ad8849d898ff` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:38.740814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c11435-5721-4b81-ba55-09c7c5131073 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] RBAC: Authorizing `identity:delete_project(project_id=995eade935fe4f94a466ad8849d898ff)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:38.747041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c11435-5721-4b81-ba55-09c7c5131073 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:38.965791 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c9c11435-5721-4b81-ba55-09c7c5131073 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995eade935fe4f94a466ad8849d898ff', 'request_id': 'req-c9c11435-5721-4b81-ba55-09c7c5131073'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:38.976169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c9c11435-5721-4b81-ba55-09c7c5131073 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995eade935fe4f94a466ad8849d898ff', 'request_id': 'req-c9c11435-5721-4b81-ba55-09c7c5131073'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:38.984558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c9c11435-5721-4b81-ba55-09c7c5131073 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995eade935fe4f94a466ad8849d898ff', 'request_id': 'req-c9c11435-5721-4b81-ba55-09c7c5131073'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:39.081158 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c9c11435-5721-4b81-ba55-09c7c5131073 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] The token cache is being invalidate because project 995eade935fe4f94a466ad8849d898ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:39.081158 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c9c11435-5721-4b81-ba55-09c7c5131073 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:39.081490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c9c11435-5721-4b81-ba55-09c7c5131073 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:39.088960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 934/1845] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:38 2022] DELETE /identity/v3/projects/995eade935fe4f94a466ad8849d898ff => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:39.428424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a428044-6f84-4728-856a-4df3d0a7f5d2 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:39.431012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7a428044-6f84-4728-856a-4df3d0a7f5d2 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:39.475733 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:39.518070 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a428044-6f84-4728-856a-4df3d0a7f5d2 tempest-VolumeQuotaClassesTest-2061456456 tempest-VolumeQuotaClassesTest-2061456456-project-admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:39.589813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61790a-5bb8-4166-b5bb-cf1a5f5348f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:39.590474 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61790a-5bb8-4166-b5bb-cf1a5f5348f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:39.590758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61790a-5bb8-4166-b5bb-cf1a5f5348f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:39.591043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61790a-5bb8-4166-b5bb-cf1a5f5348f3 admin admin] PATH_INFO: `/v3/users/7f23504aae9b48ee9913af8427455a10` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:39.592274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61790a-5bb8-4166-b5bb-cf1a5f5348f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f23504aae9b48ee9913af8427455a10)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:39.594270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61790a-5bb8-4166-b5bb-cf1a5f5348f3 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:39.789387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-cf61790a-5bb8-4166-b5bb-cf1a5f5348f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f23504aae9b48ee9913af8427455a10'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:39.790303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-cf61790a-5bb8-4166-b5bb-cf1a5f5348f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f23504aae9b48ee9913af8427455a10'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:39.790968 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-cf61790a-5bb8-4166-b5bb-cf1a5f5348f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f23504aae9b48ee9913af8427455a10'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:39.828058 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-cf61790a-5bb8-4166-b5bb-cf1a5f5348f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f23504aae9b48ee9913af8427455a10'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:39.848227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-cf61790a-5bb8-4166-b5bb-cf1a5f5348f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f23504aae9b48ee9913af8427455a10'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:39.997443 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 912/1846] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:39 2022] DELETE /identity/v3/users/7f23504aae9b48ee9913af8427455a10 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:40.004062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d4a71-6ff0-424b-8d20-e95f8b136057 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:40.004062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d4a71-6ff0-424b-8d20-e95f8b136057 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:40.004062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d4a71-6ff0-424b-8d20-e95f8b136057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:40.010484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61790a-5bb8-4166-b5bb-cf1a5f5348f3 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:40.012504 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-cf61790a-5bb8-4166-b5bb-cf1a5f5348f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:40.031418 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-670d4a71-6ff0-424b-8d20-e95f8b136057 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:40.032783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-670d4a71-6ff0-424b-8d20-e95f8b136057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:40.045620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:40.103285 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61790a-5bb8-4166-b5bb-cf1a5f5348f3 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:40.108804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244654b-2632-47cd-b46e-e0b48fa086b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:40.109533 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244654b-2632-47cd-b46e-e0b48fa086b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:40.109882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244654b-2632-47cd-b46e-e0b48fa086b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:40.110224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244654b-2632-47cd-b46e-e0b48fa086b9 admin admin] PATH_INFO: `/v3/users/617cf199c555468db6173b4ca67dc4fb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:40.111401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244654b-2632-47cd-b46e-e0b48fa086b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=617cf199c555468db6173b4ca67dc4fb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:40.112773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 935/1847] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:40.113645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244654b-2632-47cd-b46e-e0b48fa086b9 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:40.124427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d4a71-6ff0-424b-8d20-e95f8b136057 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:40.127564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-670d4a71-6ff0-424b-8d20-e95f8b136057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:40.189165 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d4a71-6ff0-424b-8d20-e95f8b136057 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:40.192235 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ba3de-3e71-4cdc-9977-42e9832a1847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:40.192850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ba3de-3e71-4cdc-9977-42e9832a1847 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:40.193141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ba3de-3e71-4cdc-9977-42e9832a1847 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:40.193410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ba3de-3e71-4cdc-9977-42e9832a1847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:40.203973 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ba3de-3e71-4cdc-9977-42e9832a1847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:40.205477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ba3de-3e71-4cdc-9977-42e9832a1847 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:40.220310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 936/1848] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:58:40.347874 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2244654b-2632-47cd-b46e-e0b48fa086b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617cf199c555468db6173b4ca67dc4fb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:40.348969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2244654b-2632-47cd-b46e-e0b48fa086b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617cf199c555468db6173b4ca67dc4fb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:40.349788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2244654b-2632-47cd-b46e-e0b48fa086b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617cf199c555468db6173b4ca67dc4fb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:40.378834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2244654b-2632-47cd-b46e-e0b48fa086b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617cf199c555468db6173b4ca67dc4fb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:40.402952 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2244654b-2632-47cd-b46e-e0b48fa086b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617cf199c555468db6173b4ca67dc4fb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:40.525549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 913/1849] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:40 2022] DELETE /identity/v3/users/617cf199c555468db6173b4ca67dc4fb => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:40.529022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a39217-5d8b-444c-9d9d-54487ab58128 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:40.529880 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a39217-5d8b-444c-9d9d-54487ab58128 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:40.531156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a39217-5d8b-444c-9d9d-54487ab58128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:40.562451 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f7a39217-5d8b-444c-9d9d-54487ab58128 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:40.563792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f7a39217-5d8b-444c-9d9d-54487ab58128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:40.657572 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 937/1850] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:40.683638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244654b-2632-47cd-b46e-e0b48fa086b9 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:40.685611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2244654b-2632-47cd-b46e-e0b48fa086b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:40.698876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:40.786161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a39217-5d8b-444c-9d9d-54487ab58128 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:40.787534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f7a39217-5d8b-444c-9d9d-54487ab58128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:40.804595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a39217-5d8b-444c-9d9d-54487ab58128 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:40.807458 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244654b-2632-47cd-b46e-e0b48fa086b9 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:40.812485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d32176-103d-4ffa-9f38-b57148abdd80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:40.813122 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d32176-103d-4ffa-9f38-b57148abdd80 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:40.814133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d32176-103d-4ffa-9f38-b57148abdd80 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:40.814750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d32176-103d-4ffa-9f38-b57148abdd80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:40.820946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b9d27-6a15-4a37-a58a-6f2b963c9206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:40.823711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b9d27-6a15-4a37-a58a-6f2b963c9206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:40.823711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b9d27-6a15-4a37-a58a-6f2b963c9206 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:40.823711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b9d27-6a15-4a37-a58a-6f2b963c9206 admin admin] PATH_INFO: `/v3/projects/aea60bf3e97c406faad49942bdd5511e` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:40.825018 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b9d27-6a15-4a37-a58a-6f2b963c9206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea60bf3e97c406faad49942bdd5511e)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:40.828588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d32176-103d-4ffa-9f38-b57148abdd80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:40.830009 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d32176-103d-4ffa-9f38-b57148abdd80 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:40.830514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b9d27-6a15-4a37-a58a-6f2b963c9206 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:40.858684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 914/1851] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:40.952664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-790b9d27-6a15-4a37-a58a-6f2b963c9206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea60bf3e97c406faad49942bdd5511e', 'request_id': 'req-790b9d27-6a15-4a37-a58a-6f2b963c9206'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:40.962831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-790b9d27-6a15-4a37-a58a-6f2b963c9206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea60bf3e97c406faad49942bdd5511e', 'request_id': 'req-790b9d27-6a15-4a37-a58a-6f2b963c9206'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:40.973952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-790b9d27-6a15-4a37-a58a-6f2b963c9206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea60bf3e97c406faad49942bdd5511e', 'request_id': 'req-790b9d27-6a15-4a37-a58a-6f2b963c9206'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:41.098040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-790b9d27-6a15-4a37-a58a-6f2b963c9206 admin admin] The token cache is being invalidate because project aea60bf3e97c406faad49942bdd5511e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:41.098651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-790b9d27-6a15-4a37-a58a-6f2b963c9206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:41.099165 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-790b9d27-6a15-4a37-a58a-6f2b963c9206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:41.101115 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 938/1852] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:40 2022] DELETE /identity/v3/projects/aea60bf3e97c406faad49942bdd5511e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:41.107444 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d32176-103d-4ffa-9f38-b57148abdd80 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:41.123097 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d32176-103d-4ffa-9f38-b57148abdd80 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:41.210612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb7a15-bcb7-4d08-91b2-1f4ba329b918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:41.211350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb7a15-bcb7-4d08-91b2-1f4ba329b918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:41.212475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb7a15-bcb7-4d08-91b2-1f4ba329b918 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:41.213211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb7a15-bcb7-4d08-91b2-1f4ba329b918 admin admin] PATH_INFO: `/v3/users/0df5c4afb1c8470295f50172f02c445b` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:41.214591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb7a15-bcb7-4d08-91b2-1f4ba329b918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df5c4afb1c8470295f50172f02c445b)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:41.216624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb7a15-bcb7-4d08-91b2-1f4ba329b918 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:41.341355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b9d27-6a15-4a37-a58a-6f2b963c9206 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:41.342862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-790b9d27-6a15-4a37-a58a-6f2b963c9206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:41.360072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b9d27-6a15-4a37-a58a-6f2b963c9206 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:41.374705 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306762a1-9ff8-46bf-a7cc-0e69a495eebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:41.374705 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306762a1-9ff8-46bf-a7cc-0e69a495eebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:41.374705 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306762a1-9ff8-46bf-a7cc-0e69a495eebf admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:41.374705 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306762a1-9ff8-46bf-a7cc-0e69a495eebf admin admin] PATH_INFO: `/v3/projects/e7e55cb4661f40a48d1b980dd71ead2f` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:41.375175 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306762a1-9ff8-46bf-a7cc-0e69a495eebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e55cb4661f40a48d1b980dd71ead2f)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:41.375175 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306762a1-9ff8-46bf-a7cc-0e69a495eebf admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:41.490980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e6cb7a15-bcb7-4d08-91b2-1f4ba329b918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df5c4afb1c8470295f50172f02c445b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:41.491669 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e6cb7a15-bcb7-4d08-91b2-1f4ba329b918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df5c4afb1c8470295f50172f02c445b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:41.492475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e6cb7a15-bcb7-4d08-91b2-1f4ba329b918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df5c4afb1c8470295f50172f02c445b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:41.514395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e6cb7a15-bcb7-4d08-91b2-1f4ba329b918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df5c4afb1c8470295f50172f02c445b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:41.525182 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e6cb7a15-bcb7-4d08-91b2-1f4ba329b918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df5c4afb1c8470295f50172f02c445b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:41.529854 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-306762a1-9ff8-46bf-a7cc-0e69a495eebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e55cb4661f40a48d1b980dd71ead2f', 'request_id': 'req-306762a1-9ff8-46bf-a7cc-0e69a495eebf'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:41.537238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-306762a1-9ff8-46bf-a7cc-0e69a495eebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e55cb4661f40a48d1b980dd71ead2f', 'request_id': 'req-306762a1-9ff8-46bf-a7cc-0e69a495eebf'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:41.544741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-306762a1-9ff8-46bf-a7cc-0e69a495eebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e55cb4661f40a48d1b980dd71ead2f', 'request_id': 'req-306762a1-9ff8-46bf-a7cc-0e69a495eebf'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:41.627756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 915/1853] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:41 2022] DELETE /identity/v3/users/0df5c4afb1c8470295f50172f02c445b => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:41.631545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb7a15-bcb7-4d08-91b2-1f4ba329b918 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:41.640698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e6cb7a15-bcb7-4d08-91b2-1f4ba329b918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:41.715561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-306762a1-9ff8-46bf-a7cc-0e69a495eebf admin admin] The token cache is being invalidate because project e7e55cb4661f40a48d1b980dd71ead2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:41.715916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-306762a1-9ff8-46bf-a7cc-0e69a495eebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:41.716678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-306762a1-9ff8-46bf-a7cc-0e69a495eebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:41.719080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 939/1854] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:41 2022] DELETE /identity/v3/projects/e7e55cb4661f40a48d1b980dd71ead2f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:58:41.723197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306762a1-9ff8-46bf-a7cc-0e69a495eebf admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:41.725859 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-306762a1-9ff8-46bf-a7cc-0e69a495eebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:41.803246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb7a15-bcb7-4d08-91b2-1f4ba329b918 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:41.809980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebdd1b7-16d9-4b5f-aac5-c620039f7fe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:41.810912 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdd1b7-16d9-4b5f-aac5-c620039f7fe4 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:41.811193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdd1b7-16d9-4b5f-aac5-c620039f7fe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:41.811571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdd1b7-16d9-4b5f-aac5-c620039f7fe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:41.813772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7ebdd1b7-16d9-4b5f-aac5-c620039f7fe4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:41.862464 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306762a1-9ff8-46bf-a7cc-0e69a495eebf admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:41.944778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdde481-cabd-43f5-a915-190402831e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:41.945460 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdde481-cabd-43f5-a915-190402831e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:41.945745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdde481-cabd-43f5-a915-190402831e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:41.946548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdde481-cabd-43f5-a915-190402831e13 admin admin] PATH_INFO: `/v3/users/2c8ace04656e4a9c9c81af41d4bf517f` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:41.947720 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdde481-cabd-43f5-a915-190402831e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c8ace04656e4a9c9c81af41d4bf517f)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:41.948038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebdd1b7-16d9-4b5f-aac5-c620039f7fe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:41.949598 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebdd1b7-16d9-4b5f-aac5-c620039f7fe4 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:41.949893 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdde481-cabd-43f5-a915-190402831e13 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:41.967017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 916/1855] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:42.194558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7bdde481-cabd-43f5-a915-190402831e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c8ace04656e4a9c9c81af41d4bf517f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:42.207879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7bdde481-cabd-43f5-a915-190402831e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c8ace04656e4a9c9c81af41d4bf517f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:42.217757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebdd1b7-16d9-4b5f-aac5-c620039f7fe4 service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:42.219452 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7ebdd1b7-16d9-4b5f-aac5-c620039f7fe4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:42.245484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebdd1b7-16d9-4b5f-aac5-c620039f7fe4 service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:42.269828 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851bbcb-37de-420a-9d6b-71b8477aa4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:42.270922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851bbcb-37de-420a-9d6b-71b8477aa4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:42.275361 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851bbcb-37de-420a-9d6b-71b8477aa4da admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:42.277265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851bbcb-37de-420a-9d6b-71b8477aa4da admin admin] PATH_INFO: `/v3/users/c47cc5f800da45c9bd5eca983ab55ddb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:42.281496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851bbcb-37de-420a-9d6b-71b8477aa4da admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47cc5f800da45c9bd5eca983ab55ddb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:42.284416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851bbcb-37de-420a-9d6b-71b8477aa4da admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:42.302908 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7bdde481-cabd-43f5-a915-190402831e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c8ace04656e4a9c9c81af41d4bf517f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:42.303567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7bdde481-cabd-43f5-a915-190402831e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c8ace04656e4a9c9c81af41d4bf517f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:42.332527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7bdde481-cabd-43f5-a915-190402831e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c8ace04656e4a9c9c81af41d4bf517f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:42.345044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 940/1856] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:41 2022] DELETE /identity/v3/users/2c8ace04656e4a9c9c81af41d4bf517f => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:42.345044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdde481-cabd-43f5-a915-190402831e13 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:42.358973 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-7bdde481-cabd-43f5-a915-190402831e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:42.500932 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdde481-cabd-43f5-a915-190402831e13 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:42.518723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de20187-d493-4ecf-a1dc-c2afae59844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:42.520177 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de20187-d493-4ecf-a1dc-c2afae59844e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:42.520561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de20187-d493-4ecf-a1dc-c2afae59844e admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:42.520953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de20187-d493-4ecf-a1dc-c2afae59844e admin admin] PATH_INFO: `/v3/projects/d2c2e5278153415aa82cbe98f3b58136` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:42.524851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de20187-d493-4ecf-a1dc-c2afae59844e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c2e5278153415aa82cbe98f3b58136)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:42.531378 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de20187-d493-4ecf-a1dc-c2afae59844e admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:42.562975 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8851bbcb-37de-420a-9d6b-71b8477aa4da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47cc5f800da45c9bd5eca983ab55ddb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:42.564801 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8851bbcb-37de-420a-9d6b-71b8477aa4da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47cc5f800da45c9bd5eca983ab55ddb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:42.571563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8851bbcb-37de-420a-9d6b-71b8477aa4da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47cc5f800da45c9bd5eca983ab55ddb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:42.589351 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8851bbcb-37de-420a-9d6b-71b8477aa4da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47cc5f800da45c9bd5eca983ab55ddb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:42.597518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8851bbcb-37de-420a-9d6b-71b8477aa4da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47cc5f800da45c9bd5eca983ab55ddb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:42.706283 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 917/1857] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:42 2022] DELETE /identity/v3/users/c47cc5f800da45c9bd5eca983ab55ddb => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:42.711010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e358b7-e115-4fc2-9485-0355ab088982 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:42.711383 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e358b7-e115-4fc2-9485-0355ab088982 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:42.712722 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e358b7-e115-4fc2-9485-0355ab088982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:42.718438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7de20187-d493-4ecf-a1dc-c2afae59844e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c2e5278153415aa82cbe98f3b58136', 'request_id': 'req-7de20187-d493-4ecf-a1dc-c2afae59844e'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:42.725301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7de20187-d493-4ecf-a1dc-c2afae59844e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c2e5278153415aa82cbe98f3b58136', 'request_id': 'req-7de20187-d493-4ecf-a1dc-c2afae59844e'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:42.734302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7de20187-d493-4ecf-a1dc-c2afae59844e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c2e5278153415aa82cbe98f3b58136', 'request_id': 'req-7de20187-d493-4ecf-a1dc-c2afae59844e'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:42.735029 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-54e358b7-e115-4fc2-9485-0355ab088982 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:42.736407 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-54e358b7-e115-4fc2-9485-0355ab088982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:42.809271 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 918/1858] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:58:42.819603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e358b7-e115-4fc2-9485-0355ab088982 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:42.822240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-54e358b7-e115-4fc2-9485-0355ab088982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:42.882248 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e358b7-e115-4fc2-9485-0355ab088982 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:42.886801 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906213cd-0a47-4eed-a8d8-7dd8e7334cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:42.887426 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906213cd-0a47-4eed-a8d8-7dd8e7334cdf service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:42.887708 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906213cd-0a47-4eed-a8d8-7dd8e7334cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:42.887981 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906213cd-0a47-4eed-a8d8-7dd8e7334cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:42.897849 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906213cd-0a47-4eed-a8d8-7dd8e7334cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:42.899591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906213cd-0a47-4eed-a8d8-7dd8e7334cdf service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:42.913231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 919/1859] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:42.953056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906213cd-0a47-4eed-a8d8-7dd8e7334cdf service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:42.954395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-906213cd-0a47-4eed-a8d8-7dd8e7334cdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:42.958937 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7de20187-d493-4ecf-a1dc-c2afae59844e admin admin] The token cache is being invalidate because project d2c2e5278153415aa82cbe98f3b58136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:42.962549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7de20187-d493-4ecf-a1dc-c2afae59844e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:42.962549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7de20187-d493-4ecf-a1dc-c2afae59844e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:42.965374 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 941/1860] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:42 2022] DELETE /identity/v3/projects/d2c2e5278153415aa82cbe98f3b58136 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:42.970564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6485b2-2610-4a1e-b450-7a8ba2f49e4c None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:42.970969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6485b2-2610-4a1e-b450-7a8ba2f49e4c None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:42.971318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6485b2-2610-4a1e-b450-7a8ba2f49e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:42.982130 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906213cd-0a47-4eed-a8d8-7dd8e7334cdf service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:43.000873 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cf5ea-2f93-4608-a1ba-69d0c4220ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:43.001635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cf5ea-2f93-4608-a1ba-69d0c4220ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:43.001986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cf5ea-2f93-4608-a1ba-69d0c4220ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:43.002337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cf5ea-2f93-4608-a1ba-69d0c4220ba3 admin admin] PATH_INFO: `/v3/projects/63bfd58b00d54962a9fbd63e3dfcb2a2` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:43.004582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-8e6485b2-2610-4a1e-b450-7a8ba2f49e4c None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:43.005898 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cf5ea-2f93-4608-a1ba-69d0c4220ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63bfd58b00d54962a9fbd63e3dfcb2a2)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:43.006142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8e6485b2-2610-4a1e-b450-7a8ba2f49e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:43.010035 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cf5ea-2f93-4608-a1ba-69d0c4220ba3 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:43.017645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 942/1861] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:58:43.025220 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232acdde-19a4-48bd-90c9-e15302f05f61 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:43.025731 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232acdde-19a4-48bd-90c9-e15302f05f61 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:43.026062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232acdde-19a4-48bd-90c9-e15302f05f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:43.051396 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-232acdde-19a4-48bd-90c9-e15302f05f61 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:43.052822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-232acdde-19a4-48bd-90c9-e15302f05f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:43.062354 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 943/1862] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:43.067000 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232acdde-19a4-48bd-90c9-e15302f05f61 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:43.077192 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232acdde-19a4-48bd-90c9-e15302f05f61 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:43.082127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf79905-dca8-486b-9958-53c64dd437dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:43.082744 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf79905-dca8-486b-9958-53c64dd437dd admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:43.083030 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf79905-dca8-486b-9958-53c64dd437dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:43.083287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf79905-dca8-486b-9958-53c64dd437dd admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:43.087020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf79905-dca8-486b-9958-53c64dd437dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:43.087020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf79905-dca8-486b-9958-53c64dd437dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:43.087020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf79905-dca8-486b-9958-53c64dd437dd admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:43.106265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 944/1863] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:58:43.106265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf79905-dca8-486b-9958-53c64dd437dd admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:43.116446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf79905-dca8-486b-9958-53c64dd437dd admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:43.132306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-7f2cf5ea-2f93-4608-a1ba-69d0c4220ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63bfd58b00d54962a9fbd63e3dfcb2a2', 'request_id': 'req-7f2cf5ea-2f93-4608-a1ba-69d0c4220ba3'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:43.203256 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0ab71-ab26-463b-8ee9-a25002d87ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:43.205627 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0ab71-ab26-463b-8ee9-a25002d87ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:43.206375 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0ab71-ab26-463b-8ee9-a25002d87ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:43.207093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0ab71-ab26-463b-8ee9-a25002d87ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:43.208570 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0ab71-ab26-463b-8ee9-a25002d87ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:43.214387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0ab71-ab26-463b-8ee9-a25002d87ff5 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:43.275659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-7f2cf5ea-2f93-4608-a1ba-69d0c4220ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63bfd58b00d54962a9fbd63e3dfcb2a2', 'request_id': 'req-7f2cf5ea-2f93-4608-a1ba-69d0c4220ba3'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:43.297534 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-7f2cf5ea-2f93-4608-a1ba-69d0c4220ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63bfd58b00d54962a9fbd63e3dfcb2a2', 'request_id': 'req-7f2cf5ea-2f93-4608-a1ba-69d0c4220ba3'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:43.314234 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-7f2cf5ea-2f93-4608-a1ba-69d0c4220ba3 admin admin] The token cache is being invalidate because project 63bfd58b00d54962a9fbd63e3dfcb2a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:43.314888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-7f2cf5ea-2f93-4608-a1ba-69d0c4220ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:43.316490 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-7f2cf5ea-2f93-4608-a1ba-69d0c4220ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:43.319226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 920/1864] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:42 2022] DELETE /identity/v3/projects/63bfd58b00d54962a9fbd63e3dfcb2a2 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:58:43.325757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a141e2-a970-44cf-8ea8-e21e96ed8c84 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:43.327356 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a141e2-a970-44cf-8ea8-e21e96ed8c84 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:43.327924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a141e2-a970-44cf-8ea8-e21e96ed8c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:43.363439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-f1a141e2-a970-44cf-8ea8-e21e96ed8c84 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:43.365598 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f1a141e2-a970-44cf-8ea8-e21e96ed8c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:43.380269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 921/1865] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:43.393566 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1e56a-fb1e-4ba9-baaa-79cc0ecb1aa7 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:43.393867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1e56a-fb1e-4ba9-baaa-79cc0ecb1aa7 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:43.394143 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1e56a-fb1e-4ba9-baaa-79cc0ecb1aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:43.395341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 945/1866] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:43 2022] POST /identity/v3/projects => generated 365 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:58:43.401253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0ab71-ab26-463b-8ee9-a25002d87ff5 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:43.405567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-11d0ab71-ab26-463b-8ee9-a25002d87ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:43.453762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-20c1e56a-fb1e-4ba9-baaa-79cc0ecb1aa7 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:43.455318 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-20c1e56a-fb1e-4ba9-baaa-79cc0ecb1aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:43.491562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0ab71-ab26-463b-8ee9-a25002d87ff5 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:43.510115 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474788c-ba1b-4289-ab80-3211e5d97d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:43.511191 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474788c-ba1b-4289-ab80-3211e5d97d5b admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:43.511486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474788c-ba1b-4289-ab80-3211e5d97d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:43.511909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474788c-ba1b-4289-ab80-3211e5d97d5b admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:43.512859 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474788c-ba1b-4289-ab80-3211e5d97d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:43.514892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474788c-ba1b-4289-ab80-3211e5d97d5b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:43.558059 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 922/1867] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:43.559302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1e56a-fb1e-4ba9-baaa-79cc0ecb1aa7 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:43.560975 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-20c1e56a-fb1e-4ba9-baaa-79cc0ecb1aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:43.575321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1e56a-fb1e-4ba9-baaa-79cc0ecb1aa7 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:43.581073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ea85e-7b52-4071-bb54-8c40346bcaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:43.581739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ea85e-7b52-4071-bb54-8c40346bcaa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:43.582021 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ea85e-7b52-4071-bb54-8c40346bcaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:43.582298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ea85e-7b52-4071-bb54-8c40346bcaa6 admin admin] PATH_INFO: `/v3/projects/0db75c90c8a04911859391528992d578` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:43.583592 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ea85e-7b52-4071-bb54-8c40346bcaa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0db75c90c8a04911859391528992d578)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:43.585537 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ea85e-7b52-4071-bb54-8c40346bcaa6 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:43.664260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 946/1868] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:43 2022] POST /identity/v3/users => generated 283 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:43.664995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474788c-ba1b-4289-ab80-3211e5d97d5b admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:43.689018 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474788c-ba1b-4289-ab80-3211e5d97d5b admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:43.704936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44678ca6-68b5-4109-ad9e-609d357ae06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:43.706683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678ca6-68b5-4109-ad9e-609d357ae06a admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:43.707874 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678ca6-68b5-4109-ad9e-609d357ae06a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:43.708370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678ca6-68b5-4109-ad9e-609d357ae06a admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:43.709506 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44678ca6-68b5-4109-ad9e-609d357ae06a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:43.710599 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44678ca6-68b5-4109-ad9e-609d357ae06a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:43.713211 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44678ca6-68b5-4109-ad9e-609d357ae06a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:43.714354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c15ea85e-7b52-4071-bb54-8c40346bcaa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0db75c90c8a04911859391528992d578', 'request_id': 'req-c15ea85e-7b52-4071-bb54-8c40346bcaa6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:43.728452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 947/1869] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:58:43.729827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44678ca6-68b5-4109-ad9e-609d357ae06a admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:43.742040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44678ca6-68b5-4109-ad9e-609d357ae06a admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:43.812279 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c15ea85e-7b52-4071-bb54-8c40346bcaa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0db75c90c8a04911859391528992d578', 'request_id': 'req-c15ea85e-7b52-4071-bb54-8c40346bcaa6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:43.820008 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c15ea85e-7b52-4071-bb54-8c40346bcaa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0db75c90c8a04911859391528992d578', 'request_id': 'req-c15ea85e-7b52-4071-bb54-8c40346bcaa6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:43.841971 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2645936-e431-452c-9276-7968bc9a6ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:43.842904 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2645936-e431-452c-9276-7968bc9a6ccb admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:43.843348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2645936-e431-452c-9276-7968bc9a6ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:43.843668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2645936-e431-452c-9276-7968bc9a6ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:43.844489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2645936-e431-452c-9276-7968bc9a6ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:43.846847 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2645936-e431-452c-9276-7968bc9a6ccb admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:43.862142 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c15ea85e-7b52-4071-bb54-8c40346bcaa6 admin admin] The token cache is being invalidate because project 0db75c90c8a04911859391528992d578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:43.862443 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c15ea85e-7b52-4071-bb54-8c40346bcaa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:43.868386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 948/1870] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:43.868386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2645936-e431-452c-9276-7968bc9a6ccb admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:43.868615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c15ea85e-7b52-4071-bb54-8c40346bcaa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:43.870370 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 923/1871] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:43 2022] DELETE /identity/v3/projects/0db75c90c8a04911859391528992d578 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:43.871308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ea85e-7b52-4071-bb54-8c40346bcaa6 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:43.874810 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c15ea85e-7b52-4071-bb54-8c40346bcaa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:43.876208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e2645936-e431-452c-9276-7968bc9a6ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:43.893057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2645936-e431-452c-9276-7968bc9a6ccb admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:43.898197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f53eb-2fd9-43fc-bab0-40a4fd0922b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:43.899644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f53eb-2fd9-43fc-bab0-40a4fd0922b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:43.900145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f53eb-2fd9-43fc-bab0-40a4fd0922b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:43.900706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f53eb-2fd9-43fc-bab0-40a4fd0922b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:43.901644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f53eb-2fd9-43fc-bab0-40a4fd0922b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:43.903029 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ea85e-7b52-4071-bb54-8c40346bcaa6 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:43.903916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f53eb-2fd9-43fc-bab0-40a4fd0922b3 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:43.911097 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05529ebe-8ef9-428f-ba64-4d286fc505e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:43.912088 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05529ebe-8ef9-428f-ba64-4d286fc505e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:43.912507 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05529ebe-8ef9-428f-ba64-4d286fc505e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:43.912888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05529ebe-8ef9-428f-ba64-4d286fc505e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:43.913977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05529ebe-8ef9-428f-ba64-4d286fc505e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:43.915770 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05529ebe-8ef9-428f-ba64-4d286fc505e4 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:43.929141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 924/1872] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:43.930758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c6987-aeca-43c4-89d3-f2d4a4f89830 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:43.931472 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c6987-aeca-43c4-89d3-f2d4a4f89830 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:43.931924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c6987-aeca-43c4-89d3-f2d4a4f89830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:43.954579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-bf5c6987-aeca-43c4-89d3-f2d4a4f89830 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:43.955784 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-bf5c6987-aeca-43c4-89d3-f2d4a4f89830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:43.965273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 925/1873] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:43.972468 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c6987-aeca-43c4-89d3-f2d4a4f89830 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:43.983273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c6987-aeca-43c4-89d3-f2d4a4f89830 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:43.988277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c8ee7-95a9-47ad-be0d-d8908bae62dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:43.988986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c8ee7-95a9-47ad-be0d-d8908bae62dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:43.989271 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c8ee7-95a9-47ad-be0d-d8908bae62dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:43.989551 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c8ee7-95a9-47ad-be0d-d8908bae62dd admin admin] PATH_INFO: `/v3/projects/f1a02aed3f864358a96fe450c7646c53/users/3963e014caa646ec946897e777d504bf/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.007493 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 949/1874] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:43 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:44.009763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553bef-bea4-443a-b67d-d90bedf6d31d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.010048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553bef-bea4-443a-b67d-d90bedf6d31d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.010334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553bef-bea4-443a-b67d-d90bedf6d31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.015358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c8ee7-95a9-47ad-be0d-d8908bae62dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a02aed3f864358a96fe450c7646c53, user_id=3963e014caa646ec946897e777d504bf, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:44.018142 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c8ee7-95a9-47ad-be0d-d8908bae62dd admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:44.037604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-64553bef-bea4-443a-b67d-d90bedf6d31d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:44.039450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-64553bef-bea4-443a-b67d-d90bedf6d31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:44.043406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:44.081646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 926/1875] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:43 2022] PUT /identity/v3/projects/f1a02aed3f864358a96fe450c7646c53/users/3963e014caa646ec946897e777d504bf/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:44.092412 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c8ee7-95a9-47ad-be0d-d8908bae62dd admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:44.120073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 950/1876] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:44.125457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de956e4-0464-4907-9d24-22e455c9b9ae None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.125748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de956e4-0464-4907-9d24-22e455c9b9ae None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.126035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de956e4-0464-4907-9d24-22e455c9b9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.157077 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-1de956e4-0464-4907-9d24-22e455c9b9ae None None] MFA Rules not processed for user `3963e014caa646ec946897e777d504bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:44.158514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-1de956e4-0464-4907-9d24-22e455c9b9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:44.170322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c8ee7-95a9-47ad-be0d-d8908bae62dd admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:44.175458 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b5b5e-b563-4a8f-95f5-797b16346592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:44.176075 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b5b5e-b563-4a8f-95f5-797b16346592 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.176392 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b5b5e-b563-4a8f-95f5-797b16346592 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.176811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b5b5e-b563-4a8f-95f5-797b16346592 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.177492 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b5b5e-b563-4a8f-95f5-797b16346592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:44.179843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b5b5e-b563-4a8f-95f5-797b16346592 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:44.245452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 951/1877] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:44.246316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de956e4-0464-4907-9d24-22e455c9b9ae None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:44.259763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de956e4-0464-4907-9d24-22e455c9b9ae None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:44.265150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a1f84-34f0-4fe6-822e-500d4be4e598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:44.265871 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a1f84-34f0-4fe6-822e-500d4be4e598 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.266164 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a1f84-34f0-4fe6-822e-500d4be4e598 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.266431 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a1f84-34f0-4fe6-822e-500d4be4e598 admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.267150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a1f84-34f0-4fe6-822e-500d4be4e598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:44.267456 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a1f84-34f0-4fe6-822e-500d4be4e598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:44.269126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a1f84-34f0-4fe6-822e-500d4be4e598 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:44.284005 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 952/1878] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:58:44.284621 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 927/1879] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:44 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:44.292325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b5b5e-b563-4a8f-95f5-797b16346592 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:44.292866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a1f84-34f0-4fe6-822e-500d4be4e598 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:44.304370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a1f84-34f0-4fe6-822e-500d4be4e598 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:44.304553 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b5b5e-b563-4a8f-95f5-797b16346592 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:44.311320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc266c5-bc78-4855-b43b-44bb188c71de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:44.311819 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc266c5-bc78-4855-b43b-44bb188c71de admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.312114 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc266c5-bc78-4855-b43b-44bb188c71de admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.312324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463fca3-0b9b-4b8c-b95a-d7531869ee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:44.312591 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc266c5-bc78-4855-b43b-44bb188c71de admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.313540 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc266c5-bc78-4855-b43b-44bb188c71de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:44.313653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463fca3-0b9b-4b8c-b95a-d7531869ee1f admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.313749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463fca3-0b9b-4b8c-b95a-d7531869ee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.314003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463fca3-0b9b-4b8c-b95a-d7531869ee1f admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.314671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463fca3-0b9b-4b8c-b95a-d7531869ee1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:44.315168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc266c5-bc78-4855-b43b-44bb188c71de admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:44.316951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463fca3-0b9b-4b8c-b95a-d7531869ee1f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:44.395898 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 953/1880] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:44 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:44.396874 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc266c5-bc78-4855-b43b-44bb188c71de admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:44.403540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:44.414170 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 928/1881] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:44 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:44.415877 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463fca3-0b9b-4b8c-b95a-d7531869ee1f admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:44.507252 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463fca3-0b9b-4b8c-b95a-d7531869ee1f admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:44.510117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc266c5-bc78-4855-b43b-44bb188c71de admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:44.515241 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75effb-b934-4ae8-84b3-241d5b8efec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:44.516210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75effb-b934-4ae8-84b3-241d5b8efec6 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.516700 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75effb-b934-4ae8-84b3-241d5b8efec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.517158 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75effb-b934-4ae8-84b3-241d5b8efec6 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.517500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d289ef-fdff-4e7a-a661-43aa26578d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:44.518220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75effb-b934-4ae8-84b3-241d5b8efec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:44.518393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d289ef-fdff-4e7a-a661-43aa26578d63 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.518840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d289ef-fdff-4e7a-a661-43aa26578d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.519262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d289ef-fdff-4e7a-a661-43aa26578d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.520392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d289ef-fdff-4e7a-a661-43aa26578d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:44.521772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75effb-b934-4ae8-84b3-241d5b8efec6 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:44.523137 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d289ef-fdff-4e7a-a661-43aa26578d63 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:44.542607 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 954/1882] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:44.544145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d289ef-fdff-4e7a-a661-43aa26578d63 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:44.559237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d289ef-fdff-4e7a-a661-43aa26578d63 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:44.565298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6375cf6-14ce-4f56-ae43-947cc04933a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:44.565914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6375cf6-14ce-4f56-ae43-947cc04933a7 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.566197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6375cf6-14ce-4f56-ae43-947cc04933a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.566468 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6375cf6-14ce-4f56-ae43-947cc04933a7 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.567104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6375cf6-14ce-4f56-ae43-947cc04933a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:44.569081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6375cf6-14ce-4f56-ae43-947cc04933a7 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:44.607336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 929/1883] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:44 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:44.614548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75effb-b934-4ae8-84b3-241d5b8efec6 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:44.620399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75effb-b934-4ae8-84b3-241d5b8efec6 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:44.625604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc51da-c85c-47c2-8a92-e7a075392403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:44.626218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc51da-c85c-47c2-8a92-e7a075392403 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.626576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc51da-c85c-47c2-8a92-e7a075392403 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.626872 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc51da-c85c-47c2-8a92-e7a075392403 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.627514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc51da-c85c-47c2-8a92-e7a075392403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:44.629160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc51da-c85c-47c2-8a92-e7a075392403 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:44.639803 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 930/1884] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:44.640712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc51da-c85c-47c2-8a92-e7a075392403 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:44.650335 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc51da-c85c-47c2-8a92-e7a075392403 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:44.654908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be62f0-756b-48ec-b7e1-c042e7ec7567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:44.655492 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be62f0-756b-48ec-b7e1-c042e7ec7567 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.655770 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be62f0-756b-48ec-b7e1-c042e7ec7567 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.656043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be62f0-756b-48ec-b7e1-c042e7ec7567 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.656711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be62f0-756b-48ec-b7e1-c042e7ec7567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:44.658318 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be62f0-756b-48ec-b7e1-c042e7ec7567 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:44.669159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 931/1885] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:44.669933 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be62f0-756b-48ec-b7e1-c042e7ec7567 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:44.682853 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be62f0-756b-48ec-b7e1-c042e7ec7567 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:44.687569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab37d35-7431-45cd-9a9f-bda0573d6cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:44.688242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab37d35-7431-45cd-9a9f-bda0573d6cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.688583 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab37d35-7431-45cd-9a9f-bda0573d6cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.688884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab37d35-7431-45cd-9a9f-bda0573d6cfe admin admin] PATH_INFO: `/v3/projects/a07d95c16a05416b9549f794acfbc86a/users/00c13997850644e691f3c99b0043a280/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.703111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 955/1886] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:44 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:44.703995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6375cf6-14ce-4f56-ae43-947cc04933a7 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:44.709141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab37d35-7431-45cd-9a9f-bda0573d6cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07d95c16a05416b9549f794acfbc86a, user_id=00c13997850644e691f3c99b0043a280, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:44.712375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab37d35-7431-45cd-9a9f-bda0573d6cfe admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:44.716318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6375cf6-14ce-4f56-ae43-947cc04933a7 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:44.721563 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd093ef-0c70-4c85-9587-4523e8b4b7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:44.722349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd093ef-0c70-4c85-9587-4523e8b4b7c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.722621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd093ef-0c70-4c85-9587-4523e8b4b7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.722892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd093ef-0c70-4c85-9587-4523e8b4b7c0 admin admin] PATH_INFO: `/v3/projects/350204ce50cc4558bc7d8d317404196e/users/d9852154173f4555a30225f3ecdc6efd/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.740360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd093ef-0c70-4c85-9587-4523e8b4b7c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350204ce50cc4558bc7d8d317404196e, user_id=d9852154173f4555a30225f3ecdc6efd, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:44.744276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd093ef-0c70-4c85-9587-4523e8b4b7c0 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:44.800574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 932/1887] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:44 2022] PUT /identity/v3/projects/a07d95c16a05416b9549f794acfbc86a/users/00c13997850644e691f3c99b0043a280/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:44.801324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab37d35-7431-45cd-9a9f-bda0573d6cfe admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:44.826568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 956/1888] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:44 2022] PUT /identity/v3/projects/350204ce50cc4558bc7d8d317404196e/users/d9852154173f4555a30225f3ecdc6efd/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:44.828761 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffb092-2140-4e83-bb0f-483f63173206 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.829383 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffb092-2140-4e83-bb0f-483f63173206 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.829693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffb092-2140-4e83-bb0f-483f63173206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.862753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f5ffb092-2140-4e83-bb0f-483f63173206 None None] MFA Rules not processed for user `00c13997850644e691f3c99b0043a280`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:44.864331 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f5ffb092-2140-4e83-bb0f-483f63173206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:44.877614 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab37d35-7431-45cd-9a9f-bda0573d6cfe admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:44.943446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 957/1889] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:44.944911 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffb092-2140-4e83-bb0f-483f63173206 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:44.950887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205e4f1-fcbf-465a-a9e5-fe91a831940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:44.951902 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205e4f1-fcbf-465a-a9e5-fe91a831940d admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.952022 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205e4f1-fcbf-465a-a9e5-fe91a831940d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.952391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205e4f1-fcbf-465a-a9e5-fe91a831940d admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.953464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205e4f1-fcbf-465a-a9e5-fe91a831940d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:44.958517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205e4f1-fcbf-465a-a9e5-fe91a831940d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:44.964401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffb092-2140-4e83-bb0f-483f63173206 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:44.968762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 933/1890] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:44.968762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205e4f1-fcbf-465a-a9e5-fe91a831940d admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:44.971831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5f3e7-7e85-4ea6-b14a-323cdd37f9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:44.972378 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5f3e7-7e85-4ea6-b14a-323cdd37f9de admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.972665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5f3e7-7e85-4ea6-b14a-323cdd37f9de admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.972945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5f3e7-7e85-4ea6-b14a-323cdd37f9de admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.973663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5f3e7-7e85-4ea6-b14a-323cdd37f9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:44.975521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5f3e7-7e85-4ea6-b14a-323cdd37f9de admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:44.979609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205e4f1-fcbf-465a-a9e5-fe91a831940d admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:44.984876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569c8c2-f0be-424e-b4f8-926e5cc7c1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:44.985502 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569c8c2-f0be-424e-b4f8-926e5cc7c1dc admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:44.985792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569c8c2-f0be-424e-b4f8-926e5cc7c1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:44.986080 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569c8c2-f0be-424e-b4f8-926e5cc7c1dc admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:44.986738 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569c8c2-f0be-424e-b4f8-926e5cc7c1dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:44.988692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569c8c2-f0be-424e-b4f8-926e5cc7c1dc admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:44.990007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 958/1891] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:44.990945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5f3e7-7e85-4ea6-b14a-323cdd37f9de admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:45.001604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5f3e7-7e85-4ea6-b14a-323cdd37f9de admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:45.006986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a115aa-274e-4453-8bf3-11ba6352ae15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:45.007428 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a115aa-274e-4453-8bf3-11ba6352ae15 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:45.007776 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a115aa-274e-4453-8bf3-11ba6352ae15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:45.008167 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a115aa-274e-4453-8bf3-11ba6352ae15 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:45.009402 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a115aa-274e-4453-8bf3-11ba6352ae15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:45.011089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a115aa-274e-4453-8bf3-11ba6352ae15 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:45.029246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 959/1892] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:45.029246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a115aa-274e-4453-8bf3-11ba6352ae15 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:45.038216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a115aa-274e-4453-8bf3-11ba6352ae15 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:45.043775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b29526-05ac-46de-9f1d-6519b73af231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:45.044493 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b29526-05ac-46de-9f1d-6519b73af231 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:45.044771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b29526-05ac-46de-9f1d-6519b73af231 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:45.045043 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b29526-05ac-46de-9f1d-6519b73af231 admin admin] PATH_INFO: `/v3/projects/350204ce50cc4558bc7d8d317404196e/users/d9852154173f4555a30225f3ecdc6efd/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:45.047022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b29526-05ac-46de-9f1d-6519b73af231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350204ce50cc4558bc7d8d317404196e, user_id=d9852154173f4555a30225f3ecdc6efd, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:45.049923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b29526-05ac-46de-9f1d-6519b73af231 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:45.063163 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 960/1893] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:45 2022] PUT /identity/v3/projects/350204ce50cc4558bc7d8d317404196e/users/d9852154173f4555a30225f3ecdc6efd/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:45.073593 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b29526-05ac-46de-9f1d-6519b73af231 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:45.085637 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 934/1894] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:44 2022] POST /identity/v3/projects => generated 391 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:45.090975 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e8f2a-83c1-4a78-b6d8-20606557fe68 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:45.091330 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e8f2a-83c1-4a78-b6d8-20606557fe68 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:45.091677 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e8f2a-83c1-4a78-b6d8-20606557fe68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:45.137811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-c28e8f2a-83c1-4a78-b6d8-20606557fe68 None None] MFA Rules not processed for user `d9852154173f4555a30225f3ecdc6efd`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:45.139531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c28e8f2a-83c1-4a78-b6d8-20606557fe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:45.190242 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b29526-05ac-46de-9f1d-6519b73af231 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:45.289619 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 935/1895] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:45.289619 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e8f2a-83c1-4a78-b6d8-20606557fe68 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:45.293050 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e8c5f-9967-4e0d-ad72-c42b8e9d29c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:45.294810 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e8c5f-9967-4e0d-ad72-c42b8e9d29c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:45.295244 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e8c5f-9967-4e0d-ad72-c42b8e9d29c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:45.295533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e8c5f-9967-4e0d-ad72-c42b8e9d29c7 admin admin] PATH_INFO: `/v3/projects/10bfc12517bd4c76ac4347f952f90bb6/users/eefe3b4de9fa416698fc849f3aa7e7ad/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:45.300553 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e8f2a-83c1-4a78-b6d8-20606557fe68 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:45.306554 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a5065-f648-4ecf-a7c1-2dffbd31f494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:45.306988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a5065-f648-4ecf-a7c1-2dffbd31f494 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:45.307261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a5065-f648-4ecf-a7c1-2dffbd31f494 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:45.308238 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a5065-f648-4ecf-a7c1-2dffbd31f494 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:45.308238 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a5065-f648-4ecf-a7c1-2dffbd31f494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:45.310128 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a5065-f648-4ecf-a7c1-2dffbd31f494 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:45.316369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e8c5f-9967-4e0d-ad72-c42b8e9d29c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10bfc12517bd4c76ac4347f952f90bb6, user_id=eefe3b4de9fa416698fc849f3aa7e7ad, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:45.320447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e8c5f-9967-4e0d-ad72-c42b8e9d29c7 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:45.428874 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 961/1896] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:45 2022] PUT /identity/v3/projects/10bfc12517bd4c76ac4347f952f90bb6/users/eefe3b4de9fa416698fc849f3aa7e7ad/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:45.429747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e8c5f-9967-4e0d-ad72-c42b8e9d29c7 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:45.433855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ef6e8c5f-9967-4e0d-ad72-c42b8e9d29c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:45.437616 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 936/1897] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:45 2022] POST /identity/v3/users => generated 302 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:45.443682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24173e-a904-4d33-88c8-7706a304cae2 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:45.444039 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24173e-a904-4d33-88c8-7706a304cae2 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:45.444309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24173e-a904-4d33-88c8-7706a304cae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:45.475648 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-4d24173e-a904-4d33-88c8-7706a304cae2 None None] MFA Rules not processed for user `eefe3b4de9fa416698fc849f3aa7e7ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:45.477000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4d24173e-a904-4d33-88c8-7706a304cae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:45.526687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e8c5f-9967-4e0d-ad72-c42b8e9d29c7 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:45.532669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f4e18-da22-4a94-b223-b42b828b51c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:45.533306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f4e18-da22-4a94-b223-b42b828b51c8 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:45.533574 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f4e18-da22-4a94-b223-b42b828b51c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:45.533943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f4e18-da22-4a94-b223-b42b828b51c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:45.573751 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 937/1898] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:58:45.578598 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24173e-a904-4d33-88c8-7706a304cae2 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:45.660001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f4e18-da22-4a94-b223-b42b828b51c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:45.662788 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f4e18-da22-4a94-b223-b42b828b51c8 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:45.683733 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 962/1899] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:45.686207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f4e18-da22-4a94-b223-b42b828b51c8 service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:45.699842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24173e-a904-4d33-88c8-7706a304cae2 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:45.711950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe30cb3-4e30-4351-8f8b-8d478ef6d70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:45.713124 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe30cb3-4e30-4351-8f8b-8d478ef6d70d admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:45.713460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe30cb3-4e30-4351-8f8b-8d478ef6d70d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:45.713798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe30cb3-4e30-4351-8f8b-8d478ef6d70d admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:45.714463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe30cb3-4e30-4351-8f8b-8d478ef6d70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:45.715332 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f4e18-da22-4a94-b223-b42b828b51c8 service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:45.716119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe30cb3-4e30-4351-8f8b-8d478ef6d70d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:45.720716 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea7a9d-38f9-403d-8249-161468de5a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:45.721337 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea7a9d-38f9-403d-8249-161468de5a19 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:45.721759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea7a9d-38f9-403d-8249-161468de5a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:45.722040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea7a9d-38f9-403d-8249-161468de5a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:45.722689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea7a9d-38f9-403d-8249-161468de5a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:45.724715 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea7a9d-38f9-403d-8249-161468de5a19 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:45.731759 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 938/1900] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:45.737334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe30cb3-4e30-4351-8f8b-8d478ef6d70d admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:45.755610 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe30cb3-4e30-4351-8f8b-8d478ef6d70d admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:45.761090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516826be-2067-4b25-b224-ec3e78dd61c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:45.761781 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516826be-2067-4b25-b224-ec3e78dd61c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:45.762064 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516826be-2067-4b25-b224-ec3e78dd61c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:45.762348 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516826be-2067-4b25-b224-ec3e78dd61c8 admin admin] PATH_INFO: `/v3/projects/b67403401cd741779c053a46241fc6ef/users/ad99ad5abf7c4ad3afd3342eac35200a/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:45.809504 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516826be-2067-4b25-b224-ec3e78dd61c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b67403401cd741779c053a46241fc6ef, user_id=ad99ad5abf7c4ad3afd3342eac35200a, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:45.813075 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516826be-2067-4b25-b224-ec3e78dd61c8 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:45.837302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 963/1901] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:45 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:45.848034 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea7a9d-38f9-403d-8249-161468de5a19 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:45.903807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 939/1902] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:45 2022] PUT /identity/v3/projects/b67403401cd741779c053a46241fc6ef/users/ad99ad5abf7c4ad3afd3342eac35200a/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:58:45.907864 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516826be-2067-4b25-b224-ec3e78dd61c8 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:45.922493 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea7a9d-38f9-403d-8249-161468de5a19 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:45.987903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516826be-2067-4b25-b224-ec3e78dd61c8 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:45.994606 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b9eea-28b1-4d7b-aafd-f3142734bf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:45.995871 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b9eea-28b1-4d7b-aafd-f3142734bf86 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:45.996226 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b9eea-28b1-4d7b-aafd-f3142734bf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:45.996646 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b9eea-28b1-4d7b-aafd-f3142734bf86 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:45.997296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b9eea-28b1-4d7b-aafd-f3142734bf86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:45.999208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b9eea-28b1-4d7b-aafd-f3142734bf86 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:46.001021 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf4e92-9350-4e31-a769-83a9ff8bcc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:46.001739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf4e92-9350-4e31-a769-83a9ff8bcc2e admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:46.002184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf4e92-9350-4e31-a769-83a9ff8bcc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:46.002518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf4e92-9350-4e31-a769-83a9ff8bcc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:46.003407 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf4e92-9350-4e31-a769-83a9ff8bcc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:46.005384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf4e92-9350-4e31-a769-83a9ff8bcc2e admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:46.020266 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 940/1903] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:58:46.022337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf4e92-9350-4e31-a769-83a9ff8bcc2e admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:46.069782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:46.085334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf4e92-9350-4e31-a769-83a9ff8bcc2e admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:46.090756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70593283-f050-4d0d-903f-af6863c6b35e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:46.091566 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593283-f050-4d0d-903f-af6863c6b35e service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:46.091841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593283-f050-4d0d-903f-af6863c6b35e service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:46.092219 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593283-f050-4d0d-903f-af6863c6b35e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:46.129418 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 964/1904] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:45 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:58:46.129418 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b9eea-28b1-4d7b-aafd-f3142734bf86 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:46.144738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b9eea-28b1-4d7b-aafd-f3142734bf86 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:46.154453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c511a1-f8c5-4c3b-b7c0-0064bc59fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:46.155137 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c511a1-f8c5-4c3b-b7c0-0064bc59fdfb admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:46.155418 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c511a1-f8c5-4c3b-b7c0-0064bc59fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:46.155691 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c511a1-f8c5-4c3b-b7c0-0064bc59fdfb admin admin] PATH_INFO: `/v3/projects/b67403401cd741779c053a46241fc6ef/users/ad99ad5abf7c4ad3afd3342eac35200a/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:46.159626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70593283-f050-4d0d-903f-af6863c6b35e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:46.160182 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c511a1-f8c5-4c3b-b7c0-0064bc59fdfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b67403401cd741779c053a46241fc6ef, user_id=ad99ad5abf7c4ad3afd3342eac35200a, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:46.161252 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70593283-f050-4d0d-903f-af6863c6b35e service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:46.165022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c511a1-f8c5-4c3b-b7c0-0064bc59fdfb admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:46.173458 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 941/1905] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:46.174144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70593283-f050-4d0d-903f-af6863c6b35e service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:46.187382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 965/1906] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:46 2022] PUT /identity/v3/projects/b67403401cd741779c053a46241fc6ef/users/ad99ad5abf7c4ad3afd3342eac35200a/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:46.187823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70593283-f050-4d0d-903f-af6863c6b35e service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:46.189194 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245cdc6-7fcd-4962-bacf-363b958dc6a8 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:46.189483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245cdc6-7fcd-4962-bacf-363b958dc6a8 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:46.189808 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245cdc6-7fcd-4962-bacf-363b958dc6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:46.238363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-4245cdc6-7fcd-4962-bacf-363b958dc6a8 None None] MFA Rules not processed for user `ad99ad5abf7c4ad3afd3342eac35200a`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:46.240170 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4245cdc6-7fcd-4962-bacf-363b958dc6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:46.294896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514cf66-a483-4e4c-8f15-e30e80773296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:46.295944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514cf66-a483-4e4c-8f15-e30e80773296 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:46.296326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514cf66-a483-4e4c-8f15-e30e80773296 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:46.296714 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514cf66-a483-4e4c-8f15-e30e80773296 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:46.297897 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514cf66-a483-4e4c-8f15-e30e80773296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:46.299776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514cf66-a483-4e4c-8f15-e30e80773296 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:46.318026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 942/1907] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:46.324108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514cf66-a483-4e4c-8f15-e30e80773296 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:46.336263 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514cf66-a483-4e4c-8f15-e30e80773296 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:46.342204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a00f0-65f4-42fc-845e-fbac03c11f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:46.343055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a00f0-65f4-42fc-845e-fbac03c11f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:46.343950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a00f0-65f4-42fc-845e-fbac03c11f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:46.343950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a00f0-65f4-42fc-845e-fbac03c11f22 admin admin] PATH_INFO: `/v3/projects/16f8d9eb6eed4f72baa66f61bcae5e08/users/a417ef7c1a914857aa300a8b98a94682/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:46.350585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 966/1908] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:46.361462 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245cdc6-7fcd-4962-bacf-363b958dc6a8 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:46.363307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4245cdc6-7fcd-4962-bacf-363b958dc6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:46.375425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a00f0-65f4-42fc-845e-fbac03c11f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f8d9eb6eed4f72baa66f61bcae5e08, user_id=a417ef7c1a914857aa300a8b98a94682, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:46.380384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a00f0-65f4-42fc-845e-fbac03c11f22 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:46.446790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245cdc6-7fcd-4962-bacf-363b958dc6a8 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:46.450553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c458fe4-cc66-45c7-8439-9f78280c154a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:46.451170 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c458fe4-cc66-45c7-8439-9f78280c154a service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:46.451457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c458fe4-cc66-45c7-8439-9f78280c154a service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:46.451736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c458fe4-cc66-45c7-8439-9f78280c154a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:46.462349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c458fe4-cc66-45c7-8439-9f78280c154a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:46.463899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c458fe4-cc66-45c7-8439-9f78280c154a service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:46.474370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 967/1909] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:46 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:58:46.482953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 943/1910] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:46 2022] PUT /identity/v3/projects/16f8d9eb6eed4f72baa66f61bcae5e08/users/a417ef7c1a914857aa300a8b98a94682/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:46.489430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c458fe4-cc66-45c7-8439-9f78280c154a service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:46.503173 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c458fe4-cc66-45c7-8439-9f78280c154a service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:46.577966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a00f0-65f4-42fc-845e-fbac03c11f22 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:46.620995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0511b33-2cff-4b2a-8ea6-b5f7b7c942a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:46.621700 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0511b33-2cff-4b2a-8ea6-b5f7b7c942a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:46.621991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0511b33-2cff-4b2a-8ea6-b5f7b7c942a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:46.622247 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0511b33-2cff-4b2a-8ea6-b5f7b7c942a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:46.622889 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0511b33-2cff-4b2a-8ea6-b5f7b7c942a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:46.625209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0511b33-2cff-4b2a-8ea6-b5f7b7c942a7 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:46.637778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 968/1911] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:46.641649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0511b33-2cff-4b2a-8ea6-b5f7b7c942a7 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:46.651363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a00f0-65f4-42fc-845e-fbac03c11f22 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:46.652868 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0511b33-2cff-4b2a-8ea6-b5f7b7c942a7 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:46.657788 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38ea46-e11a-4c8d-8006-db668953e3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:46.658088 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795b299-a217-4436-8dd8-a81e11b855d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:46.658465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38ea46-e11a-4c8d-8006-db668953e3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:46.658712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795b299-a217-4436-8dd8-a81e11b855d7 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:46.658847 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38ea46-e11a-4c8d-8006-db668953e3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:46.658994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795b299-a217-4436-8dd8-a81e11b855d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:46.659094 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38ea46-e11a-4c8d-8006-db668953e3d6 admin admin] PATH_INFO: `/v3/projects/16f8d9eb6eed4f72baa66f61bcae5e08/users/a417ef7c1a914857aa300a8b98a94682/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:46.659268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795b299-a217-4436-8dd8-a81e11b855d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:46.661012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38ea46-e11a-4c8d-8006-db668953e3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f8d9eb6eed4f72baa66f61bcae5e08, user_id=a417ef7c1a914857aa300a8b98a94682, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:46.663882 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38ea46-e11a-4c8d-8006-db668953e3d6 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:46.675617 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 969/1912] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:46 2022] PUT /identity/v3/projects/16f8d9eb6eed4f72baa66f61bcae5e08/users/a417ef7c1a914857aa300a8b98a94682/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:58:46.687575 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e3b2c-b624-4847-a15e-ccb0496dad2a None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:46.687861 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e3b2c-b624-4847-a15e-ccb0496dad2a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:46.688144 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e3b2c-b624-4847-a15e-ccb0496dad2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:46.721420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-256e3b2c-b624-4847-a15e-ccb0496dad2a None None] MFA Rules not processed for user `a417ef7c1a914857aa300a8b98a94682`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:46.722660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-256e3b2c-b624-4847-a15e-ccb0496dad2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:46.725373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795b299-a217-4436-8dd8-a81e11b855d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:46.726872 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795b299-a217-4436-8dd8-a81e11b855d7 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:46.738081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 944/1913] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:46.796508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 970/1914] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:58:46.869059 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795b299-a217-4436-8dd8-a81e11b855d7 service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:46.879125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795b299-a217-4436-8dd8-a81e11b855d7 service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:46.940349 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bddf4d-865e-43c6-8714-d727d1eaea62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:46.940985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bddf4d-865e-43c6-8714-d727d1eaea62 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:46.941275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bddf4d-865e-43c6-8714-d727d1eaea62 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:46.941645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bddf4d-865e-43c6-8714-d727d1eaea62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:47.011892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bddf4d-865e-43c6-8714-d727d1eaea62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:47.018112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bddf4d-865e-43c6-8714-d727d1eaea62 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:47.032160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 945/1915] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:47.120611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:48.433977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:49.296787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:50.592154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:51.455565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:51.778951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e3b2c-b624-4847-a15e-ccb0496dad2a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:51.834341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:51.865075 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e3b2c-b624-4847-a15e-ccb0496dad2a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:51.872236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4f674-6c3e-4c58-be4a-794491b55f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:51.873177 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4f674-6c3e-4c58-be4a-794491b55f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:51.873458 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4f674-6c3e-4c58-be4a-794491b55f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:51.873729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4f674-6c3e-4c58-be4a-794491b55f1b admin admin] PATH_INFO: `/v3/users/eefe3b4de9fa416698fc849f3aa7e7ad` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:51.874882 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4f674-6c3e-4c58-be4a-794491b55f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eefe3b4de9fa416698fc849f3aa7e7ad)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:51.876874 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4f674-6c3e-4c58-be4a-794491b55f1b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:52.176782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-afe4f674-6c3e-4c58-be4a-794491b55f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eefe3b4de9fa416698fc849f3aa7e7ad'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:52.185152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-afe4f674-6c3e-4c58-be4a-794491b55f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eefe3b4de9fa416698fc849f3aa7e7ad'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:52.296395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-afe4f674-6c3e-4c58-be4a-794491b55f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eefe3b4de9fa416698fc849f3aa7e7ad'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:52.296959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-afe4f674-6c3e-4c58-be4a-794491b55f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eefe3b4de9fa416698fc849f3aa7e7ad'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:52.323942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-afe4f674-6c3e-4c58-be4a-794491b55f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eefe3b4de9fa416698fc849f3aa7e7ad'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:52.334526 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 971/1916] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:51 2022] DELETE /identity/v3/users/eefe3b4de9fa416698fc849f3aa7e7ad => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:52.339184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe72ff-de18-4ce7-9567-b7a77b3078b5 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:52.339513 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe72ff-de18-4ce7-9567-b7a77b3078b5 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:52.339797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe72ff-de18-4ce7-9567-b7a77b3078b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:52.364834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-52fe72ff-de18-4ce7-9567-b7a77b3078b5 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:52.375743 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-52fe72ff-de18-4ce7-9567-b7a77b3078b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:52.455561 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 946/1917] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:52.466419 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4f674-6c3e-4c58-be4a-794491b55f1b admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:52.468216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-afe4f674-6c3e-4c58-be4a-794491b55f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:52.507706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:52.541656 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4f674-6c3e-4c58-be4a-794491b55f1b admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:52.545654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3c7ce-85fe-4450-92f3-a1ea006f19ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:52.546314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3c7ce-85fe-4450-92f3-a1ea006f19ea service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:52.546602 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3c7ce-85fe-4450-92f3-a1ea006f19ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:52.546882 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3c7ce-85fe-4450-92f3-a1ea006f19ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:52.557208 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:52.558988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3c7ce-85fe-4450-92f3-a1ea006f19ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:52.560484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3c7ce-85fe-4450-92f3-a1ea006f19ea service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:52.572568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 972/1918] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:53.170605 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:53.267987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe72ff-de18-4ce7-9567-b7a77b3078b5 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:53.270530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-52fe72ff-de18-4ce7-9567-b7a77b3078b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:53.299576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe72ff-de18-4ce7-9567-b7a77b3078b5 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:53.306875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:53.307734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:53.308119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:53.308600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d admin admin] PATH_INFO: `/v3/projects/10bfc12517bd4c76ac4347f952f90bb6` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:53.310516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d admin admin] RBAC: Authorizing `identity:delete_project(project_id=10bfc12517bd4c76ac4347f952f90bb6)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:53.313100 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:53.317381 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:53.476273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10bfc12517bd4c76ac4347f952f90bb6', 'request_id': 'req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:53.522149 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3c7ce-85fe-4450-92f3-a1ea006f19ea service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:53.523683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a9c3c7ce-85fe-4450-92f3-a1ea006f19ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:53.545491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3c7ce-85fe-4450-92f3-a1ea006f19ea service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:53.560783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10bfc12517bd4c76ac4347f952f90bb6', 'request_id': 'req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:53.573927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10bfc12517bd4c76ac4347f952f90bb6', 'request_id': 'req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:53.597050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d admin admin] The token cache is being invalidate because project 10bfc12517bd4c76ac4347f952f90bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:53.597399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:53.598144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:53.604061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 947/1919] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:53 2022] DELETE /identity/v3/projects/10bfc12517bd4c76ac4347f952f90bb6 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:53.605631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:53.607415 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:53.619967 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f14fc-22dd-49ad-9caa-d1239de351ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:53.620719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f14fc-22dd-49ad-9caa-d1239de351ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:53.621176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f14fc-22dd-49ad-9caa-d1239de351ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:53.621477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f14fc-22dd-49ad-9caa-d1239de351ad admin admin] PATH_INFO: `/v3/users/00c13997850644e691f3c99b0043a280` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:53.623286 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f14fc-22dd-49ad-9caa-d1239de351ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=00c13997850644e691f3c99b0043a280)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:53.625304 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f14fc-22dd-49ad-9caa-d1239de351ad admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:53.709420 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f8bf-a098-4c3c-85aa-1ce5d7dca52d admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:53.715898 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee12bf-49d5-489c-855c-c987c40574cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:53.722336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee12bf-49d5-489c-855c-c987c40574cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:53.722336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee12bf-49d5-489c-855c-c987c40574cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:53.722336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee12bf-49d5-489c-855c-c987c40574cf admin admin] PATH_INFO: `/v3/users/a417ef7c1a914857aa300a8b98a94682` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:53.722336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee12bf-49d5-489c-855c-c987c40574cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a417ef7c1a914857aa300a8b98a94682)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:53.722336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee12bf-49d5-489c-855c-c987c40574cf admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:53.815262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-496f14fc-22dd-49ad-9caa-d1239de351ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00c13997850644e691f3c99b0043a280'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:53.831555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-496f14fc-22dd-49ad-9caa-d1239de351ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00c13997850644e691f3c99b0043a280'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:53.942222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-496f14fc-22dd-49ad-9caa-d1239de351ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00c13997850644e691f3c99b0043a280'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:53.942984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-496f14fc-22dd-49ad-9caa-d1239de351ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00c13997850644e691f3c99b0043a280'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:53.956543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-496f14fc-22dd-49ad-9caa-d1239de351ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00c13997850644e691f3c99b0043a280'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:53.963778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 973/1920] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:53 2022] DELETE /identity/v3/users/00c13997850644e691f3c99b0043a280 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:53.968275 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d51527-f561-4662-bf00-ea0cf8399fe6 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:53.968896 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d51527-f561-4662-bf00-ea0cf8399fe6 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:53.969181 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d51527-f561-4662-bf00-ea0cf8399fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:53.991605 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-16d51527-f561-4662-bf00-ea0cf8399fe6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:53.993765 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-16d51527-f561-4662-bf00-ea0cf8399fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:54.066227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 974/1921] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:58:54.081620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d51527-f561-4662-bf00-ea0cf8399fe6 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:54.083564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-16d51527-f561-4662-bf00-ea0cf8399fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:54.152664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d51527-f561-4662-bf00-ea0cf8399fe6 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:54.156767 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831eab1-6235-4131-bcfa-b3d072511882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:54.157496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831eab1-6235-4131-bcfa-b3d072511882 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:54.157775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831eab1-6235-4131-bcfa-b3d072511882 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:54.158047 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831eab1-6235-4131-bcfa-b3d072511882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:54.168971 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831eab1-6235-4131-bcfa-b3d072511882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:54.170429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831eab1-6235-4131-bcfa-b3d072511882 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:54.190001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 975/1922] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:54.223689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-00ee12bf-49d5-489c-855c-c987c40574cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a417ef7c1a914857aa300a8b98a94682'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:54.224506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-00ee12bf-49d5-489c-855c-c987c40574cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a417ef7c1a914857aa300a8b98a94682'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:54.225419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-00ee12bf-49d5-489c-855c-c987c40574cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a417ef7c1a914857aa300a8b98a94682'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:54.243876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-00ee12bf-49d5-489c-855c-c987c40574cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a417ef7c1a914857aa300a8b98a94682'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:54.256507 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-00ee12bf-49d5-489c-855c-c987c40574cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a417ef7c1a914857aa300a8b98a94682'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:54.279425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:54.334057 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 948/1923] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:53 2022] DELETE /identity/v3/users/a417ef7c1a914857aa300a8b98a94682 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:54.510539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:55.074697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:55.223850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831eab1-6235-4131-bcfa-b3d072511882 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:55.225726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-5831eab1-6235-4131-bcfa-b3d072511882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:55.241900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831eab1-6235-4131-bcfa-b3d072511882 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:55.296855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:55.350952 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee12bf-49d5-489c-855c-c987c40574cf admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:55.352733 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7acb11-6fde-4512-8e81-2fbc788ae89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:55.353510 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7acb11-6fde-4512-8e81-2fbc788ae89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:55.353795 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7acb11-6fde-4512-8e81-2fbc788ae89f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:55.353902 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-00ee12bf-49d5-489c-855c-c987c40574cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:55.354086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7acb11-6fde-4512-8e81-2fbc788ae89f admin admin] PATH_INFO: `/v3/projects/16f8d9eb6eed4f72baa66f61bcae5e08` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:55.355683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7acb11-6fde-4512-8e81-2fbc788ae89f admin admin] RBAC: Authorizing `identity:delete_project(project_id=16f8d9eb6eed4f72baa66f61bcae5e08)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:55.357875 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7acb11-6fde-4512-8e81-2fbc788ae89f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:55.374151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee12bf-49d5-489c-855c-c987c40574cf admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:55.402629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f6f23-bf60-4585-b4ad-859c0e3e342b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:55.403367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f6f23-bf60-4585-b4ad-859c0e3e342b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:55.404095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f6f23-bf60-4585-b4ad-859c0e3e342b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:55.404504 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f6f23-bf60-4585-b4ad-859c0e3e342b admin admin] PATH_INFO: `/v3/projects/a07d95c16a05416b9549f794acfbc86a` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:55.408996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f6f23-bf60-4585-b4ad-859c0e3e342b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07d95c16a05416b9549f794acfbc86a)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:55.412930 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f6f23-bf60-4585-b4ad-859c0e3e342b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:55.514227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-2f7acb11-6fde-4512-8e81-2fbc788ae89f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f8d9eb6eed4f72baa66f61bcae5e08', 'request_id': 'req-2f7acb11-6fde-4512-8e81-2fbc788ae89f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:55.528042 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-2f7acb11-6fde-4512-8e81-2fbc788ae89f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f8d9eb6eed4f72baa66f61bcae5e08', 'request_id': 'req-2f7acb11-6fde-4512-8e81-2fbc788ae89f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:55.534586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-2f7acb11-6fde-4512-8e81-2fbc788ae89f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f8d9eb6eed4f72baa66f61bcae5e08', 'request_id': 'req-2f7acb11-6fde-4512-8e81-2fbc788ae89f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:55.630090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-552f6f23-bf60-4585-b4ad-859c0e3e342b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07d95c16a05416b9549f794acfbc86a', 'request_id': 'req-552f6f23-bf60-4585-b4ad-859c0e3e342b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:55.646179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-2f7acb11-6fde-4512-8e81-2fbc788ae89f admin admin] The token cache is being invalidate because project 16f8d9eb6eed4f72baa66f61bcae5e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:55.646489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-2f7acb11-6fde-4512-8e81-2fbc788ae89f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:55.649576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-2f7acb11-6fde-4512-8e81-2fbc788ae89f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:55.649576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 976/1924] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:55 2022] DELETE /identity/v3/projects/16f8d9eb6eed4f72baa66f61bcae5e08 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:55.654701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faf9dd-bfdf-4599-8483-02680aa2f7d2 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:55.655098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faf9dd-bfdf-4599-8483-02680aa2f7d2 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:55.660675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faf9dd-bfdf-4599-8483-02680aa2f7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:55.687467 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-59faf9dd-bfdf-4599-8483-02680aa2f7d2 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:55.689291 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-59faf9dd-bfdf-4599-8483-02680aa2f7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:55.697479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-552f6f23-bf60-4585-b4ad-859c0e3e342b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07d95c16a05416b9549f794acfbc86a', 'request_id': 'req-552f6f23-bf60-4585-b4ad-859c0e3e342b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:55.706291 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-552f6f23-bf60-4585-b4ad-859c0e3e342b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07d95c16a05416b9549f794acfbc86a', 'request_id': 'req-552f6f23-bf60-4585-b4ad-859c0e3e342b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:55.719032 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-552f6f23-bf60-4585-b4ad-859c0e3e342b admin admin] The token cache is being invalidate because project a07d95c16a05416b9549f794acfbc86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:55.719438 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-552f6f23-bf60-4585-b4ad-859c0e3e342b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:55.720213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-552f6f23-bf60-4585-b4ad-859c0e3e342b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:55.722368 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 949/1925] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:55 2022] DELETE /identity/v3/projects/a07d95c16a05416b9549f794acfbc86a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:55.727214 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f6f23-bf60-4585-b4ad-859c0e3e342b admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:55.729823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-552f6f23-bf60-4585-b4ad-859c0e3e342b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:55.788179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 977/1926] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:55.795185 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37857d86-0ada-4afa-8756-92616b660f58 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:55.795474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37857d86-0ada-4afa-8756-92616b660f58 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:55.795754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37857d86-0ada-4afa-8756-92616b660f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:55.846101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-37857d86-0ada-4afa-8756-92616b660f58 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:55.847412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-37857d86-0ada-4afa-8756-92616b660f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:55.865933 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 978/1927] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:55.866138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f6f23-bf60-4585-b4ad-859c0e3e342b admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:55.868307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37857d86-0ada-4afa-8756-92616b660f58 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:55.884827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37857d86-0ada-4afa-8756-92616b660f58 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:55.886681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69eed85-53ff-4980-9f47-3c9c80a20487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:55.887758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eed85-53ff-4980-9f47-3c9c80a20487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:55.889278 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eed85-53ff-4980-9f47-3c9c80a20487 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:55.890010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eed85-53ff-4980-9f47-3c9c80a20487 admin admin] PATH_INFO: `/v3/users/ad99ad5abf7c4ad3afd3342eac35200a` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:55.893672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69eed85-53ff-4980-9f47-3c9c80a20487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad99ad5abf7c4ad3afd3342eac35200a)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:55.899914 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69eed85-53ff-4980-9f47-3c9c80a20487 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:55.900093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8336c-8314-4dfd-a508-0cd262931c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:55.900871 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8336c-8314-4dfd-a508-0cd262931c97 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:55.901245 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8336c-8314-4dfd-a508-0cd262931c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:55.902252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8336c-8314-4dfd-a508-0cd262931c97 admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:55.903090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8336c-8314-4dfd-a508-0cd262931c97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:55.903431 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8336c-8314-4dfd-a508-0cd262931c97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:55.908289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8336c-8314-4dfd-a508-0cd262931c97 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:55.924843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 979/1928] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:58:55.930914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8336c-8314-4dfd-a508-0cd262931c97 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:55.944154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8336c-8314-4dfd-a508-0cd262931c97 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:55.965608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405c8d9-c876-4241-9f8d-99515ed3cc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:55.966987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405c8d9-c876-4241-9f8d-99515ed3cc11 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:55.967283 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405c8d9-c876-4241-9f8d-99515ed3cc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:55.967557 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405c8d9-c876-4241-9f8d-99515ed3cc11 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:55.970029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405c8d9-c876-4241-9f8d-99515ed3cc11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:55.971997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405c8d9-c876-4241-9f8d-99515ed3cc11 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:56.096447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:56.109636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 980/1929] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:55 2022] POST /identity/v3/projects => generated 369 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:58:56.110837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405c8d9-c876-4241-9f8d-99515ed3cc11 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:56.173953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405c8d9-c876-4241-9f8d-99515ed3cc11 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:56.178784 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329ea94-9e56-4019-9a7c-6f142b8bb38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:56.179401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329ea94-9e56-4019-9a7c-6f142b8bb38a admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:56.180338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329ea94-9e56-4019-9a7c-6f142b8bb38a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:56.180837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329ea94-9e56-4019-9a7c-6f142b8bb38a admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:56.181603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329ea94-9e56-4019-9a7c-6f142b8bb38a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:56.183536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329ea94-9e56-4019-9a7c-6f142b8bb38a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:56.199009 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f69eed85-53ff-4980-9f47-3c9c80a20487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad99ad5abf7c4ad3afd3342eac35200a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:56.199812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f69eed85-53ff-4980-9f47-3c9c80a20487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad99ad5abf7c4ad3afd3342eac35200a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:56.200489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f69eed85-53ff-4980-9f47-3c9c80a20487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad99ad5abf7c4ad3afd3342eac35200a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:56.214440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f69eed85-53ff-4980-9f47-3c9c80a20487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad99ad5abf7c4ad3afd3342eac35200a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:56.221596 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f69eed85-53ff-4980-9f47-3c9c80a20487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad99ad5abf7c4ad3afd3342eac35200a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:56.295584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 981/1930] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:56 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:56.297802 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329ea94-9e56-4019-9a7c-6f142b8bb38a admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:56.299772 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e329ea94-9e56-4019-9a7c-6f142b8bb38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:56.313435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329ea94-9e56-4019-9a7c-6f142b8bb38a admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:56.318611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807342fb-140f-4c77-be34-3f11d06b5609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:56.319248 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807342fb-140f-4c77-be34-3f11d06b5609 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:56.319530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807342fb-140f-4c77-be34-3f11d06b5609 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:56.319802 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807342fb-140f-4c77-be34-3f11d06b5609 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:56.320497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807342fb-140f-4c77-be34-3f11d06b5609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:56.322154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807342fb-140f-4c77-be34-3f11d06b5609 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:56.341530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 950/1931] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:55 2022] DELETE /identity/v3/users/ad99ad5abf7c4ad3afd3342eac35200a => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:56.342283 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 982/1932] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:56.343412 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69eed85-53ff-4980-9f47-3c9c80a20487 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:56.491057 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69eed85-53ff-4980-9f47-3c9c80a20487 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:56.502682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ee571-1c73-4714-9b25-cc528150cd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:56.508268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ee571-1c73-4714-9b25-cc528150cd2c admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:56.508268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ee571-1c73-4714-9b25-cc528150cd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:56.508268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ee571-1c73-4714-9b25-cc528150cd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:56.508268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ee571-1c73-4714-9b25-cc528150cd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:56.509852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ee571-1c73-4714-9b25-cc528150cd2c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:56.526255 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:56.538090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 951/1933] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:56.540076 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807342fb-140f-4c77-be34-3f11d06b5609 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:56.571694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807342fb-140f-4c77-be34-3f11d06b5609 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:56.577356 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ded367-5028-4ffc-8561-d9e43835132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:56.578038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ded367-5028-4ffc-8561-d9e43835132e admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:56.578463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ded367-5028-4ffc-8561-d9e43835132e admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:56.578779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ded367-5028-4ffc-8561-d9e43835132e admin admin] PATH_INFO: `/v3/projects/cf7d543376754ac680284678d2496847/users/9653dbf85e6542e29cea9e46442d2f52/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:56.597955 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ded367-5028-4ffc-8561-d9e43835132e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7d543376754ac680284678d2496847, user_id=9653dbf85e6542e29cea9e46442d2f52, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:56.601049 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ded367-5028-4ffc-8561-d9e43835132e admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:56.689213 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 983/1934] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:56 2022] PUT /identity/v3/projects/cf7d543376754ac680284678d2496847/users/9653dbf85e6542e29cea9e46442d2f52/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:56.701577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76c519-7335-48dc-bd55-cc29a6218be5 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:56.702107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76c519-7335-48dc-bd55-cc29a6218be5 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:56.702641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76c519-7335-48dc-bd55-cc29a6218be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:56.762249 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-5d76c519-7335-48dc-bd55-cc29a6218be5 None None] MFA Rules not processed for user `9653dbf85e6542e29cea9e46442d2f52`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:56.763487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5d76c519-7335-48dc-bd55-cc29a6218be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:56.926469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 952/1935] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:56.950621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ded367-5028-4ffc-8561-d9e43835132e admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:56.954560 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a0ded367-5028-4ffc-8561-d9e43835132e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:56.990827 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:57.106704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76c519-7335-48dc-bd55-cc29a6218be5 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:57.110983 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5d76c519-7335-48dc-bd55-cc29a6218be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:57.252612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76c519-7335-48dc-bd55-cc29a6218be5 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:57.253434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ded367-5028-4ffc-8561-d9e43835132e admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:57.259563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c7ddf-fc09-455d-ad71-1d2458e366bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:57.265015 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c7ddf-fc09-455d-ad71-1d2458e366bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:57.268301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28693ab9-d02d-4549-92ba-52d3dfdccf07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e72cc048a0418cac062d68b8df402f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:57.269644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28693ab9-d02d-4549-92ba-52d3dfdccf07 service glance] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:57.269787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c7ddf-fc09-455d-ad71-1d2458e366bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:57.269883 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28693ab9-d02d-4549-92ba-52d3dfdccf07 service glance] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:57.269991 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c7ddf-fc09-455d-ad71-1d2458e366bf admin admin] PATH_INFO: `/v3/projects/b67403401cd741779c053a46241fc6ef` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:57.270080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28693ab9-d02d-4549-92ba-52d3dfdccf07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:57.276096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c7ddf-fc09-455d-ad71-1d2458e366bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b67403401cd741779c053a46241fc6ef)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:57.280519 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c7ddf-fc09-455d-ad71-1d2458e366bf admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:57.296785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28693ab9-d02d-4549-92ba-52d3dfdccf07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:57.299782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28693ab9-d02d-4549-92ba-52d3dfdccf07 service glance] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:57.352610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 984/1936] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:57.477374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-da1c7ddf-fc09-455d-ad71-1d2458e366bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b67403401cd741779c053a46241fc6ef', 'request_id': 'req-da1c7ddf-fc09-455d-ad71-1d2458e366bf'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:57.627740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-da1c7ddf-fc09-455d-ad71-1d2458e366bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b67403401cd741779c053a46241fc6ef', 'request_id': 'req-da1c7ddf-fc09-455d-ad71-1d2458e366bf'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:57.641384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-da1c7ddf-fc09-455d-ad71-1d2458e366bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b67403401cd741779c053a46241fc6ef', 'request_id': 'req-da1c7ddf-fc09-455d-ad71-1d2458e366bf'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:57.673900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-da1c7ddf-fc09-455d-ad71-1d2458e366bf admin admin] The token cache is being invalidate because project b67403401cd741779c053a46241fc6ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:57.674651 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-da1c7ddf-fc09-455d-ad71-1d2458e366bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:57.676304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-da1c7ddf-fc09-455d-ad71-1d2458e366bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:57.684687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 953/1937] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:57 2022] DELETE /identity/v3/projects/b67403401cd741779c053a46241fc6ef => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:57.686471 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbac2c-b64d-4767-bd7e-377f9b23aaeb None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:57.687023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbac2c-b64d-4767-bd7e-377f9b23aaeb None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:57.687146 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbac2c-b64d-4767-bd7e-377f9b23aaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:57.717585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-cacbac2c-b64d-4767-bd7e-377f9b23aaeb None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:57.719317 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-cacbac2c-b64d-4767-bd7e-377f9b23aaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:57.800484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 985/1938] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:57.811005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba6c99-e19a-4357-bd99-edbbe4691287 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:57.811400 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba6c99-e19a-4357-bd99-edbbe4691287 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:57.811765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba6c99-e19a-4357-bd99-edbbe4691287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:57.844512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-71ba6c99-e19a-4357-bd99-edbbe4691287 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:57.846371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-71ba6c99-e19a-4357-bd99-edbbe4691287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:57.860634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 954/1939] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:57.861667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbac2c-b64d-4767-bd7e-377f9b23aaeb None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:57.874733 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbac2c-b64d-4767-bd7e-377f9b23aaeb None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:57.880550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd088f-c391-46e9-af85-d6794a64531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:57.882065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd088f-c391-46e9-af85-d6794a64531c admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:57.882065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd088f-c391-46e9-af85-d6794a64531c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:57.882065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd088f-c391-46e9-af85-d6794a64531c admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:57.882638 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd088f-c391-46e9-af85-d6794a64531c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:57.883246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd088f-c391-46e9-af85-d6794a64531c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:57.884869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd088f-c391-46e9-af85-d6794a64531c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:57.905182 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 986/1940] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:58:57.916379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba6c99-e19a-4357-bd99-edbbe4691287 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:57.928643 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba6c99-e19a-4357-bd99-edbbe4691287 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:57.935325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15213286-8a63-4aa3-be29-138d4b874de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:57.936838 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15213286-8a63-4aa3-be29-138d4b874de0 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:57.937233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15213286-8a63-4aa3-be29-138d4b874de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:57.939673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15213286-8a63-4aa3-be29-138d4b874de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:57.939673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15213286-8a63-4aa3-be29-138d4b874de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:57.940704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15213286-8a63-4aa3-be29-138d4b874de0 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:58.089366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 955/1941] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:57 2022] POST /identity/v3/projects => generated 389 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:58.107126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd088f-c391-46e9-af85-d6794a64531c admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:58.126012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd088f-c391-46e9-af85-d6794a64531c admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:58.154156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:58.216703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd1ea5-dafc-419c-a626-a0d344d1cd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:58.217768 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd1ea5-dafc-419c-a626-a0d344d1cd6e admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:58.218354 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd1ea5-dafc-419c-a626-a0d344d1cd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:58.219091 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd1ea5-dafc-419c-a626-a0d344d1cd6e admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:58.220548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd1ea5-dafc-419c-a626-a0d344d1cd6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:58.222967 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd1ea5-dafc-419c-a626-a0d344d1cd6e admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:58.367919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 987/1942] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:58 2022] POST /identity/v3/users => generated 295 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:58.375857 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15213286-8a63-4aa3-be29-138d4b874de0 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:58.388183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15213286-8a63-4aa3-be29-138d4b874de0 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:58.399383 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f6555-19cc-4ead-910b-f54d5e5cb897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:58.400326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f6555-19cc-4ead-910b-f54d5e5cb897 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:58.400739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f6555-19cc-4ead-910b-f54d5e5cb897 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:58.401080 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f6555-19cc-4ead-910b-f54d5e5cb897 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:58.401977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f6555-19cc-4ead-910b-f54d5e5cb897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:58.403681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f6555-19cc-4ead-910b-f54d5e5cb897 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:58.416892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 956/1943] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:58.420894 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd1ea5-dafc-419c-a626-a0d344d1cd6e admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:58.435130 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd1ea5-dafc-419c-a626-a0d344d1cd6e admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:58.440491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f4624-2ca7-4993-8491-896e2ce266d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:58.441100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4624-2ca7-4993-8491-896e2ce266d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:58.441379 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4624-2ca7-4993-8491-896e2ce266d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:58.441649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4624-2ca7-4993-8491-896e2ce266d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:58.442296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f4624-2ca7-4993-8491-896e2ce266d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:58.445516 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f4624-2ca7-4993-8491-896e2ce266d6 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:58.457658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 988/1944] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:58.462674 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f6555-19cc-4ead-910b-f54d5e5cb897 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:58.478817 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f6555-19cc-4ead-910b-f54d5e5cb897 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:58.484071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89199042-4d52-4052-a458-9c3aef86ba8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:58.484777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89199042-4d52-4052-a458-9c3aef86ba8c admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:58.485055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89199042-4d52-4052-a458-9c3aef86ba8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:58.485343 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89199042-4d52-4052-a458-9c3aef86ba8c admin admin] PATH_INFO: `/v3/projects/18b04ece55cc4e93a02cc751204b5ee2/users/bcbf5345695140908e34b0e065ae24a2/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:58.510258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89199042-4d52-4052-a458-9c3aef86ba8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b04ece55cc4e93a02cc751204b5ee2, user_id=bcbf5345695140908e34b0e065ae24a2, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:58.510258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89199042-4d52-4052-a458-9c3aef86ba8c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:58.615960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 957/1945] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:58 2022] PUT /identity/v3/projects/18b04ece55cc4e93a02cc751204b5ee2/users/bcbf5345695140908e34b0e065ae24a2/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:58:58.627043 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447c143-fedb-4e1d-9e7a-06be15bc3cd8 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:58.627335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447c143-fedb-4e1d-9e7a-06be15bc3cd8 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:58.627610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447c143-fedb-4e1d-9e7a-06be15bc3cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:58.656064 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f447c143-fedb-4e1d-9e7a-06be15bc3cd8 None None] MFA Rules not processed for user `bcbf5345695140908e34b0e065ae24a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:58.657610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f447c143-fedb-4e1d-9e7a-06be15bc3cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:58.717910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89199042-4d52-4052-a458-9c3aef86ba8c admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:58.719620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-89199042-4d52-4052-a458-9c3aef86ba8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:58.723705 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 989/1946] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:58:58.728285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447c143-fedb-4e1d-9e7a-06be15bc3cd8 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:58.795761 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447c143-fedb-4e1d-9e7a-06be15bc3cd8 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:58.800522 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cde1f-fa09-45fb-8ce1-684cb3cfd2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:58.801143 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cde1f-fa09-45fb-8ce1-684cb3cfd2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:58.801427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cde1f-fa09-45fb-8ce1-684cb3cfd2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:58.801704 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cde1f-fa09-45fb-8ce1-684cb3cfd2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:58.802348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cde1f-fa09-45fb-8ce1-684cb3cfd2e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:58.803807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89199042-4d52-4052-a458-9c3aef86ba8c admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:58.804886 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cde1f-fa09-45fb-8ce1-684cb3cfd2e7 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:58.809596 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9be4fd-4b4c-4c25-8e3d-a3bf81b8b4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:58.810233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9be4fd-4b4c-4c25-8e3d-a3bf81b8b4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:58.810645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9be4fd-4b4c-4c25-8e3d-a3bf81b8b4db admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:58.810928 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9be4fd-4b4c-4c25-8e3d-a3bf81b8b4db admin admin] PATH_INFO: `/v3/users/3963e014caa646ec946897e777d504bf` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:58.812059 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9be4fd-4b4c-4c25-8e3d-a3bf81b8b4db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3963e014caa646ec946897e777d504bf)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:58.814012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9be4fd-4b4c-4c25-8e3d-a3bf81b8b4db admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:58.946537 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 990/1947] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:58 2022] POST /identity/v3/projects => generated 389 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:58.950777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cde1f-fa09-45fb-8ce1-684cb3cfd2e7 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:59.021824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cde1f-fa09-45fb-8ce1-684cb3cfd2e7 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:59.026628 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39751412-d0e4-4297-be8f-b47194cfba8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:59.027251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39751412-d0e4-4297-be8f-b47194cfba8c admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:59.027530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39751412-d0e4-4297-be8f-b47194cfba8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:59.030258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39751412-d0e4-4297-be8f-b47194cfba8c admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:59.030258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39751412-d0e4-4297-be8f-b47194cfba8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:59.030445 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39751412-d0e4-4297-be8f-b47194cfba8c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:59.187440 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 991/1948] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:58 2022] POST /identity/v3/users => generated 301 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:58:59.188665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39751412-d0e4-4297-be8f-b47194cfba8c admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:59.189300 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:59.199856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-1e9be4fd-4b4c-4c25-8e3d-a3bf81b8b4db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3963e014caa646ec946897e777d504bf'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:59.202408 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-1e9be4fd-4b4c-4c25-8e3d-a3bf81b8b4db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3963e014caa646ec946897e777d504bf'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:59.203393 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-1e9be4fd-4b4c-4c25-8e3d-a3bf81b8b4db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3963e014caa646ec946897e777d504bf'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:59.203507 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39751412-d0e4-4297-be8f-b47194cfba8c admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:59.215148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a4d5f-581e-43a0-9371-d98b7a80a1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:59.215917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a4d5f-581e-43a0-9371-d98b7a80a1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:59.216071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a4d5f-581e-43a0-9371-d98b7a80a1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:59.216391 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a4d5f-581e-43a0-9371-d98b7a80a1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:59.217649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a4d5f-581e-43a0-9371-d98b7a80a1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:59.219974 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a4d5f-581e-43a0-9371-d98b7a80a1c7 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:59.220377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-1e9be4fd-4b4c-4c25-8e3d-a3bf81b8b4db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3963e014caa646ec946897e777d504bf'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:59.229453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-1e9be4fd-4b4c-4c25-8e3d-a3bf81b8b4db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3963e014caa646ec946897e777d504bf'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:59.238742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 992/1949] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:59.238742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a4d5f-581e-43a0-9371-d98b7a80a1c7 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:59.240347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-429a4d5f-581e-43a0-9371-d98b7a80a1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:59.254160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a4d5f-581e-43a0-9371-d98b7a80a1c7 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:59.259135 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bad4f-35c3-48fd-b705-710499a323cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:59.259961 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bad4f-35c3-48fd-b705-710499a323cf admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:59.260589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bad4f-35c3-48fd-b705-710499a323cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:59.260928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bad4f-35c3-48fd-b705-710499a323cf admin admin] PATH_INFO: `/v3/projects/d887c45c59fd47c5a80bee12c3317ccc/users/b901157330eb4ebaa1db4c40cc12e659/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:59.277473 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bad4f-35c3-48fd-b705-710499a323cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d887c45c59fd47c5a80bee12c3317ccc, user_id=b901157330eb4ebaa1db4c40cc12e659, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:59.280255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bad4f-35c3-48fd-b705-710499a323cf admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:59.313521 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 958/1950] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:58 2022] DELETE /identity/v3/users/3963e014caa646ec946897e777d504bf => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:58:59.317686 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbc4e5-b400-43cf-8588-edf46bfb1b7a None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:59.317978 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbc4e5-b400-43cf-8588-edf46bfb1b7a None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:59.318255 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbc4e5-b400-43cf-8588-edf46bfb1b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:59.331446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 993/1951] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:59 2022] PUT /identity/v3/projects/d887c45c59fd47c5a80bee12c3317ccc/users/b901157330eb4ebaa1db4c40cc12e659/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:58:59.336022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bad4f-35c3-48fd-b705-710499a323cf admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:59.339415 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-1dbbc4e5-b400-43cf-8588-edf46bfb1b7a None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:59.340687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1dbbc4e5-b400-43cf-8588-edf46bfb1b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:59.411701 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 959/1952] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:59.421534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bad4f-35c3-48fd-b705-710499a323cf admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:59.424938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbc4e5-b400-43cf-8588-edf46bfb1b7a None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:59.427364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1dbbc4e5-b400-43cf-8588-edf46bfb1b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:59.429210 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252eb050-b293-42c1-87bc-d9d2e725c24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:59.429753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252eb050-b293-42c1-87bc-d9d2e725c24e admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:59.430117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252eb050-b293-42c1-87bc-d9d2e725c24e admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:59.430719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252eb050-b293-42c1-87bc-d9d2e725c24e admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:59.431796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252eb050-b293-42c1-87bc-d9d2e725c24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:59.434347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252eb050-b293-42c1-87bc-d9d2e725c24e admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:59.446552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 994/1953] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:59.469324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252eb050-b293-42c1-87bc-d9d2e725c24e admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:59.482677 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252eb050-b293-42c1-87bc-d9d2e725c24e admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:59.497573 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4954966-2ed7-496e-b624-6a8e94223531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:59.498813 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4954966-2ed7-496e-b624-6a8e94223531 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:59.499199 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4954966-2ed7-496e-b624-6a8e94223531 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:59.499585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4954966-2ed7-496e-b624-6a8e94223531 admin admin] PATH_INFO: `/v3/projects/d887c45c59fd47c5a80bee12c3317ccc/users/b901157330eb4ebaa1db4c40cc12e659/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:59.501733 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4954966-2ed7-496e-b624-6a8e94223531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d887c45c59fd47c5a80bee12c3317ccc, user_id=b901157330eb4ebaa1db4c40cc12e659, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:59.512587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4954966-2ed7-496e-b624-6a8e94223531 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:59.514559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbc4e5-b400-43cf-8588-edf46bfb1b7a None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:59.524047 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 995/1954] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:59 2022] PUT /identity/v3/projects/d887c45c59fd47c5a80bee12c3317ccc/users/b901157330eb4ebaa1db4c40cc12e659/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:59.534559 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9fd2f-62b3-43ad-8827-418c50ea4f3d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:59.535085 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9fd2f-62b3-43ad-8827-418c50ea4f3d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:59.535384 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9fd2f-62b3-43ad-8827-418c50ea4f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:59.587149 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-9de9fd2f-62b3-43ad-8827-418c50ea4f3d None None] MFA Rules not processed for user `b901157330eb4ebaa1db4c40cc12e659`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:59.588981 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-9de9fd2f-62b3-43ad-8827-418c50ea4f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:59.599740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dea99-d8f0-44f1-8fa9-868f57d19fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:59.601607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dea99-d8f0-44f1-8fa9-868f57d19fdc service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:59.601990 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dea99-d8f0-44f1-8fa9-868f57d19fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:59.602907 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dea99-d8f0-44f1-8fa9-868f57d19fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:59.654995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:59.753395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 996/1955] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:58:59 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:59.768419 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9fd2f-62b3-43ad-8827-418c50ea4f3d None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:59.770239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-9de9fd2f-62b3-43ad-8827-418c50ea4f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:59.775112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143dea99-d8f0-44f1-8fa9-868f57d19fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:59.777675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143dea99-d8f0-44f1-8fa9-868f57d19fdc service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:59.801043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 960/1956] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:59.855059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9fd2f-62b3-43ad-8827-418c50ea4f3d None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:59.859259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbcde4-d650-457b-8c73-1e058d4debc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:59.860589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbcde4-d650-457b-8c73-1e058d4debc8 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:59.860589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbcde4-d650-457b-8c73-1e058d4debc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:59.860589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbcde4-d650-457b-8c73-1e058d4debc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:59.882516 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbcde4-d650-457b-8c73-1e058d4debc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:59.883816 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbcde4-d650-457b-8c73-1e058d4debc8 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:59.897609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 997/1957] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:59 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:00.063939 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:00.099195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dea99-d8f0-44f1-8fa9-868f57d19fdc service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:00.110811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dea99-d8f0-44f1-8fa9-868f57d19fdc service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:00.119876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b17fe9-e3a9-408f-a428-bbd886009bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:00.124121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b17fe9-e3a9-408f-a428-bbd886009bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:00.124121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b17fe9-e3a9-408f-a428-bbd886009bda admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:00.124121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b17fe9-e3a9-408f-a428-bbd886009bda admin admin] PATH_INFO: `/v3/users/bcbf5345695140908e34b0e065ae24a2` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:00.125114 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b17fe9-e3a9-408f-a428-bbd886009bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbf5345695140908e34b0e065ae24a2)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:00.127744 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b17fe9-e3a9-408f-a428-bbd886009bda admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:00.363526 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbcde4-d650-457b-8c73-1e058d4debc8 service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:00.365048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-3bfbcde4-d650-457b-8c73-1e058d4debc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:00.380321 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbcde4-d650-457b-8c73-1e058d4debc8 service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:00.388735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fcea5-3db9-43a6-9174-b327a8a77934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:00.389768 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fcea5-3db9-43a6-9174-b327a8a77934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:00.390382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fcea5-3db9-43a6-9174-b327a8a77934 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:00.390801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fcea5-3db9-43a6-9174-b327a8a77934 admin admin] PATH_INFO: `/v3/projects/f1a02aed3f864358a96fe450c7646c53` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:00.394062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88fcea5-3db9-43a6-9174-b327a8a77934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a02aed3f864358a96fe450c7646c53)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:00.396315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88fcea5-3db9-43a6-9174-b327a8a77934 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:00.415475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-73b17fe9-e3a9-408f-a428-bbd886009bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbf5345695140908e34b0e065ae24a2'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:00.416263 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-73b17fe9-e3a9-408f-a428-bbd886009bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbf5345695140908e34b0e065ae24a2'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:00.416952 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-73b17fe9-e3a9-408f-a428-bbd886009bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbf5345695140908e34b0e065ae24a2'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:00.437891 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-73b17fe9-e3a9-408f-a428-bbd886009bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbf5345695140908e34b0e065ae24a2'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:00.445612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-73b17fe9-e3a9-408f-a428-bbd886009bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbf5345695140908e34b0e065ae24a2'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:00.540632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 961/1958] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:00 2022] DELETE /identity/v3/users/bcbf5345695140908e34b0e065ae24a2 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:00.543407 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c7688-6bcc-4d66-ad39-2baccac88de8 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:00.543859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c7688-6bcc-4d66-ad39-2baccac88de8 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:00.544352 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c7688-6bcc-4d66-ad39-2baccac88de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:00.553699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b88fcea5-3db9-43a6-9174-b327a8a77934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a02aed3f864358a96fe450c7646c53', 'request_id': 'req-b88fcea5-3db9-43a6-9174-b327a8a77934'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:00.563614 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b88fcea5-3db9-43a6-9174-b327a8a77934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a02aed3f864358a96fe450c7646c53', 'request_id': 'req-b88fcea5-3db9-43a6-9174-b327a8a77934'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:00.573110 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b88fcea5-3db9-43a6-9174-b327a8a77934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a02aed3f864358a96fe450c7646c53', 'request_id': 'req-b88fcea5-3db9-43a6-9174-b327a8a77934'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:00.576068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-775c7688-6bcc-4d66-ad39-2baccac88de8 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:00.578133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-775c7688-6bcc-4d66-ad39-2baccac88de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:00.658781 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 962/1959] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:00.661854 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b88fcea5-3db9-43a6-9174-b327a8a77934 admin admin] The token cache is being invalidate because project f1a02aed3f864358a96fe450c7646c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:00.662387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b88fcea5-3db9-43a6-9174-b327a8a77934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:00.663232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b88fcea5-3db9-43a6-9174-b327a8a77934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:00.666533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 998/1960] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:00 2022] DELETE /identity/v3/projects/f1a02aed3f864358a96fe450c7646c53 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:00.668121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c7688-6bcc-4d66-ad39-2baccac88de8 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:00.669595 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-775c7688-6bcc-4d66-ad39-2baccac88de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:00.670649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fcea5-3db9-43a6-9174-b327a8a77934 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:00.674227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:00.676385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b88fcea5-3db9-43a6-9174-b327a8a77934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:00.735728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:00.761353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c7688-6bcc-4d66-ad39-2baccac88de8 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:00.765991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fcea5-3db9-43a6-9174-b327a8a77934 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:00.771169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239df09-5b21-439e-bcf4-457c9c2071d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:00.771808 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239df09-5b21-439e-bcf4-457c9c2071d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:00.772090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239df09-5b21-439e-bcf4-457c9c2071d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:00.772410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239df09-5b21-439e-bcf4-457c9c2071d0 admin admin] PATH_INFO: `/v3/users/d9852154173f4555a30225f3ecdc6efd` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:00.774347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239df09-5b21-439e-bcf4-457c9c2071d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9852154173f4555a30225f3ecdc6efd)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:00.774544 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b48ea-6a96-4838-a852-eecede2a88c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:00.775137 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b48ea-6a96-4838-a852-eecede2a88c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:00.775900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b48ea-6a96-4838-a852-eecede2a88c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:00.775900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b48ea-6a96-4838-a852-eecede2a88c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:00.776434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239df09-5b21-439e-bcf4-457c9c2071d0 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:00.777837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-769b48ea-6a96-4838-a852-eecede2a88c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:00.797646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b48ea-6a96-4838-a852-eecede2a88c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:00.799025 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b48ea-6a96-4838-a852-eecede2a88c1 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:00.809763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 963/1961] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:59:00.989630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:00.997156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7239df09-5b21-439e-bcf4-457c9c2071d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9852154173f4555a30225f3ecdc6efd'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:01.005149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b48ea-6a96-4838-a852-eecede2a88c1 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:01.006807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-769b48ea-6a96-4838-a852-eecede2a88c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:01.007068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7239df09-5b21-439e-bcf4-457c9c2071d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9852154173f4555a30225f3ecdc6efd'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:01.028668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b48ea-6a96-4838-a852-eecede2a88c1 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:01.052717 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27422096-4fbc-4051-9811-0f1a3bcd9610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:01.053274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422096-4fbc-4051-9811-0f1a3bcd9610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:01.053563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422096-4fbc-4051-9811-0f1a3bcd9610 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:01.053839 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422096-4fbc-4051-9811-0f1a3bcd9610 admin admin] PATH_INFO: `/v3/users/07d08290883240d29e7c8f4064770435` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:01.060818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27422096-4fbc-4051-9811-0f1a3bcd9610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d08290883240d29e7c8f4064770435)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:01.063120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27422096-4fbc-4051-9811-0f1a3bcd9610 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:01.072952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7239df09-5b21-439e-bcf4-457c9c2071d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9852154173f4555a30225f3ecdc6efd'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:01.073590 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7239df09-5b21-439e-bcf4-457c9c2071d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9852154173f4555a30225f3ecdc6efd'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:01.103717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7239df09-5b21-439e-bcf4-457c9c2071d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9852154173f4555a30225f3ecdc6efd'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:01.114398 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 999/1962] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:00 2022] DELETE /identity/v3/users/d9852154173f4555a30225f3ecdc6efd => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:01.252335 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-27422096-4fbc-4051-9811-0f1a3bcd9610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d08290883240d29e7c8f4064770435'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:01.253331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-27422096-4fbc-4051-9811-0f1a3bcd9610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d08290883240d29e7c8f4064770435'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:01.253961 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-27422096-4fbc-4051-9811-0f1a3bcd9610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d08290883240d29e7c8f4064770435'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:01.273500 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-27422096-4fbc-4051-9811-0f1a3bcd9610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d08290883240d29e7c8f4064770435'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:01.287676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-27422096-4fbc-4051-9811-0f1a3bcd9610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d08290883240d29e7c8f4064770435'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:01.399029 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 964/1963] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:01 2022] DELETE /identity/v3/users/07d08290883240d29e7c8f4064770435 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:01.401112 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dcd8f-3335-43ca-a57c-da4f8936edd1 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:01.401503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dcd8f-3335-43ca-a57c-da4f8936edd1 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:01.401918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dcd8f-3335-43ca-a57c-da4f8936edd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:01.430840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-fb5dcd8f-3335-43ca-a57c-da4f8936edd1 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:01.432270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-fb5dcd8f-3335-43ca-a57c-da4f8936edd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:01.457030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:01.520504 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:01.572793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1000/1964] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:01.585762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27422096-4fbc-4051-9811-0f1a3bcd9610 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:01.599833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-27422096-4fbc-4051-9811-0f1a3bcd9610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:01.678002 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27422096-4fbc-4051-9811-0f1a3bcd9610 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:01.689827 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e038f1-0368-4a2c-bd5d-c4b5b3447ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:01.691095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e038f1-0368-4a2c-bd5d-c4b5b3447ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:01.691588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e038f1-0368-4a2c-bd5d-c4b5b3447ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:01.692065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e038f1-0368-4a2c-bd5d-c4b5b3447ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:01.716496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dcd8f-3335-43ca-a57c-da4f8936edd1 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:01.717975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-fb5dcd8f-3335-43ca-a57c-da4f8936edd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:01.730309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e038f1-0368-4a2c-bd5d-c4b5b3447ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:01.736202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e038f1-0368-4a2c-bd5d-c4b5b3447ba4 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:01.749783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dcd8f-3335-43ca-a57c-da4f8936edd1 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:01.767202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:01.773731 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:01.774334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:01.774540 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee admin admin] PATH_INFO: `/v3/projects/18b04ece55cc4e93a02cc751204b5ee2` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:01.775646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 965/1965] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:01.779759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b04ece55cc4e93a02cc751204b5ee2)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:01.781514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:01.931393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b04ece55cc4e93a02cc751204b5ee2', 'request_id': 'req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:01.937775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b04ece55cc4e93a02cc751204b5ee2', 'request_id': 'req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:01.944295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b04ece55cc4e93a02cc751204b5ee2', 'request_id': 'req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:02.040219 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e038f1-0368-4a2c-bd5d-c4b5b3447ba4 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:02.040555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee admin admin] The token cache is being invalidate because project 18b04ece55cc4e93a02cc751204b5ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:02.040999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:02.041872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:02.042266 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-81e038f1-0368-4a2c-bd5d-c4b5b3447ba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:02.044587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1001/1966] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:01 2022] DELETE /identity/v3/projects/18b04ece55cc4e93a02cc751204b5ee2 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:02.047726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:02.049750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:02.072018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e038f1-0368-4a2c-bd5d-c4b5b3447ba4 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:02.153786 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b900a5-ffff-4a37-95fb-4a5b7717b2ee admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:02.156328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:02.157711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a240ec-90ba-4e78-bfff-3eb1320ca218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:02.158471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a240ec-90ba-4e78-bfff-3eb1320ca218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:02.158760 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a240ec-90ba-4e78-bfff-3eb1320ca218 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:02.159106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a240ec-90ba-4e78-bfff-3eb1320ca218 admin admin] PATH_INFO: `/v3/projects/350204ce50cc4558bc7d8d317404196e` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:02.165530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a240ec-90ba-4e78-bfff-3eb1320ca218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=350204ce50cc4558bc7d8d317404196e)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:02.167767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a240ec-90ba-4e78-bfff-3eb1320ca218 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:02.186264 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039b380-d8a4-4943-92ec-9b599718ee0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:02.187638 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039b380-d8a4-4943-92ec-9b599718ee0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:02.189169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039b380-d8a4-4943-92ec-9b599718ee0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:02.189552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039b380-d8a4-4943-92ec-9b599718ee0a admin admin] PATH_INFO: `/v3/users/b901157330eb4ebaa1db4c40cc12e659` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:02.190927 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039b380-d8a4-4943-92ec-9b599718ee0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b901157330eb4ebaa1db4c40cc12e659)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:02.193968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039b380-d8a4-4943-92ec-9b599718ee0a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:02.339318 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-65a240ec-90ba-4e78-bfff-3eb1320ca218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350204ce50cc4558bc7d8d317404196e', 'request_id': 'req-65a240ec-90ba-4e78-bfff-3eb1320ca218'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:02.405212 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-65a240ec-90ba-4e78-bfff-3eb1320ca218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350204ce50cc4558bc7d8d317404196e', 'request_id': 'req-65a240ec-90ba-4e78-bfff-3eb1320ca218'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:02.412503 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-65a240ec-90ba-4e78-bfff-3eb1320ca218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350204ce50cc4558bc7d8d317404196e', 'request_id': 'req-65a240ec-90ba-4e78-bfff-3eb1320ca218'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:02.424920 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-65a240ec-90ba-4e78-bfff-3eb1320ca218 admin admin] The token cache is being invalidate because project 350204ce50cc4558bc7d8d317404196e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:02.425379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-65a240ec-90ba-4e78-bfff-3eb1320ca218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:02.426408 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-65a240ec-90ba-4e78-bfff-3eb1320ca218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:02.428401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 966/1967] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:02 2022] DELETE /identity/v3/projects/350204ce50cc4558bc7d8d317404196e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:02.433615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500f014-5777-43fb-a8c2-835917c6dcf0 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:02.433797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500f014-5777-43fb-a8c2-835917c6dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:02.435512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500f014-5777-43fb-a8c2-835917c6dcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:02.465752 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-2500f014-5777-43fb-a8c2-835917c6dcf0 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:02.467184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2500f014-5777-43fb-a8c2-835917c6dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:02.475169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c039b380-d8a4-4943-92ec-9b599718ee0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b901157330eb4ebaa1db4c40cc12e659'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:02.495561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c039b380-d8a4-4943-92ec-9b599718ee0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b901157330eb4ebaa1db4c40cc12e659'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:02.509454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:02.564501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c039b380-d8a4-4943-92ec-9b599718ee0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b901157330eb4ebaa1db4c40cc12e659'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:02.565280 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c039b380-d8a4-4943-92ec-9b599718ee0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b901157330eb4ebaa1db4c40cc12e659'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:02.584119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 967/1968] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:59:02.584119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500f014-5777-43fb-a8c2-835917c6dcf0 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:02.584119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2500f014-5777-43fb-a8c2-835917c6dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:02.593524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500f014-5777-43fb-a8c2-835917c6dcf0 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:02.595396 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c039b380-d8a4-4943-92ec-9b599718ee0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b901157330eb4ebaa1db4c40cc12e659'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:02.602621 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d197d-e1d0-4b94-b573-bf38b2c31a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:02.603378 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d197d-e1d0-4b94-b573-bf38b2c31a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:02.603740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d197d-e1d0-4b94-b573-bf38b2c31a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:02.604079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d197d-e1d0-4b94-b573-bf38b2c31a6c admin admin] PATH_INFO: `/v3/projects/59c36aa0c6784366ad2f51bc07813124` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:02.606013 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1002/1969] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:02 2022] DELETE /identity/v3/users/b901157330eb4ebaa1db4c40cc12e659 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:02.607434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3413e6-483e-4763-b97c-0ccc72e148f6 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:02.607727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3413e6-483e-4763-b97c-0ccc72e148f6 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:02.608001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3413e6-483e-4763-b97c-0ccc72e148f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:02.608096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d197d-e1d0-4b94-b573-bf38b2c31a6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c36aa0c6784366ad2f51bc07813124)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:02.611924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d197d-e1d0-4b94-b573-bf38b2c31a6c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:02.633592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-2c3413e6-483e-4763-b97c-0ccc72e148f6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:02.635294 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-2c3413e6-483e-4763-b97c-0ccc72e148f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:02.733157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1003/1970] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:02.734281 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3413e6-483e-4763-b97c-0ccc72e148f6 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:02.749290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3413e6-483e-4763-b97c-0ccc72e148f6 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:02.758518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-530d197d-e1d0-4b94-b573-bf38b2c31a6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c36aa0c6784366ad2f51bc07813124', 'request_id': 'req-530d197d-e1d0-4b94-b573-bf38b2c31a6c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:02.841576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a96e2-9472-4ebc-8243-cbfbee314b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:02.842209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a96e2-9472-4ebc-8243-cbfbee314b73 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:02.842843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a96e2-9472-4ebc-8243-cbfbee314b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:02.842843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a96e2-9472-4ebc-8243-cbfbee314b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:02.843771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a96e2-9472-4ebc-8243-cbfbee314b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:59:02.844103 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a96e2-9472-4ebc-8243-cbfbee314b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:02.845857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a96e2-9472-4ebc-8243-cbfbee314b73 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:02.860972 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1004/1971] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:59:02.865543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a96e2-9472-4ebc-8243-cbfbee314b73 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:02.877191 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a96e2-9472-4ebc-8243-cbfbee314b73 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:02.883680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067303a3-35c5-4058-88d9-7ceb2ebe84bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:02.884664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067303a3-35c5-4058-88d9-7ceb2ebe84bd admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:02.885122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067303a3-35c5-4058-88d9-7ceb2ebe84bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:02.885498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067303a3-35c5-4058-88d9-7ceb2ebe84bd admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:02.886421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067303a3-35c5-4058-88d9-7ceb2ebe84bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:02.888684 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067303a3-35c5-4058-88d9-7ceb2ebe84bd admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:03.156432 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-530d197d-e1d0-4b94-b573-bf38b2c31a6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c36aa0c6784366ad2f51bc07813124', 'request_id': 'req-530d197d-e1d0-4b94-b573-bf38b2c31a6c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:03.166919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1005/1972] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:02 2022] POST /identity/v3/projects => generated 383 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:59:03.168435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067303a3-35c5-4058-88d9-7ceb2ebe84bd admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:03.185483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-530d197d-e1d0-4b94-b573-bf38b2c31a6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c36aa0c6784366ad2f51bc07813124', 'request_id': 'req-530d197d-e1d0-4b94-b573-bf38b2c31a6c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:03.205272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-530d197d-e1d0-4b94-b573-bf38b2c31a6c admin admin] The token cache is being invalidate because project 59c36aa0c6784366ad2f51bc07813124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:03.205709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-530d197d-e1d0-4b94-b573-bf38b2c31a6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:03.206520 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-530d197d-e1d0-4b94-b573-bf38b2c31a6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:03.208506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 968/1973] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:02 2022] DELETE /identity/v3/projects/59c36aa0c6784366ad2f51bc07813124 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:03.215137 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d197d-e1d0-4b94-b573-bf38b2c31a6c admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:03.217825 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-530d197d-e1d0-4b94-b573-bf38b2c31a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:03.304841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d197d-e1d0-4b94-b573-bf38b2c31a6c admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:03.307425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067303a3-35c5-4058-88d9-7ceb2ebe84bd admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:03.307425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96c5c4-928b-4f0d-ba99-b6514cbff14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:03.307425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96c5c4-928b-4f0d-ba99-b6514cbff14c admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:03.307425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96c5c4-928b-4f0d-ba99-b6514cbff14c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:03.308496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96c5c4-928b-4f0d-ba99-b6514cbff14c admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:03.308496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96c5c4-928b-4f0d-ba99-b6514cbff14c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:03.308496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96c5c4-928b-4f0d-ba99-b6514cbff14c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:03.343853 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45b922-30e3-43da-88ee-b6faaf34f00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:03.344554 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45b922-30e3-43da-88ee-b6faaf34f00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:03.344836 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45b922-30e3-43da-88ee-b6faaf34f00a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:03.345112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45b922-30e3-43da-88ee-b6faaf34f00a admin admin] PATH_INFO: `/v3/users/639cdfd62a404c2bbe31a449664dcc31` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:03.346686 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45b922-30e3-43da-88ee-b6faaf34f00a admin admin] RBAC: Authorizing `identity:delete_user(user_id=639cdfd62a404c2bbe31a449664dcc31)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:03.348797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45b922-30e3-43da-88ee-b6faaf34f00a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:03.408676 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1006/1974] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:03 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:03.409933 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96c5c4-928b-4f0d-ba99-b6514cbff14c admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:03.412220 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-9c96c5c4-928b-4f0d-ba99-b6514cbff14c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:03.427531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96c5c4-928b-4f0d-ba99-b6514cbff14c admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:03.434405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5a39e-2605-4bb3-abef-d7e7b270f2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:03.435578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5a39e-2605-4bb3-abef-d7e7b270f2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:03.435578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5a39e-2605-4bb3-abef-d7e7b270f2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:03.435836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5a39e-2605-4bb3-abef-d7e7b270f2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:03.442200 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5a39e-2605-4bb3-abef-d7e7b270f2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:03.446296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5a39e-2605-4bb3-abef-d7e7b270f2c8 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:03.464284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1007/1975] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:59:03.468272 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5a39e-2605-4bb3-abef-d7e7b270f2c8 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:03.486986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5a39e-2605-4bb3-abef-d7e7b270f2c8 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:03.493244 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41cf4c-1a7d-4b6a-931c-a2a2e62c422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:03.493963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41cf4c-1a7d-4b6a-931c-a2a2e62c422b admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:03.494162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41cf4c-1a7d-4b6a-931c-a2a2e62c422b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:03.494415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41cf4c-1a7d-4b6a-931c-a2a2e62c422b admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:03.495067 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41cf4c-1a7d-4b6a-931c-a2a2e62c422b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:03.496944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41cf4c-1a7d-4b6a-931c-a2a2e62c422b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:03.512340 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1008/1976] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:03.520594 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41cf4c-1a7d-4b6a-931c-a2a2e62c422b admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:03.531829 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41cf4c-1a7d-4b6a-931c-a2a2e62c422b admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:03.536784 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ecd7c-04ce-4658-972e-92a6dec1d42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:03.537630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ecd7c-04ce-4658-972e-92a6dec1d42a admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:03.537925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ecd7c-04ce-4658-972e-92a6dec1d42a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:03.538205 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ecd7c-04ce-4658-972e-92a6dec1d42a admin admin] PATH_INFO: `/v3/projects/0f2e3dbf86264e8d832605c0b7329b05/users/b7d27670b58940d588b85bef13e609c3/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:03.589826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-9e45b922-30e3-43da-88ee-b6faaf34f00a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639cdfd62a404c2bbe31a449664dcc31'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:03.591075 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-9e45b922-30e3-43da-88ee-b6faaf34f00a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639cdfd62a404c2bbe31a449664dcc31'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:03.591803 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-9e45b922-30e3-43da-88ee-b6faaf34f00a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639cdfd62a404c2bbe31a449664dcc31'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:03.597037 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ecd7c-04ce-4658-972e-92a6dec1d42a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2e3dbf86264e8d832605c0b7329b05, user_id=b7d27670b58940d588b85bef13e609c3, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:03.600044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ecd7c-04ce-4658-972e-92a6dec1d42a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:03.621881 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-9e45b922-30e3-43da-88ee-b6faaf34f00a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639cdfd62a404c2bbe31a449664dcc31'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:03.635903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-9e45b922-30e3-43da-88ee-b6faaf34f00a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639cdfd62a404c2bbe31a449664dcc31'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:03.715878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1009/1977] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:03 2022] PUT /identity/v3/projects/0f2e3dbf86264e8d832605c0b7329b05/users/b7d27670b58940d588b85bef13e609c3/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:03.716583 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 969/1978] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:03 2022] DELETE /identity/v3/users/639cdfd62a404c2bbe31a449664dcc31 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:03.717399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ecd7c-04ce-4658-972e-92a6dec1d42a admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:03.719663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-6a7ecd7c-04ce-4658-972e-92a6dec1d42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:03.726981 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f840b5-9102-4ef4-ab30-9ce232ce713f None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:03.730266 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f840b5-9102-4ef4-ab30-9ce232ce713f None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:03.730413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f840b5-9102-4ef4-ab30-9ce232ce713f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:03.742886 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:03.803082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-f0f840b5-9102-4ef4-ab30-9ce232ce713f None None] MFA Rules not processed for user `b7d27670b58940d588b85bef13e609c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:03.805178 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f0f840b5-9102-4ef4-ab30-9ce232ce713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:03.833176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ecd7c-04ce-4658-972e-92a6dec1d42a admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:03.927118 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 970/1979] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:59:03.928556 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f840b5-9102-4ef4-ab30-9ce232ce713f None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:03.931375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f0f840b5-9102-4ef4-ab30-9ce232ce713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:03.946860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fac788-6813-4963-ad20-c12cc806f4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:03.947876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fac788-6813-4963-ad20-c12cc806f4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:03.948358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fac788-6813-4963-ad20-c12cc806f4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:03.949069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fac788-6813-4963-ad20-c12cc806f4f4 admin admin] PATH_INFO: `/v3/projects/d887c45c59fd47c5a80bee12c3317ccc` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:03.951544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fac788-6813-4963-ad20-c12cc806f4f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d887c45c59fd47c5a80bee12c3317ccc)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:03.956830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fac788-6813-4963-ad20-c12cc806f4f4 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:04.030737 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:04.100244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f840b5-9102-4ef4-ab30-9ce232ce713f None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:04.109395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a1fac788-6813-4963-ad20-c12cc806f4f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd887c45c59fd47c5a80bee12c3317ccc', 'request_id': 'req-a1fac788-6813-4963-ad20-c12cc806f4f4'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:04.120673 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a1fac788-6813-4963-ad20-c12cc806f4f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd887c45c59fd47c5a80bee12c3317ccc', 'request_id': 'req-a1fac788-6813-4963-ad20-c12cc806f4f4'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:04.132265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a1fac788-6813-4963-ad20-c12cc806f4f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd887c45c59fd47c5a80bee12c3317ccc', 'request_id': 'req-a1fac788-6813-4963-ad20-c12cc806f4f4'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:04.184730 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca134fd-1b67-4604-ab2e-a95116d251d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:04.185362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca134fd-1b67-4604-ab2e-a95116d251d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:04.185646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca134fd-1b67-4604-ab2e-a95116d251d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:04.185921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca134fd-1b67-4604-ab2e-a95116d251d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:04.186724 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca134fd-1b67-4604-ab2e-a95116d251d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:04.192111 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca134fd-1b67-4604-ab2e-a95116d251d7 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:04.209994 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a1fac788-6813-4963-ad20-c12cc806f4f4 admin admin] The token cache is being invalidate because project d887c45c59fd47c5a80bee12c3317ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:04.210471 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a1fac788-6813-4963-ad20-c12cc806f4f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:04.211210 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a1fac788-6813-4963-ad20-c12cc806f4f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:04.212894 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1010/1980] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:03 2022] DELETE /identity/v3/projects/d887c45c59fd47c5a80bee12c3317ccc => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:04.217463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4ba94-dc4a-4cef-9837-0b6c94932be3 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:04.217849 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4ba94-dc4a-4cef-9837-0b6c94932be3 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:04.218190 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4ba94-dc4a-4cef-9837-0b6c94932be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:04.241055 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-14e4ba94-dc4a-4cef-9837-0b6c94932be3 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:04.243362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-14e4ba94-dc4a-4cef-9837-0b6c94932be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:04.256292 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1011/1981] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:59:04.264054 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16b61c-b964-41ef-9f17-107d5fefd5a3 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:04.264514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16b61c-b964-41ef-9f17-107d5fefd5a3 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:04.265650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16b61c-b964-41ef-9f17-107d5fefd5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:04.287699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-6f16b61c-b964-41ef-9f17-107d5fefd5a3 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:04.289356 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-6f16b61c-b964-41ef-9f17-107d5fefd5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:04.306359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1012/1982] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:59:04.310630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16b61c-b964-41ef-9f17-107d5fefd5a3 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:04.316683 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 971/1983] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:03 2022] POST /identity/v3/projects => generated 381 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:04.317835 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca134fd-1b67-4604-ab2e-a95116d251d7 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:04.323189 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-3ca134fd-1b67-4604-ab2e-a95116d251d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:04.328114 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16b61c-b964-41ef-9f17-107d5fefd5a3 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:04.436109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca134fd-1b67-4604-ab2e-a95116d251d7 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:04.441106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e122e-6a54-433c-bec9-c26c98fd361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:04.441736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e122e-6a54-433c-bec9-c26c98fd361f admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:04.442011 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e122e-6a54-433c-bec9-c26c98fd361f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:04.442282 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e122e-6a54-433c-bec9-c26c98fd361f admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:04.443065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e122e-6a54-433c-bec9-c26c98fd361f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:04.445937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e122e-6a54-433c-bec9-c26c98fd361f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:04.456616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8afd2-ca71-431a-919f-8ab2fab11a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:04.457664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8afd2-ca71-431a-919f-8ab2fab11a26 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:04.457958 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8afd2-ca71-431a-919f-8ab2fab11a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:04.458292 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8afd2-ca71-431a-919f-8ab2fab11a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:04.458964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8afd2-ca71-431a-919f-8ab2fab11a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:59:04.459273 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8afd2-ca71-431a-919f-8ab2fab11a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:04.461900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8afd2-ca71-431a-919f-8ab2fab11a26 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:04.477272 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1013/1984] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:59:04.478725 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7ce56-5f15-4031-abde-502fd326a9df None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:04.479012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7ce56-5f15-4031-abde-502fd326a9df None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:04.479285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7ce56-5f15-4031-abde-502fd326a9df None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:04.480875 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1014/1985] 10.222.0.72 () {54 vars in 921 bytes} [Mon Aug 29 22:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:59:04.481742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7ce56-5f15-4031-abde-502fd326a9df None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:04.495830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7ce56-5f15-4031-abde-502fd326a9df None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:04.500710 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527b87b-194a-4595-8eec-0b2ec79eba4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:04.501380 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527b87b-194a-4595-8eec-0b2ec79eba4c admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:04.501653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527b87b-194a-4595-8eec-0b2ec79eba4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:04.501928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527b87b-194a-4595-8eec-0b2ec79eba4c admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:04.502874 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527b87b-194a-4595-8eec-0b2ec79eba4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:04.504670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527b87b-194a-4595-8eec-0b2ec79eba4c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:04.543703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 972/1986] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:04 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:04.543703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f7484-5929-4bc6-8703-17587a625c3e None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:04.543703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f7484-5929-4bc6-8703-17587a625c3e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:04.543703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f7484-5929-4bc6-8703-17587a625c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:04.563416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-510f7484-5929-4bc6-8703-17587a625c3e None None] MFA Rules not processed for user `83c5fb88d96640089eba545f4c8d3c44`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:04.564854 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-510f7484-5929-4bc6-8703-17587a625c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:04.630958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 973/1987] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Aug 29 22:59:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:04.631801 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f7484-5929-4bc6-8703-17587a625c3e None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:04.634172 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-510f7484-5929-4bc6-8703-17587a625c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:04.651115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f7484-5929-4bc6-8703-17587a625c3e None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:04.655393 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd57fae-ae31-40cc-b70b-71571afe9131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:04.656034 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd57fae-ae31-40cc-b70b-71571afe9131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:04.656348 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd57fae-ae31-40cc-b70b-71571afe9131 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:04.656625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd57fae-ae31-40cc-b70b-71571afe9131 admin admin] PATH_INFO: `/v3/users/fbc534cfc37940579e8e508f8a037750` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:04.656793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1015/1988] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:04 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:59:04.657712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527b87b-194a-4595-8eec-0b2ec79eba4c admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:04.661034 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd57fae-ae31-40cc-b70b-71571afe9131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc534cfc37940579e8e508f8a037750)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:04.663132 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd57fae-ae31-40cc-b70b-71571afe9131 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:04.740229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527b87b-194a-4595-8eec-0b2ec79eba4c admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:04.745604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820f678-b490-4068-86e9-b5b71070152c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:04.746217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820f678-b490-4068-86e9-b5b71070152c admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:04.746495 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820f678-b490-4068-86e9-b5b71070152c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:04.746764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820f678-b490-4068-86e9-b5b71070152c admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:04.747408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820f678-b490-4068-86e9-b5b71070152c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:04.749040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820f678-b490-4068-86e9-b5b71070152c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:04.762925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1016/1989] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:04.762925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820f678-b490-4068-86e9-b5b71070152c admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:04.765821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-3820f678-b490-4068-86e9-b5b71070152c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:04.790374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-ebd57fae-ae31-40cc-b70b-71571afe9131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc534cfc37940579e8e508f8a037750'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:04.791047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-ebd57fae-ae31-40cc-b70b-71571afe9131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc534cfc37940579e8e508f8a037750'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:04.791747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-ebd57fae-ae31-40cc-b70b-71571afe9131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc534cfc37940579e8e508f8a037750'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:04.804725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-ebd57fae-ae31-40cc-b70b-71571afe9131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc534cfc37940579e8e508f8a037750'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:04.811908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-ebd57fae-ae31-40cc-b70b-71571afe9131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc534cfc37940579e8e508f8a037750'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:04.837939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820f678-b490-4068-86e9-b5b71070152c admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:04.843148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cc603-6166-4b83-ac22-8713806c7e9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5fb88d96640089eba545f4c8d3c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:04.843757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cc603-6166-4b83-ac22-8713806c7e9b service placement] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:04.844035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cc603-6166-4b83-ac22-8713806c7e9b service placement] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:04.844339 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cc603-6166-4b83-ac22-8713806c7e9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:04.846091 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-087cc603-6166-4b83-ac22-8713806c7e9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:04.858066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cc603-6166-4b83-ac22-8713806c7e9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:04.859651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cc603-6166-4b83-ac22-8713806c7e9b service placement] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:04.870051 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1017/1990] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:04.870850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cc603-6166-4b83-ac22-8713806c7e9b service placement] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:04.872274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-087cc603-6166-4b83-ac22-8713806c7e9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:04.879733 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 974/1991] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:04 2022] DELETE /identity/v3/users/fbc534cfc37940579e8e508f8a037750 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:04.880481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd57fae-ae31-40cc-b70b-71571afe9131 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:04.886182 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-ebd57fae-ae31-40cc-b70b-71571afe9131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:04.888878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cc603-6166-4b83-ac22-8713806c7e9b service placement] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:04.937061 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:04.966926 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06791b2-c738-41c4-b267-7423eaaf6507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:04.967798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06791b2-c738-41c4-b267-7423eaaf6507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:04.968226 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06791b2-c738-41c4-b267-7423eaaf6507 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:04.968726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06791b2-c738-41c4-b267-7423eaaf6507 admin admin] PATH_INFO: `/v3/projects/d4257f6c3c4e4c5d93bc162c0f238475` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:04.969793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06791b2-c738-41c4-b267-7423eaaf6507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4257f6c3c4e4c5d93bc162c0f238475)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:04.971902 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06791b2-c738-41c4-b267-7423eaaf6507 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:04.975228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd57fae-ae31-40cc-b70b-71571afe9131 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:04.981437 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48f389-fd1d-487e-9fba-d2b6f6ab18c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:04.982764 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48f389-fd1d-487e-9fba-d2b6f6ab18c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:04.983204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48f389-fd1d-487e-9fba-d2b6f6ab18c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:04.983590 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48f389-fd1d-487e-9fba-d2b6f6ab18c9 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:04.984299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48f389-fd1d-487e-9fba-d2b6f6ab18c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:04.987428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48f389-fd1d-487e-9fba-d2b6f6ab18c9 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:05.021791 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:05.090987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 975/1992] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:04 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:05.091785 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48f389-fd1d-487e-9fba-d2b6f6ab18c9 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:05.093545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4b48f389-fd1d-487e-9fba-d2b6f6ab18c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:05.109021 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48f389-fd1d-487e-9fba-d2b6f6ab18c9 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:05.113816 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26a0b7-217f-4378-8595-a20454685aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:05.114484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26a0b7-217f-4378-8595-a20454685aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.122194 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26a0b7-217f-4378-8595-a20454685aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.122194 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26a0b7-217f-4378-8595-a20454685aaf admin admin] PATH_INFO: `/v3/projects/8bb325f49bdf4a0fa4c0fecfb475b2be/users/c1367dc00de94fc1949de5ddd707bcd7/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.129648 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-f06791b2-c738-41c4-b267-7423eaaf6507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4257f6c3c4e4c5d93bc162c0f238475', 'request_id': 'req-f06791b2-c738-41c4-b267-7423eaaf6507'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:05.137034 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-f06791b2-c738-41c4-b267-7423eaaf6507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4257f6c3c4e4c5d93bc162c0f238475', 'request_id': 'req-f06791b2-c738-41c4-b267-7423eaaf6507'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:05.137984 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26a0b7-217f-4378-8595-a20454685aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb325f49bdf4a0fa4c0fecfb475b2be, user_id=c1367dc00de94fc1949de5ddd707bcd7, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:05.140949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26a0b7-217f-4378-8595-a20454685aaf admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:05.142677 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-f06791b2-c738-41c4-b267-7423eaaf6507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4257f6c3c4e4c5d93bc162c0f238475', 'request_id': 'req-f06791b2-c738-41c4-b267-7423eaaf6507'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:05.234029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-f06791b2-c738-41c4-b267-7423eaaf6507 admin admin] The token cache is being invalidate because project d4257f6c3c4e4c5d93bc162c0f238475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:05.238317 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-f06791b2-c738-41c4-b267-7423eaaf6507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:05.238476 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 976/1993] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:05 2022] PUT /identity/v3/projects/8bb325f49bdf4a0fa4c0fecfb475b2be/users/c1367dc00de94fc1949de5ddd707bcd7/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:05.238582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-f06791b2-c738-41c4-b267-7423eaaf6507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:05.238676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26a0b7-217f-4378-8595-a20454685aaf admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:05.238676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4e26a0b7-217f-4378-8595-a20454685aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:05.238865 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1018/1994] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:04 2022] DELETE /identity/v3/projects/d4257f6c3c4e4c5d93bc162c0f238475 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:05.238865 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06791b2-c738-41c4-b267-7423eaaf6507 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:05.239963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f06791b2-c738-41c4-b267-7423eaaf6507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:05.309136 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26a0b7-217f-4378-8595-a20454685aaf admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:05.313918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06791b2-c738-41c4-b267-7423eaaf6507 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:05.314059 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d1cef-f35c-4b6e-9877-82472645cbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:05.314672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d1cef-f35c-4b6e-9877-82472645cbee admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.314956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d1cef-f35c-4b6e-9877-82472645cbee admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.315232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d1cef-f35c-4b6e-9877-82472645cbee admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.315886 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d1cef-f35c-4b6e-9877-82472645cbee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:05.317709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d1cef-f35c-4b6e-9877-82472645cbee admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:05.323148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0866279-7744-49e1-9bbc-c5ca7d7361db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:05.324320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0866279-7744-49e1-9bbc-c5ca7d7361db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.324320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0866279-7744-49e1-9bbc-c5ca7d7361db admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.324515 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0866279-7744-49e1-9bbc-c5ca7d7361db admin admin] PATH_INFO: `/v3/projects/9d9c8644b0f543559839e056773016ce` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.325597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0866279-7744-49e1-9bbc-c5ca7d7361db admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d9c8644b0f543559839e056773016ce)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:05.330997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 977/1995] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:05.330997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d1cef-f35c-4b6e-9877-82472645cbee admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:05.331235 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0866279-7744-49e1-9bbc-c5ca7d7361db admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:05.333177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-977d1cef-f35c-4b6e-9877-82472645cbee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:05.350255 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d1cef-f35c-4b6e-9877-82472645cbee admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:05.355950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d74a29-24da-48d4-9acb-bdc84d61da31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:05.356605 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d74a29-24da-48d4-9acb-bdc84d61da31 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.357005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d74a29-24da-48d4-9acb-bdc84d61da31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.357291 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d74a29-24da-48d4-9acb-bdc84d61da31 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.357945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d74a29-24da-48d4-9acb-bdc84d61da31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:05.359541 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d74a29-24da-48d4-9acb-bdc84d61da31 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:05.374837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 978/1996] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:05.374837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d7b5a-5433-4ac9-a279-477ce961eb76 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.384422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d7b5a-5433-4ac9-a279-477ce961eb76 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.384422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d7b5a-5433-4ac9-a279-477ce961eb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.396893 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-f42d7b5a-5433-4ac9-a279-477ce961eb76 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:05.398908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f42d7b5a-5433-4ac9-a279-477ce961eb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:05.407463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 979/1997] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:05.410896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d7b5a-5433-4ac9-a279-477ce961eb76 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:05.426991 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d7b5a-5433-4ac9-a279-477ce961eb76 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:05.433534 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dba4a-33f1-4753-9a88-677fa08b07b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:05.434417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dba4a-33f1-4753-9a88-677fa08b07b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.434698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dba4a-33f1-4753-9a88-677fa08b07b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.435004 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dba4a-33f1-4753-9a88-677fa08b07b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.435661 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12dba4a-33f1-4753-9a88-677fa08b07b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:05.437299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12dba4a-33f1-4753-9a88-677fa08b07b4 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:05.449581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 980/1998] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:05.451009 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dba4a-33f1-4753-9a88-677fa08b07b4 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:05.459496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:05.464609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dba4a-33f1-4753-9a88-677fa08b07b4 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:05.468535 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a0866279-7744-49e1-9bbc-c5ca7d7361db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d9c8644b0f543559839e056773016ce', 'request_id': 'req-a0866279-7744-49e1-9bbc-c5ca7d7361db'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:05.476308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a0866279-7744-49e1-9bbc-c5ca7d7361db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d9c8644b0f543559839e056773016ce', 'request_id': 'req-a0866279-7744-49e1-9bbc-c5ca7d7361db'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:05.482832 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a0866279-7744-49e1-9bbc-c5ca7d7361db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d9c8644b0f543559839e056773016ce', 'request_id': 'req-a0866279-7744-49e1-9bbc-c5ca7d7361db'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:05.497852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:05.533817 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbaadb-fb6c-4609-b857-d3bb7ae7f2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:05.535095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbaadb-fb6c-4609-b857-d3bb7ae7f2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.535387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbaadb-fb6c-4609-b857-d3bb7ae7f2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.535658 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbaadb-fb6c-4609-b857-d3bb7ae7f2d2 admin admin] PATH_INFO: `/v3/projects/8bb325f49bdf4a0fa4c0fecfb475b2be/users/c1367dc00de94fc1949de5ddd707bcd7/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.535962 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a0866279-7744-49e1-9bbc-c5ca7d7361db admin admin] The token cache is being invalidate because project 9d9c8644b0f543559839e056773016ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:05.536379 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a0866279-7744-49e1-9bbc-c5ca7d7361db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:05.537340 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a0866279-7744-49e1-9bbc-c5ca7d7361db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:05.537865 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbaadb-fb6c-4609-b857-d3bb7ae7f2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb325f49bdf4a0fa4c0fecfb475b2be, user_id=c1367dc00de94fc1949de5ddd707bcd7, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:05.540128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1019/1999] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:05 2022] DELETE /identity/v3/projects/9d9c8644b0f543559839e056773016ce => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:05.541637 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2af99-aa95-48f4-8902-7d4cef5d623e None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.541902 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbaadb-fb6c-4609-b857-d3bb7ae7f2d2 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:05.542354 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2af99-aa95-48f4-8902-7d4cef5d623e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.542845 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2af99-aa95-48f4-8902-7d4cef5d623e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.552937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 981/2000] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:05 2022] PUT /identity/v3/projects/8bb325f49bdf4a0fa4c0fecfb475b2be/users/c1367dc00de94fc1949de5ddd707bcd7/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:05.553788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbaadb-fb6c-4609-b857-d3bb7ae7f2d2 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:05.556345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-fadbaadb-fb6c-4609-b857-d3bb7ae7f2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:05.596152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-85c2af99-aa95-48f4-8902-7d4cef5d623e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:05.599290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-85c2af99-aa95-48f4-8902-7d4cef5d623e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:05.610973 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:05.626576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbaadb-fb6c-4609-b857-d3bb7ae7f2d2 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:05.631635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6233c-632e-45dd-9e2e-31a56c56788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:05.634058 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6233c-632e-45dd-9e2e-31a56c56788b admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.634058 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6233c-632e-45dd-9e2e-31a56c56788b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.634479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6233c-632e-45dd-9e2e-31a56c56788b admin admin] PATH_INFO: `/v3/projects/0a5cc96149984dd6b16b2a29165a698a/users/39e089e6b2234e37bd6d140de7ef8d4a/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.658539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6233c-632e-45dd-9e2e-31a56c56788b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5cc96149984dd6b16b2a29165a698a, user_id=39e089e6b2234e37bd6d140de7ef8d4a, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:05.661180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6233c-632e-45dd-9e2e-31a56c56788b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:05.669128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1020/2001] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:05.670513 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807f34f-6054-47d1-8f8c-364ca9ddcb26 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.670798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807f34f-6054-47d1-8f8c-364ca9ddcb26 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.671073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807f34f-6054-47d1-8f8c-364ca9ddcb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.693975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-6807f34f-6054-47d1-8f8c-364ca9ddcb26 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:05.696102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-6807f34f-6054-47d1-8f8c-364ca9ddcb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:05.703892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1021/2002] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:05.705158 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74825-8495-4459-a664-a8db8c45643b None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.705440 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74825-8495-4459-a664-a8db8c45643b None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.705709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74825-8495-4459-a664-a8db8c45643b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.719515 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 982/2003] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:05 2022] PUT /identity/v3/projects/0a5cc96149984dd6b16b2a29165a698a/users/39e089e6b2234e37bd6d140de7ef8d4a/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:05.722365 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6233c-632e-45dd-9e2e-31a56c56788b admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:05.740781 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-cfd74825-8495-4459-a664-a8db8c45643b None None] MFA Rules not processed for user `c1367dc00de94fc1949de5ddd707bcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:05.742119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-cfd74825-8495-4459-a664-a8db8c45643b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:05.789613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6233c-632e-45dd-9e2e-31a56c56788b admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:05.793965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:05.796385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d321e-e651-48e0-9609-2d0c8716c099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:05.797128 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d321e-e651-48e0-9609-2d0c8716c099 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.797416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d321e-e651-48e0-9609-2d0c8716c099 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.797716 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d321e-e651-48e0-9609-2d0c8716c099 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.798373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d321e-e651-48e0-9609-2d0c8716c099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:59:05.798682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d321e-e651-48e0-9609-2d0c8716c099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:05.800337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d321e-e651-48e0-9609-2d0c8716c099 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:05.812817 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 983/2004] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:59:05.816759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1022/2005] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:05.816913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f5ec-45f5-4638-8b32-a9819249f161 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.816913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f5ec-45f5-4638-8b32-a9819249f161 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.816913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f5ec-45f5-4638-8b32-a9819249f161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.817146 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552499a5-551a-4f40-8b2d-71715401aaac None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.817146 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552499a5-551a-4f40-8b2d-71715401aaac None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.817146 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552499a5-551a-4f40-8b2d-71715401aaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.839574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-b561f5ec-45f5-4638-8b32-a9819249f161 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:05.839796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-552499a5-551a-4f40-8b2d-71715401aaac None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:05.840843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b561f5ec-45f5-4638-8b32-a9819249f161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:05.841000 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-552499a5-551a-4f40-8b2d-71715401aaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:05.848973 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1023/2006] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:05.849880 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552499a5-551a-4f40-8b2d-71715401aaac None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:05.853304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 984/2007] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:05.854963 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f5ec-45f5-4638-8b32-a9819249f161 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:05.856249 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b561f5ec-45f5-4638-8b32-a9819249f161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:05.868510 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552499a5-551a-4f40-8b2d-71715401aaac None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:05.873302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431e5a6-40be-4dcf-9618-5ab3a60b2227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:05.873959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431e5a6-40be-4dcf-9618-5ab3a60b2227 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.874239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431e5a6-40be-4dcf-9618-5ab3a60b2227 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.874519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431e5a6-40be-4dcf-9618-5ab3a60b2227 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.875160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431e5a6-40be-4dcf-9618-5ab3a60b2227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:05.877151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431e5a6-40be-4dcf-9618-5ab3a60b2227 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:05.881781 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:05.918270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:05.923022 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f5ec-45f5-4638-8b32-a9819249f161 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:05.926968 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd7540-af99-46b6-8225-89bf4f865c61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:05.927591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd7540-af99-46b6-8225-89bf4f865c61 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.927873 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd7540-af99-46b6-8225-89bf4f865c61 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.928148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd7540-af99-46b6-8225-89bf4f865c61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.939512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd7540-af99-46b6-8225-89bf4f865c61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:05.941126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd7540-af99-46b6-8225-89bf4f865c61 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:05.952997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 985/2008] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:05.953850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd7540-af99-46b6-8225-89bf4f865c61 service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:05.965355 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd7540-af99-46b6-8225-89bf4f865c61 service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:05.969977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892626-b01b-429f-9a22-8523ca483e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:05.970592 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892626-b01b-429f-9a22-8523ca483e77 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:05.970877 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892626-b01b-429f-9a22-8523ca483e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:05.971151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892626-b01b-429f-9a22-8523ca483e77 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:05.971841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c892626-b01b-429f-9a22-8523ca483e77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:59:05.972148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c892626-b01b-429f-9a22-8523ca483e77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:05.974406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c892626-b01b-429f-9a22-8523ca483e77 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:05.990433 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 986/2009] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:59:05.990433 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892626-b01b-429f-9a22-8523ca483e77 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:05.994653 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0c892626-b01b-429f-9a22-8523ca483e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:06.018807 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1024/2010] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:05 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:06.019833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431e5a6-40be-4dcf-9618-5ab3a60b2227 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:06.075687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892626-b01b-429f-9a22-8523ca483e77 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:06.097406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:06.102218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431e5a6-40be-4dcf-9618-5ab3a60b2227 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:06.107350 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c9d6c-4d97-411f-a462-fcec3a62fd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:06.107964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c9d6c-4d97-411f-a462-fcec3a62fd4f admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:06.108297 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c9d6c-4d97-411f-a462-fcec3a62fd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:06.108586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c9d6c-4d97-411f-a462-fcec3a62fd4f admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:06.109229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c9d6c-4d97-411f-a462-fcec3a62fd4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:06.111141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c9d6c-4d97-411f-a462-fcec3a62fd4f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:06.134050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3b1fb-c21e-4072-a313-47e7d2a0990d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:06.134050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3b1fb-c21e-4072-a313-47e7d2a0990d service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:06.134050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3b1fb-c21e-4072-a313-47e7d2a0990d service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:06.134050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3b1fb-c21e-4072-a313-47e7d2a0990d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:06.143908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3b1fb-c21e-4072-a313-47e7d2a0990d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:06.145752 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3b1fb-c21e-4072-a313-47e7d2a0990d service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:06.157416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 987/2011] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:06.158223 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3b1fb-c21e-4072-a313-47e7d2a0990d service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:06.169100 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3b1fb-c21e-4072-a313-47e7d2a0990d service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:06.174275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa59572-4274-457f-a114-16a830640d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:06.174888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59572-4274-457f-a114-16a830640d63 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:06.175214 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59572-4274-457f-a114-16a830640d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:06.175424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59572-4274-457f-a114-16a830640d63 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:06.176047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa59572-4274-457f-a114-16a830640d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:06.178016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa59572-4274-457f-a114-16a830640d63 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:06.235401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1025/2012] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:06 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:06.236148 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c9d6c-4d97-411f-a462-fcec3a62fd4f admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:06.264347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:06.272038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 988/2013] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:06 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:06.273435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa59572-4274-457f-a114-16a830640d63 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:06.284895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa59572-4274-457f-a114-16a830640d63 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:06.307609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c9d6c-4d97-411f-a462-fcec3a62fd4f admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:06.311426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70285aa1-989f-4579-82b5-4b18f185ce0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:06.312177 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70285aa1-989f-4579-82b5-4b18f185ce0b service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:06.312498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70285aa1-989f-4579-82b5-4b18f185ce0b service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:06.312761 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70285aa1-989f-4579-82b5-4b18f185ce0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:06.316640 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-70285aa1-989f-4579-82b5-4b18f185ce0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:06.357505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad651e-a1c8-43cf-84dc-f51275dffcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:06.359321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad651e-a1c8-43cf-84dc-f51275dffcd8 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:06.359834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad651e-a1c8-43cf-84dc-f51275dffcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:06.360319 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad651e-a1c8-43cf-84dc-f51275dffcd8 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:06.361123 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad651e-a1c8-43cf-84dc-f51275dffcd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:06.363822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad651e-a1c8-43cf-84dc-f51275dffcd8 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:06.388443 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70285aa1-989f-4579-82b5-4b18f185ce0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:06.389940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70285aa1-989f-4579-82b5-4b18f185ce0b service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:06.400121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1026/2014] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:06.401147 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70285aa1-989f-4579-82b5-4b18f185ce0b service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:06.412310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70285aa1-989f-4579-82b5-4b18f185ce0b service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:06.418571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010f7cb-9f46-45ce-b9d0-8185a0a692be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:06.419324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010f7cb-9f46-45ce-b9d0-8185a0a692be admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:06.419616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010f7cb-9f46-45ce-b9d0-8185a0a692be admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:06.419962 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010f7cb-9f46-45ce-b9d0-8185a0a692be admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:06.420728 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010f7cb-9f46-45ce-b9d0-8185a0a692be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:06.425114 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010f7cb-9f46-45ce-b9d0-8185a0a692be admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:06.439943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1027/2015] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:06.441385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010f7cb-9f46-45ce-b9d0-8185a0a692be admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:06.454493 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010f7cb-9f46-45ce-b9d0-8185a0a692be admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:06.465024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee553ab-14aa-40c1-ad5f-54c96439286b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:06.465884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee553ab-14aa-40c1-ad5f-54c96439286b admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:06.466317 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee553ab-14aa-40c1-ad5f-54c96439286b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:06.467421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee553ab-14aa-40c1-ad5f-54c96439286b admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:06.469038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee553ab-14aa-40c1-ad5f-54c96439286b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:06.470727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee553ab-14aa-40c1-ad5f-54c96439286b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:06.475789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:06.483502 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 989/2016] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:06 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:06.491024 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad651e-a1c8-43cf-84dc-f51275dffcd8 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:06.493097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1028/2017] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:06.497654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee553ab-14aa-40c1-ad5f-54c96439286b admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:06.508138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad651e-a1c8-43cf-84dc-f51275dffcd8 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:06.514185 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee553ab-14aa-40c1-ad5f-54c96439286b admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:06.519300 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddcfbc-b183-4612-862f-292cd5045854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:06.520043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddcfbc-b183-4612-862f-292cd5045854 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:06.520361 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddcfbc-b183-4612-862f-292cd5045854 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:06.520756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddcfbc-b183-4612-862f-292cd5045854 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:06.521226 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff34de-99bf-454f-9a15-721b1eb323d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:06.521821 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddcfbc-b183-4612-862f-292cd5045854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:06.522104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff34de-99bf-454f-9a15-721b1eb323d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:06.522389 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff34de-99bf-454f-9a15-721b1eb323d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:06.522659 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff34de-99bf-454f-9a15-721b1eb323d5 admin admin] PATH_INFO: `/v3/projects/e0c62a15c0924bf3a9e56876693d5f02/users/7842fcfeb0584b4eb926686ecf3fd000/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:06.524726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddcfbc-b183-4612-862f-292cd5045854 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:06.542108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 990/2018] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:06.543184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddcfbc-b183-4612-862f-292cd5045854 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:06.560885 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff34de-99bf-454f-9a15-721b1eb323d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c62a15c0924bf3a9e56876693d5f02, user_id=7842fcfeb0584b4eb926686ecf3fd000, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:06.564439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff34de-99bf-454f-9a15-721b1eb323d5 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:06.572573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:06.578648 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddcfbc-b183-4612-862f-292cd5045854 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:06.584405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0534c9-fb43-4bf0-8315-7fead99bf99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:06.585117 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0534c9-fb43-4bf0-8315-7fead99bf99e admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:06.586185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0534c9-fb43-4bf0-8315-7fead99bf99e admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:06.586538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0534c9-fb43-4bf0-8315-7fead99bf99e admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:06.587494 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0534c9-fb43-4bf0-8315-7fead99bf99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:06.589557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0534c9-fb43-4bf0-8315-7fead99bf99e admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:06.608332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 991/2019] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:06.609628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0534c9-fb43-4bf0-8315-7fead99bf99e admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:06.626608 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0534c9-fb43-4bf0-8315-7fead99bf99e admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:06.636298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538915ed-0355-4f42-8325-dae53365fbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:06.636298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538915ed-0355-4f42-8325-dae53365fbdc admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:06.636298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538915ed-0355-4f42-8325-dae53365fbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:06.636298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538915ed-0355-4f42-8325-dae53365fbdc admin admin] PATH_INFO: `/v3/projects/ba85b12261b34ab4a5ae59e2065ff993/users/fbdd4001b2ea4c6cbd6e012f497275cb/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:06.655761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538915ed-0355-4f42-8325-dae53365fbdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba85b12261b34ab4a5ae59e2065ff993, user_id=fbdd4001b2ea4c6cbd6e012f497275cb, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:06.669213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538915ed-0355-4f42-8325-dae53365fbdc admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:06.676900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1029/2020] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:06 2022] PUT /identity/v3/projects/e0c62a15c0924bf3a9e56876693d5f02/users/7842fcfeb0584b4eb926686ecf3fd000/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:06.689358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1576984-0e8c-464b-984d-ee84cca289c9 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:06.689892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1576984-0e8c-464b-984d-ee84cca289c9 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:06.691429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1576984-0e8c-464b-984d-ee84cca289c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:06.729711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-d1576984-0e8c-464b-984d-ee84cca289c9 None None] MFA Rules not processed for user `7842fcfeb0584b4eb926686ecf3fd000`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:06.731675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d1576984-0e8c-464b-984d-ee84cca289c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:06.781800 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 992/2021] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:06 2022] PUT /identity/v3/projects/ba85b12261b34ab4a5ae59e2065ff993/users/fbdd4001b2ea4c6cbd6e012f497275cb/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:06.786761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469cda5-db1d-4c89-816d-45d6b4656366 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:06.787205 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469cda5-db1d-4c89-816d-45d6b4656366 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:06.787548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469cda5-db1d-4c89-816d-45d6b4656366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:06.820797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-5469cda5-db1d-4c89-816d-45d6b4656366 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:06.822052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5469cda5-db1d-4c89-816d-45d6b4656366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:06.858445 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1030/2022] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:59:06.863006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1576984-0e8c-464b-984d-ee84cca289c9 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:06.912672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 993/2023] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:06.924626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469cda5-db1d-4c89-816d-45d6b4656366 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:06.926081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5469cda5-db1d-4c89-816d-45d6b4656366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:06.941253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:06.955979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1576984-0e8c-464b-984d-ee84cca289c9 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:06.967358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfd824-18c0-4288-8a6f-c5623f21b517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:06.968565 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfd824-18c0-4288-8a6f-c5623f21b517 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:06.968855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfd824-18c0-4288-8a6f-c5623f21b517 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:06.969141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfd824-18c0-4288-8a6f-c5623f21b517 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:06.969806 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfd824-18c0-4288-8a6f-c5623f21b517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:06.971933 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfd824-18c0-4288-8a6f-c5623f21b517 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:07.011514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469cda5-db1d-4c89-816d-45d6b4656366 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:07.016892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c01f43-4ff0-41c8-a5bc-746de487a859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:07.017699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c01f43-4ff0-41c8-a5bc-746de487a859 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:07.018413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c01f43-4ff0-41c8-a5bc-746de487a859 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:07.018797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c01f43-4ff0-41c8-a5bc-746de487a859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:07.030439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c01f43-4ff0-41c8-a5bc-746de487a859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:07.032337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c01f43-4ff0-41c8-a5bc-746de487a859 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:07.044755 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 994/2024] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:59:07.099399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1031/2025] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:06 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:59:07.104414 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c01f43-4ff0-41c8-a5bc-746de487a859 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:07.115306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c01f43-4ff0-41c8-a5bc-746de487a859 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:07.194792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:07.199181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07886f54-cb2c-4603-ae0a-d9a35b373873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:07.201676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07886f54-cb2c-4603-ae0a-d9a35b373873 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:07.201676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07886f54-cb2c-4603-ae0a-d9a35b373873 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:07.201676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07886f54-cb2c-4603-ae0a-d9a35b373873 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:07.202184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07886f54-cb2c-4603-ae0a-d9a35b373873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:07.205458 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07886f54-cb2c-4603-ae0a-d9a35b373873 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:07.314747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 995/2026] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:07 2022] POST /identity/v3/users => generated 299 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:07.320459 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfd824-18c0-4288-8a6f-c5623f21b517 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:07.331079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfd824-18c0-4288-8a6f-c5623f21b517 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:07.336611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97299858-67a5-440b-a95f-98dde791a81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:07.337229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299858-67a5-440b-a95f-98dde791a81b admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:07.337515 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299858-67a5-440b-a95f-98dde791a81b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:07.337788 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299858-67a5-440b-a95f-98dde791a81b admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:07.338442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97299858-67a5-440b-a95f-98dde791a81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:07.340044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97299858-67a5-440b-a95f-98dde791a81b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:07.350688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1032/2027] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:07.355402 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07886f54-cb2c-4603-ae0a-d9a35b373873 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:07.367530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07886f54-cb2c-4603-ae0a-d9a35b373873 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:07.372914 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93979e84-d047-4726-93e4-099e71cccb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:07.373762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93979e84-d047-4726-93e4-099e71cccb93 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:07.374054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93979e84-d047-4726-93e4-099e71cccb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:07.374325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93979e84-d047-4726-93e4-099e71cccb93 admin admin] PATH_INFO: `/v3/projects/f2b818235ba04d809349a5747b2c9af8/users/1436ab707dfa4c4db59afab168b61289/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:07.403962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93979e84-d047-4726-93e4-099e71cccb93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b818235ba04d809349a5747b2c9af8, user_id=1436ab707dfa4c4db59afab168b61289, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:07.407110 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93979e84-d047-4726-93e4-099e71cccb93 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:07.490484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 996/2028] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:07 2022] PUT /identity/v3/projects/f2b818235ba04d809349a5747b2c9af8/users/1436ab707dfa4c4db59afab168b61289/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:07.494740 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97299858-67a5-440b-a95f-98dde791a81b admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:07.510122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97299858-67a5-440b-a95f-98dde791a81b admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:07.605505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce44e7-47ed-4e65-9a3c-2708c3697d07 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:07.605792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce44e7-47ed-4e65-9a3c-2708c3697d07 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:07.606056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce44e7-47ed-4e65-9a3c-2708c3697d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:07.612099 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa59e18-abb7-4260-a2db-73b2908af3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:07.613782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa59e18-abb7-4260-a2db-73b2908af3df admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:07.614064 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa59e18-abb7-4260-a2db-73b2908af3df admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:07.614344 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa59e18-abb7-4260-a2db-73b2908af3df admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:07.615002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa59e18-abb7-4260-a2db-73b2908af3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:07.617650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa59e18-abb7-4260-a2db-73b2908af3df admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:07.629222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1033/2029] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:07.635521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa59e18-abb7-4260-a2db-73b2908af3df admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:07.645920 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-cdce44e7-47ed-4e65-9a3c-2708c3697d07 None None] MFA Rules not processed for user `39e089e6b2234e37bd6d140de7ef8d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:07.647728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-cdce44e7-47ed-4e65-9a3c-2708c3697d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:07.649403 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa59e18-abb7-4260-a2db-73b2908af3df admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:07.654765 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8bd9f-0b6a-4554-9d86-10168aee3df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:07.655498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8bd9f-0b6a-4554-9d86-10168aee3df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:07.655848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8bd9f-0b6a-4554-9d86-10168aee3df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:07.656138 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8bd9f-0b6a-4554-9d86-10168aee3df9 admin admin] PATH_INFO: `/v3/projects/f2b818235ba04d809349a5747b2c9af8/users/1436ab707dfa4c4db59afab168b61289/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:07.660822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8bd9f-0b6a-4554-9d86-10168aee3df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b818235ba04d809349a5747b2c9af8, user_id=1436ab707dfa4c4db59afab168b61289, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:07.661648 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8bd9f-0b6a-4554-9d86-10168aee3df9 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:07.683492 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1034/2030] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:07 2022] PUT /identity/v3/projects/f2b818235ba04d809349a5747b2c9af8/users/1436ab707dfa4c4db59afab168b61289/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:07.689011 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7571e-f625-4a5e-bdf4-90dc8baf32ac None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:07.689503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7571e-f625-4a5e-bdf4-90dc8baf32ac None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:07.689921 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7571e-f625-4a5e-bdf4-90dc8baf32ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:07.725161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-4cb7571e-f625-4a5e-bdf4-90dc8baf32ac None None] MFA Rules not processed for user `1436ab707dfa4c4db59afab168b61289`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:07.726929 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4cb7571e-f625-4a5e-bdf4-90dc8baf32ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:07.736278 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 997/2031] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:59:07.740882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce44e7-47ed-4e65-9a3c-2708c3697d07 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:07.753953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce44e7-47ed-4e65-9a3c-2708c3697d07 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:07.760947 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:07.823302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1035/2032] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:59:07.842376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7571e-f625-4a5e-bdf4-90dc8baf32ac None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:07.844084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4cb7571e-f625-4a5e-bdf4-90dc8baf32ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:07.863001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ba975-75bc-4423-abbe-7bc2b04f7bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:07.863790 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ba975-75bc-4423-abbe-7bc2b04f7bad admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:07.864172 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ba975-75bc-4423-abbe-7bc2b04f7bad admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:07.864580 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ba975-75bc-4423-abbe-7bc2b04f7bad admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:07.865491 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ba975-75bc-4423-abbe-7bc2b04f7bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:07.867782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ba975-75bc-4423-abbe-7bc2b04f7bad admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:07.925404 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7571e-f625-4a5e-bdf4-90dc8baf32ac None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:07.929749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07870b-c6c3-4036-9902-b4c91e36f295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:07.930443 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07870b-c6c3-4036-9902-b4c91e36f295 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:07.931041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07870b-c6c3-4036-9902-b4c91e36f295 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:07.931380 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07870b-c6c3-4036-9902-b4c91e36f295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:07.942004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07870b-c6c3-4036-9902-b4c91e36f295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:07.943608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07870b-c6c3-4036-9902-b4c91e36f295 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:07.956830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1036/2033] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:59:07.993097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07870b-c6c3-4036-9902-b4c91e36f295 service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:08.001442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 998/2034] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:07 2022] POST /identity/v3/projects => generated 371 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:08.002819 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07870b-c6c3-4036-9902-b4c91e36f295 service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:08.005266 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ba975-75bc-4423-abbe-7bc2b04f7bad admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:08.065678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a0c52-171a-45ca-ad53-67042a9b0129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:08.066410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a0c52-171a-45ca-ad53-67042a9b0129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:08.066792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a0c52-171a-45ca-ad53-67042a9b0129 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:08.067065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a0c52-171a-45ca-ad53-67042a9b0129 admin admin] PATH_INFO: `/v3/users/7842fcfeb0584b4eb926686ecf3fd000` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:08.068394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a0c52-171a-45ca-ad53-67042a9b0129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7842fcfeb0584b4eb926686ecf3fd000)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:08.069743 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ba975-75bc-4423-abbe-7bc2b04f7bad admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:08.070937 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a0c52-171a-45ca-ad53-67042a9b0129 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:08.076010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f5e03-028e-49df-a6c4-1cf55f043126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:08.076657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f5e03-028e-49df-a6c4-1cf55f043126 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:08.076940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f5e03-028e-49df-a6c4-1cf55f043126 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:08.077216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f5e03-028e-49df-a6c4-1cf55f043126 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:08.077852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f5e03-028e-49df-a6c4-1cf55f043126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:08.079772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f5e03-028e-49df-a6c4-1cf55f043126 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:08.102341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:08.188773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 999/2035] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:08 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:08.193259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f5e03-028e-49df-a6c4-1cf55f043126 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:08.203517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f5e03-028e-49df-a6c4-1cf55f043126 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:08.209584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b3f9b-3505-43a1-aab2-55adea0c8598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:08.216572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b3f9b-3505-43a1-aab2-55adea0c8598 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:08.216572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b3f9b-3505-43a1-aab2-55adea0c8598 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:08.216572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b3f9b-3505-43a1-aab2-55adea0c8598 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:08.216572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b3f9b-3505-43a1-aab2-55adea0c8598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:08.216572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b3f9b-3505-43a1-aab2-55adea0c8598 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:08.225783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1000/2036] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:08.232121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b3f9b-3505-43a1-aab2-55adea0c8598 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:08.242121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b3f9b-3505-43a1-aab2-55adea0c8598 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:08.247107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4a6d1-acb9-4ba6-a3d2-8ed38c0143de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:08.247762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4a6d1-acb9-4ba6-a3d2-8ed38c0143de admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:08.248041 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4a6d1-acb9-4ba6-a3d2-8ed38c0143de admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:08.248413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4a6d1-acb9-4ba6-a3d2-8ed38c0143de admin admin] PATH_INFO: `/v3/projects/a774a3efab544584ac348a3085f8e583/users/7b3a24e07f9843f383483e55cd47b7a1/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:08.263401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4a6d1-acb9-4ba6-a3d2-8ed38c0143de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a774a3efab544584ac348a3085f8e583, user_id=7b3a24e07f9843f383483e55cd47b7a1, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:08.266102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4a6d1-acb9-4ba6-a3d2-8ed38c0143de admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:08.307009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d65a0c52-171a-45ca-ad53-67042a9b0129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7842fcfeb0584b4eb926686ecf3fd000'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:08.318721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d65a0c52-171a-45ca-ad53-67042a9b0129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7842fcfeb0584b4eb926686ecf3fd000'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:08.344550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1001/2037] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:08 2022] PUT /identity/v3/projects/a774a3efab544584ac348a3085f8e583/users/7b3a24e07f9843f383483e55cd47b7a1/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:08.349066 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4a6d1-acb9-4ba6-a3d2-8ed38c0143de admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:08.431568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4a6d1-acb9-4ba6-a3d2-8ed38c0143de admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:08.437569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a794e-8f10-4b07-b4bb-3cc9cd8af833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:08.438325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a794e-8f10-4b07-b4bb-3cc9cd8af833 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:08.438663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a794e-8f10-4b07-b4bb-3cc9cd8af833 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:08.438943 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a794e-8f10-4b07-b4bb-3cc9cd8af833 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:08.439623 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a794e-8f10-4b07-b4bb-3cc9cd8af833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:08.442347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a794e-8f10-4b07-b4bb-3cc9cd8af833 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:08.453897 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1002/2038] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:08.457838 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d65a0c52-171a-45ca-ad53-67042a9b0129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7842fcfeb0584b4eb926686ecf3fd000'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:08.458169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a794e-8f10-4b07-b4bb-3cc9cd8af833 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:08.458536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d65a0c52-171a-45ca-ad53-67042a9b0129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7842fcfeb0584b4eb926686ecf3fd000'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:08.465205 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0b5a794e-8f10-4b07-b4bb-3cc9cd8af833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:08.478316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d65a0c52-171a-45ca-ad53-67042a9b0129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7842fcfeb0584b4eb926686ecf3fd000'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:08.479415 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a794e-8f10-4b07-b4bb-3cc9cd8af833 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:08.488850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc66c3-4a8d-4ef3-8ae9-0de06ff48322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:08.488850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc66c3-4a8d-4ef3-8ae9-0de06ff48322 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:08.488850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc66c3-4a8d-4ef3-8ae9-0de06ff48322 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:08.488850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc66c3-4a8d-4ef3-8ae9-0de06ff48322 admin admin] PATH_INFO: `/v3/projects/a774a3efab544584ac348a3085f8e583/users/7b3a24e07f9843f383483e55cd47b7a1/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:08.489966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1037/2039] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:07 2022] DELETE /identity/v3/users/7842fcfeb0584b4eb926686ecf3fd000 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:08.490086 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc66c3-4a8d-4ef3-8ae9-0de06ff48322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a774a3efab544584ac348a3085f8e583, user_id=7b3a24e07f9843f383483e55cd47b7a1, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:08.492268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6fd49-2203-49d4-b250-5dc556c0b198 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:08.492770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6fd49-2203-49d4-b250-5dc556c0b198 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:08.493202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6fd49-2203-49d4-b250-5dc556c0b198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:08.494663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc66c3-4a8d-4ef3-8ae9-0de06ff48322 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:08.506332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1003/2040] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:08 2022] PUT /identity/v3/projects/a774a3efab544584ac348a3085f8e583/users/7b3a24e07f9843f383483e55cd47b7a1/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:08.516450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-97b6fd49-2203-49d4-b250-5dc556c0b198 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:08.518447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-97b6fd49-2203-49d4-b250-5dc556c0b198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:08.555165 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:08.622431 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1038/2041] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:08.642739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc66c3-4a8d-4ef3-8ae9-0de06ff48322 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:08.644777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e9bc66c3-4a8d-4ef3-8ae9-0de06ff48322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:08.715834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc66c3-4a8d-4ef3-8ae9-0de06ff48322 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:08.720179 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc798b-5121-44fc-b0af-e359533f6c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:08.720918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc798b-5121-44fc-b0af-e359533f6c6c service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:08.721299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc798b-5121-44fc-b0af-e359533f6c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:08.721668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc798b-5121-44fc-b0af-e359533f6c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:08.737614 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc798b-5121-44fc-b0af-e359533f6c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:08.739267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc798b-5121-44fc-b0af-e359533f6c6c service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:08.751215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1004/2042] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:08.856966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:09.373065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6fd49-2203-49d4-b250-5dc556c0b198 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:09.380431 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-97b6fd49-2203-49d4-b250-5dc556c0b198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:09.412750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6fd49-2203-49d4-b250-5dc556c0b198 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:09.427483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7746196-ce05-4d20-b623-5e5437d1392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:09.428124 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7746196-ce05-4d20-b623-5e5437d1392a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:09.428430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7746196-ce05-4d20-b623-5e5437d1392a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:09.428703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7746196-ce05-4d20-b623-5e5437d1392a admin admin] PATH_INFO: `/v3/projects/e0c62a15c0924bf3a9e56876693d5f02` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:09.436349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7746196-ce05-4d20-b623-5e5437d1392a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c62a15c0924bf3a9e56876693d5f02)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:09.438298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7746196-ce05-4d20-b623-5e5437d1392a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:09.621046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-e7746196-ce05-4d20-b623-5e5437d1392a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c62a15c0924bf3a9e56876693d5f02', 'request_id': 'req-e7746196-ce05-4d20-b623-5e5437d1392a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:09.639786 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-e7746196-ce05-4d20-b623-5e5437d1392a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c62a15c0924bf3a9e56876693d5f02', 'request_id': 'req-e7746196-ce05-4d20-b623-5e5437d1392a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:09.651781 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-e7746196-ce05-4d20-b623-5e5437d1392a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c62a15c0924bf3a9e56876693d5f02', 'request_id': 'req-e7746196-ce05-4d20-b623-5e5437d1392a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:09.763039 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-e7746196-ce05-4d20-b623-5e5437d1392a admin admin] The token cache is being invalidate because project e0c62a15c0924bf3a9e56876693d5f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:09.763320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-e7746196-ce05-4d20-b623-5e5437d1392a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:09.764063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-e7746196-ce05-4d20-b623-5e5437d1392a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:09.765923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1039/2043] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:09 2022] DELETE /identity/v3/projects/e0c62a15c0924bf3a9e56876693d5f02 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:09.769832 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc798b-5121-44fc-b0af-e359533f6c6c service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:09.781103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc798b-5121-44fc-b0af-e359533f6c6c service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:09.855368 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d20db-36e5-4dcf-b7c2-bae841be0ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:09.856674 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d20db-36e5-4dcf-b7c2-bae841be0ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:09.856966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d20db-36e5-4dcf-b7c2-bae841be0ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:09.857243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d20db-36e5-4dcf-b7c2-bae841be0ca9 admin admin] PATH_INFO: `/v3/users/1436ab707dfa4c4db59afab168b61289` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:09.859257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d20db-36e5-4dcf-b7c2-bae841be0ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1436ab707dfa4c4db59afab168b61289)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:09.862894 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d20db-36e5-4dcf-b7c2-bae841be0ca9 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:10.105537 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6e7d20db-36e5-4dcf-b7c2-bae841be0ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1436ab707dfa4c4db59afab168b61289'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:10.106379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6e7d20db-36e5-4dcf-b7c2-bae841be0ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1436ab707dfa4c4db59afab168b61289'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:10.107062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6e7d20db-36e5-4dcf-b7c2-bae841be0ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1436ab707dfa4c4db59afab168b61289'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:10.123045 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6e7d20db-36e5-4dcf-b7c2-bae841be0ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1436ab707dfa4c4db59afab168b61289'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:10.131216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6e7d20db-36e5-4dcf-b7c2-bae841be0ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1436ab707dfa4c4db59afab168b61289'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:10.133538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:10.241478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1005/2044] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:09 2022] DELETE /identity/v3/users/1436ab707dfa4c4db59afab168b61289 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:10.247923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cfe66-c8d5-44f4-b1e5-6b66ed0574c3 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:10.248497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cfe66-c8d5-44f4-b1e5-6b66ed0574c3 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:10.248817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cfe66-c8d5-44f4-b1e5-6b66ed0574c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:10.294487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-3b0cfe66-c8d5-44f4-b1e5-6b66ed0574c3 None None] MFA Rules not processed for user `7b3a24e07f9843f383483e55cd47b7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:10.296283 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-3b0cfe66-c8d5-44f4-b1e5-6b66ed0574c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:10.429334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1040/2045] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:10.441758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b84bd-1489-42f6-b3a8-dfe1d2526647 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:10.441758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b84bd-1489-42f6-b3a8-dfe1d2526647 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:10.441758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b84bd-1489-42f6-b3a8-dfe1d2526647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:10.474622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-531b84bd-1489-42f6-b3a8-dfe1d2526647 None None] MFA Rules not processed for user `39e089e6b2234e37bd6d140de7ef8d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:10.476216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-531b84bd-1489-42f6-b3a8-dfe1d2526647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:10.549345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1006/2046] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:10.566251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cfe66-c8d5-44f4-b1e5-6b66ed0574c3 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:10.567796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-3b0cfe66-c8d5-44f4-b1e5-6b66ed0574c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:10.576543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:10.695038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cfe66-c8d5-44f4-b1e5-6b66ed0574c3 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:10.709136 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950b58c-e170-493f-98aa-f02bb5cfa940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:10.709851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950b58c-e170-493f-98aa-f02bb5cfa940 service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:10.710140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950b58c-e170-493f-98aa-f02bb5cfa940 service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:10.711225 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950b58c-e170-493f-98aa-f02bb5cfa940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:10.713542 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-3950b58c-e170-493f-98aa-f02bb5cfa940 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:10.732269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950b58c-e170-493f-98aa-f02bb5cfa940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:10.734014 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950b58c-e170-493f-98aa-f02bb5cfa940 service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:10.747666 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1041/2047] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:10.858909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b84bd-1489-42f6-b3a8-dfe1d2526647 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:10.861505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-531b84bd-1489-42f6-b3a8-dfe1d2526647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:10.954227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b84bd-1489-42f6-b3a8-dfe1d2526647 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:10.964776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa725e93-779a-41e6-af5e-e383a099a29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:10.965548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa725e93-779a-41e6-af5e-e383a099a29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:10.965919 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa725e93-779a-41e6-af5e-e383a099a29b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:10.967808 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa725e93-779a-41e6-af5e-e383a099a29b admin admin] PATH_INFO: `/v3/projects/f2b818235ba04d809349a5747b2c9af8` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:10.967808 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa725e93-779a-41e6-af5e-e383a099a29b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b818235ba04d809349a5747b2c9af8)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:10.971203 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa725e93-779a-41e6-af5e-e383a099a29b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:10.996902 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950b58c-e170-493f-98aa-f02bb5cfa940 service nova] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:11.000107 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-3950b58c-e170-493f-98aa-f02bb5cfa940 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:11.025446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950b58c-e170-493f-98aa-f02bb5cfa940 service nova] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:11.033261 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5355bc-871a-4e0b-b102-7f2e63969971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:11.034749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5355bc-871a-4e0b-b102-7f2e63969971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:11.040334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5355bc-871a-4e0b-b102-7f2e63969971 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:11.042276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5355bc-871a-4e0b-b102-7f2e63969971 admin admin] PATH_INFO: `/v3/users/b7d27670b58940d588b85bef13e609c3` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:11.043382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5355bc-871a-4e0b-b102-7f2e63969971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d27670b58940d588b85bef13e609c3)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:11.045783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5355bc-871a-4e0b-b102-7f2e63969971 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:11.113556 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fa725e93-779a-41e6-af5e-e383a099a29b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b818235ba04d809349a5747b2c9af8', 'request_id': 'req-fa725e93-779a-41e6-af5e-e383a099a29b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:11.239203 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fa725e93-779a-41e6-af5e-e383a099a29b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b818235ba04d809349a5747b2c9af8', 'request_id': 'req-fa725e93-779a-41e6-af5e-e383a099a29b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:11.248768 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fa725e93-779a-41e6-af5e-e383a099a29b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b818235ba04d809349a5747b2c9af8', 'request_id': 'req-fa725e93-779a-41e6-af5e-e383a099a29b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:11.268362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fa725e93-779a-41e6-af5e-e383a099a29b admin admin] The token cache is being invalidate because project f2b818235ba04d809349a5747b2c9af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:11.269859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fa725e93-779a-41e6-af5e-e383a099a29b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:11.269859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fa725e93-779a-41e6-af5e-e383a099a29b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:11.271505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1007/2048] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:10 2022] DELETE /identity/v3/projects/f2b818235ba04d809349a5747b2c9af8 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:11.276523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e844b-1bbf-45ca-bb28-85d22fdd0323 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:11.277039 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e844b-1bbf-45ca-bb28-85d22fdd0323 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:11.277496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e844b-1bbf-45ca-bb28-85d22fdd0323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:11.312677 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-493e844b-1bbf-45ca-bb28-85d22fdd0323 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:11.315226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-493e844b-1bbf-45ca-bb28-85d22fdd0323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:11.335623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-ed5355bc-871a-4e0b-b102-7f2e63969971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d27670b58940d588b85bef13e609c3'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:11.353471 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-ed5355bc-871a-4e0b-b102-7f2e63969971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d27670b58940d588b85bef13e609c3'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:11.370467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:11.401187 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1008/2049] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:59:11.410174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801cbf3-4eb5-4025-b616-26bdfc6e677d None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:11.411047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801cbf3-4eb5-4025-b616-26bdfc6e677d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:11.411409 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801cbf3-4eb5-4025-b616-26bdfc6e677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:11.412616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-ed5355bc-871a-4e0b-b102-7f2e63969971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d27670b58940d588b85bef13e609c3'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:11.415999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-ed5355bc-871a-4e0b-b102-7f2e63969971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d27670b58940d588b85bef13e609c3'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:11.444423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-ed5355bc-871a-4e0b-b102-7f2e63969971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d27670b58940d588b85bef13e609c3'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:11.453143 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-8801cbf3-4eb5-4025-b616-26bdfc6e677d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:11.459588 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8801cbf3-4eb5-4025-b616-26bdfc6e677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:11.459722 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1042/2050] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:10 2022] DELETE /identity/v3/users/b7d27670b58940d588b85bef13e609c3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:11.461592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3539e4d-10c2-47a9-a09d-f0f6b3ea32f7 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:11.462767 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3539e4d-10c2-47a9-a09d-f0f6b3ea32f7 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:11.463824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3539e4d-10c2-47a9-a09d-f0f6b3ea32f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:11.527455 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1009/2051] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:11.531679 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801cbf3-4eb5-4025-b616-26bdfc6e677d None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:11.538724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f3539e4d-10c2-47a9-a09d-f0f6b3ea32f7 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:11.540816 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f3539e4d-10c2-47a9-a09d-f0f6b3ea32f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:11.541660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801cbf3-4eb5-4025-b616-26bdfc6e677d None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:11.547684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df1354-f927-4261-80b7-5fc102b11cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:11.548378 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df1354-f927-4261-80b7-5fc102b11cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:11.548663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df1354-f927-4261-80b7-5fc102b11cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:11.548945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df1354-f927-4261-80b7-5fc102b11cd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:11.549613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df1354-f927-4261-80b7-5fc102b11cd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:59:11.552844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df1354-f927-4261-80b7-5fc102b11cd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:11.553107 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1043/2052] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:59:11.553202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df1354-f927-4261-80b7-5fc102b11cd7 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:11.565325 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3539e4d-10c2-47a9-a09d-f0f6b3ea32f7 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:11.576908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1010/2053] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:59:11.577865 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df1354-f927-4261-80b7-5fc102b11cd7 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:11.587428 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f3539e4d-10c2-47a9-a09d-f0f6b3ea32f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:11.589695 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df1354-f927-4261-80b7-5fc102b11cd7 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:11.595027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afa47b-e27b-4aeb-bfbe-47328541cb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:11.595652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afa47b-e27b-4aeb-bfbe-47328541cb31 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:11.595936 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afa47b-e27b-4aeb-bfbe-47328541cb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:11.596247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afa47b-e27b-4aeb-bfbe-47328541cb31 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:11.596896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afa47b-e27b-4aeb-bfbe-47328541cb31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:11.598890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afa47b-e27b-4aeb-bfbe-47328541cb31 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:11.729564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3539e4d-10c2-47a9-a09d-f0f6b3ea32f7 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:11.733853 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac66f80-5740-40e7-8911-e2a352d86d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:11.736381 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac66f80-5740-40e7-8911-e2a352d86d70 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:11.736381 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac66f80-5740-40e7-8911-e2a352d86d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:11.736381 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac66f80-5740-40e7-8911-e2a352d86d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:11.753424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac66f80-5740-40e7-8911-e2a352d86d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:11.755199 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac66f80-5740-40e7-8911-e2a352d86d70 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:11.767120 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1011/2054] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:11 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:11.769224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afa47b-e27b-4aeb-bfbe-47328541cb31 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:11.779351 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1044/2055] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:11.782615 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:11.920205 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afa47b-e27b-4aeb-bfbe-47328541cb31 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:11.932888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62378a63-0e3e-4229-9d65-076186d773b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:11.934564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378a63-0e3e-4229-9d65-076186d773b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:11.934921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378a63-0e3e-4229-9d65-076186d773b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:11.936365 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378a63-0e3e-4229-9d65-076186d773b3 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:11.937121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62378a63-0e3e-4229-9d65-076186d773b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:11.942619 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62378a63-0e3e-4229-9d65-076186d773b3 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:12.059936 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1012/2056] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:11 2022] POST /identity/v3/users => generated 290 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:12.063958 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac66f80-5740-40e7-8911-e2a352d86d70 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:12.075105 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac66f80-5740-40e7-8911-e2a352d86d70 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:12.088919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260289da-23c7-43bb-9c4c-5031794fd2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:12.089917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260289da-23c7-43bb-9c4c-5031794fd2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:12.091555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260289da-23c7-43bb-9c4c-5031794fd2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:12.092713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260289da-23c7-43bb-9c4c-5031794fd2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:12.096853 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260289da-23c7-43bb-9c4c-5031794fd2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:12.099648 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260289da-23c7-43bb-9c4c-5031794fd2f6 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:12.115925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62378a63-0e3e-4229-9d65-076186d773b3 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:12.116381 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1045/2057] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:12.127479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62378a63-0e3e-4229-9d65-076186d773b3 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:12.135069 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a738f-15a4-4943-9248-d234a10734f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:12.135904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a738f-15a4-4943-9248-d234a10734f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:12.136425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a738f-15a4-4943-9248-d234a10734f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:12.136988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a738f-15a4-4943-9248-d234a10734f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:12.137676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a738f-15a4-4943-9248-d234a10734f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:12.139482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a738f-15a4-4943-9248-d234a10734f7 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:12.157980 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260289da-23c7-43bb-9c4c-5031794fd2f6 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:12.166981 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1013/2058] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:12.178373 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260289da-23c7-43bb-9c4c-5031794fd2f6 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:12.184316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145d99e-4eca-49c2-b470-86cb881dee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:12.186276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145d99e-4eca-49c2-b470-86cb881dee31 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:12.186276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145d99e-4eca-49c2-b470-86cb881dee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:12.186276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145d99e-4eca-49c2-b470-86cb881dee31 admin admin] PATH_INFO: `/v3/projects/19b0eedc2c7c45f6a10a85a4295f7ca6/users/4e7ca425cf0d47b89c881f6ef599a347/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:12.206265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145d99e-4eca-49c2-b470-86cb881dee31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b0eedc2c7c45f6a10a85a4295f7ca6, user_id=4e7ca425cf0d47b89c881f6ef599a347, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:12.212597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145d99e-4eca-49c2-b470-86cb881dee31 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:12.306504 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1046/2059] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:12 2022] PUT /identity/v3/projects/19b0eedc2c7c45f6a10a85a4295f7ca6/users/4e7ca425cf0d47b89c881f6ef599a347/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:12.318587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8eb92-7f99-4ddf-a8df-d6e0ebf46934 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:12.319430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8eb92-7f99-4ddf-a8df-d6e0ebf46934 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:12.319430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8eb92-7f99-4ddf-a8df-d6e0ebf46934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:12.393830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-64a8eb92-7f99-4ddf-a8df-d6e0ebf46934 None None] MFA Rules not processed for user `4e7ca425cf0d47b89c881f6ef599a347`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:12.396829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-64a8eb92-7f99-4ddf-a8df-d6e0ebf46934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:12.490837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1014/2060] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:12.497189 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145d99e-4eca-49c2-b470-86cb881dee31 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:12.579873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145d99e-4eca-49c2-b470-86cb881dee31 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:12.590400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f3f67-379a-4f27-ba48-96191225c252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:12.590400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f3f67-379a-4f27-ba48-96191225c252 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:12.590400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f3f67-379a-4f27-ba48-96191225c252 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:12.590400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f3f67-379a-4f27-ba48-96191225c252 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:12.590792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f3f67-379a-4f27-ba48-96191225c252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:12.592672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f3f67-379a-4f27-ba48-96191225c252 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:12.640773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8eb92-7f99-4ddf-a8df-d6e0ebf46934 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:12.642623 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-64a8eb92-7f99-4ddf-a8df-d6e0ebf46934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:12.659177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8eb92-7f99-4ddf-a8df-d6e0ebf46934 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:12.666614 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851b3f1-e21a-43c8-882a-c55068326215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:12.667240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851b3f1-e21a-43c8-882a-c55068326215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:12.667879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851b3f1-e21a-43c8-882a-c55068326215 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:12.667879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851b3f1-e21a-43c8-882a-c55068326215 admin admin] PATH_INFO: `/v3/projects/0f2e3dbf86264e8d832605c0b7329b05` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:12.679848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851b3f1-e21a-43c8-882a-c55068326215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f2e3dbf86264e8d832605c0b7329b05)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:12.684219 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851b3f1-e21a-43c8-882a-c55068326215 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:12.751499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1047/2061] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:12 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:12.756634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f3f67-379a-4f27-ba48-96191225c252 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:12.860943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f3f67-379a-4f27-ba48-96191225c252 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:12.868924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f851b3f1-e21a-43c8-882a-c55068326215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2e3dbf86264e8d832605c0b7329b05', 'request_id': 'req-f851b3f1-e21a-43c8-882a-c55068326215'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:12.927538 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc70ec-a7ea-44bb-bdc7-e407dbdd1cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:12.929746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc70ec-a7ea-44bb-bdc7-e407dbdd1cff admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:12.929746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc70ec-a7ea-44bb-bdc7-e407dbdd1cff admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:12.929746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc70ec-a7ea-44bb-bdc7-e407dbdd1cff admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:12.929746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc70ec-a7ea-44bb-bdc7-e407dbdd1cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:12.932700 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc70ec-a7ea-44bb-bdc7-e407dbdd1cff admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:12.982702 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f851b3f1-e21a-43c8-882a-c55068326215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2e3dbf86264e8d832605c0b7329b05', 'request_id': 'req-f851b3f1-e21a-43c8-882a-c55068326215'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:12.989859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f851b3f1-e21a-43c8-882a-c55068326215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2e3dbf86264e8d832605c0b7329b05', 'request_id': 'req-f851b3f1-e21a-43c8-882a-c55068326215'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:13.015112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f851b3f1-e21a-43c8-882a-c55068326215 admin admin] The token cache is being invalidate because project 0f2e3dbf86264e8d832605c0b7329b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:13.015868 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f851b3f1-e21a-43c8-882a-c55068326215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:13.028149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f851b3f1-e21a-43c8-882a-c55068326215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:13.028149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1015/2062] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:12 2022] DELETE /identity/v3/projects/0f2e3dbf86264e8d832605c0b7329b05 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:13.033859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851b3f1-e21a-43c8-882a-c55068326215 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:13.045182 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f851b3f1-e21a-43c8-882a-c55068326215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:13.071742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1048/2063] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:12 2022] POST /identity/v3/users => generated 295 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:13.075372 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851b3f1-e21a-43c8-882a-c55068326215 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:13.077176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc70ec-a7ea-44bb-bdc7-e407dbdd1cff admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:13.079881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-dafc70ec-a7ea-44bb-bdc7-e407dbdd1cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:13.086525 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806ed43-aeef-41ad-9f81-1d6b27158616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:13.087202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806ed43-aeef-41ad-9f81-1d6b27158616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:13.087495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806ed43-aeef-41ad-9f81-1d6b27158616 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:13.087966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806ed43-aeef-41ad-9f81-1d6b27158616 admin admin] PATH_INFO: `/v3/users/c1367dc00de94fc1949de5ddd707bcd7` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:13.090119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806ed43-aeef-41ad-9f81-1d6b27158616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1367dc00de94fc1949de5ddd707bcd7)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:13.092981 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806ed43-aeef-41ad-9f81-1d6b27158616 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:13.114655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc70ec-a7ea-44bb-bdc7-e407dbdd1cff admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:13.123975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8dc84-06cf-4f59-a402-7b579b9f52ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:13.126365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8dc84-06cf-4f59-a402-7b579b9f52ff admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:13.129992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8dc84-06cf-4f59-a402-7b579b9f52ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:13.134562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8dc84-06cf-4f59-a402-7b579b9f52ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:13.137233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8dc84-06cf-4f59-a402-7b579b9f52ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:13.143081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8dc84-06cf-4f59-a402-7b579b9f52ff admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:13.148830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:13.162595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1049/2064] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:59:13.167412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8dc84-06cf-4f59-a402-7b579b9f52ff admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:13.182073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8dc84-06cf-4f59-a402-7b579b9f52ff admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:13.192766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d647fd-9801-4ec6-9c3d-e2d9478802eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:13.193645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d647fd-9801-4ec6-9c3d-e2d9478802eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:13.194038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d647fd-9801-4ec6-9c3d-e2d9478802eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:13.194499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d647fd-9801-4ec6-9c3d-e2d9478802eb admin admin] PATH_INFO: `/v3/projects/d54a2be077054f0e8fed27027d956f4a/users/008629d28120430a9641a7a760d92865/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:13.218981 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d647fd-9801-4ec6-9c3d-e2d9478802eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54a2be077054f0e8fed27027d956f4a, user_id=008629d28120430a9641a7a760d92865, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:13.222563 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d647fd-9801-4ec6-9c3d-e2d9478802eb admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:13.328139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1050/2065] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:13 2022] PUT /identity/v3/projects/d54a2be077054f0e8fed27027d956f4a/users/008629d28120430a9641a7a760d92865/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:13.331981 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d647fd-9801-4ec6-9c3d-e2d9478802eb admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:13.354261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-4806ed43-aeef-41ad-9f81-1d6b27158616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1367dc00de94fc1949de5ddd707bcd7'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:13.357339 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-4806ed43-aeef-41ad-9f81-1d6b27158616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1367dc00de94fc1949de5ddd707bcd7'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:13.358016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-4806ed43-aeef-41ad-9f81-1d6b27158616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1367dc00de94fc1949de5ddd707bcd7'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:13.391322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-4806ed43-aeef-41ad-9f81-1d6b27158616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1367dc00de94fc1949de5ddd707bcd7'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:13.401056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-4806ed43-aeef-41ad-9f81-1d6b27158616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1367dc00de94fc1949de5ddd707bcd7'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:13.481377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1016/2066] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:13 2022] DELETE /identity/v3/users/c1367dc00de94fc1949de5ddd707bcd7 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:13.490377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:13.495256 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d647fd-9801-4ec6-9c3d-e2d9478802eb admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:13.618018 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dceaa-bcd1-4b8f-bbe6-735463f4b0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:13.618684 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dceaa-bcd1-4b8f-bbe6-735463f4b0ed admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:13.618894 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dceaa-bcd1-4b8f-bbe6-735463f4b0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:13.619240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dceaa-bcd1-4b8f-bbe6-735463f4b0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:13.619924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dceaa-bcd1-4b8f-bbe6-735463f4b0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:13.622430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dceaa-bcd1-4b8f-bbe6-735463f4b0ed admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:13.635276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1051/2067] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:13.639664 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806ed43-aeef-41ad-9f81-1d6b27158616 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:13.641399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4806ed43-aeef-41ad-9f81-1d6b27158616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:13.656043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806ed43-aeef-41ad-9f81-1d6b27158616 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:13.661309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c200-37ed-4112-b7df-b23ffcad3f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:13.662111 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c200-37ed-4112-b7df-b23ffcad3f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:13.662584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c200-37ed-4112-b7df-b23ffcad3f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:13.662934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c200-37ed-4112-b7df-b23ffcad3f90 admin admin] PATH_INFO: `/v3/projects/d54a2be077054f0e8fed27027d956f4a/users/008629d28120430a9641a7a760d92865/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:13.665411 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15c200-37ed-4112-b7df-b23ffcad3f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54a2be077054f0e8fed27027d956f4a, user_id=008629d28120430a9641a7a760d92865, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:13.668129 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15c200-37ed-4112-b7df-b23ffcad3f90 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:13.683541 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1017/2068] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:13 2022] PUT /identity/v3/projects/d54a2be077054f0e8fed27027d956f4a/users/008629d28120430a9641a7a760d92865/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:13.693983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439066b-32d9-41b0-b294-ce6520b54d01 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:13.694298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439066b-32d9-41b0-b294-ce6520b54d01 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:13.694708 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439066b-32d9-41b0-b294-ce6520b54d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:13.726918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-a439066b-32d9-41b0-b294-ce6520b54d01 None None] MFA Rules not processed for user `008629d28120430a9641a7a760d92865`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:13.728155 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a439066b-32d9-41b0-b294-ce6520b54d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:13.870360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1052/2069] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:13.886726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c200-37ed-4112-b7df-b23ffcad3f90 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:13.921517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0e15c200-37ed-4112-b7df-b23ffcad3f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:14.013947 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c200-37ed-4112-b7df-b23ffcad3f90 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:14.020114 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfbe902-321b-4bed-b6f8-eae3460174ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:14.021129 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbe902-321b-4bed-b6f8-eae3460174ce service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:14.021625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbe902-321b-4bed-b6f8-eae3460174ce service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:14.022157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbe902-321b-4bed-b6f8-eae3460174ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:14.025282 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0bfbe902-321b-4bed-b6f8-eae3460174ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:14.113899 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:14.123430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439066b-32d9-41b0-b294-ce6520b54d01 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:14.123430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a439066b-32d9-41b0-b294-ce6520b54d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:14.152890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfbe902-321b-4bed-b6f8-eae3460174ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:14.157814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfbe902-321b-4bed-b6f8-eae3460174ce service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:14.185623 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1018/2070] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:14.309630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439066b-32d9-41b0-b294-ce6520b54d01 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:14.316728 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:14.317757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:14.318105 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:14.318508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b admin admin] PATH_INFO: `/v3/projects/8bb325f49bdf4a0fa4c0fecfb475b2be` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:14.320620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb325f49bdf4a0fa4c0fecfb475b2be)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:14.323418 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:14.413891 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:14.462463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fdb15-7c29-4813-a13b-31719f7b8649 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:14.463034 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fdb15-7c29-4813-a13b-31719f7b8649 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:14.463496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fdb15-7c29-4813-a13b-31719f7b8649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:14.506693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-3f2fdb15-7c29-4813-a13b-31719f7b8649 None None] MFA Rules not processed for user `fbdd4001b2ea4c6cbd6e012f497275cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:14.510063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-3f2fdb15-7c29-4813-a13b-31719f7b8649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:14.524653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb325f49bdf4a0fa4c0fecfb475b2be', 'request_id': 'req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:14.536040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb325f49bdf4a0fa4c0fecfb475b2be', 'request_id': 'req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:14.552922 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb325f49bdf4a0fa4c0fecfb475b2be', 'request_id': 'req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:14.622977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1019/2071] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:14.623182 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b admin admin] The token cache is being invalidate because project 8bb325f49bdf4a0fa4c0fecfb475b2be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:14.630677 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:14.630677 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:14.630677 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1053/2072] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:14 2022] DELETE /identity/v3/projects/8bb325f49bdf4a0fa4c0fecfb475b2be => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:14.634745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49f5b0-bc18-4de9-b662-1e7ebcabc5c3 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:14.635239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49f5b0-bc18-4de9-b662-1e7ebcabc5c3 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:14.635664 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49f5b0-bc18-4de9-b662-1e7ebcabc5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:14.642610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:14.644491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:14.665953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-3a49f5b0-bc18-4de9-b662-1e7ebcabc5c3 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:14.667486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-3a49f5b0-bc18-4de9-b662-1e7ebcabc5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:14.742875 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67cfb2-681f-452c-9c9c-a80cacd2bb1b admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:14.748937 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bb3c0-3f5a-41ea-a582-0f5d9cb747cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:14.749435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bb3c0-3f5a-41ea-a582-0f5d9cb747cf service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:14.749716 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bb3c0-3f5a-41ea-a582-0f5d9cb747cf service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:14.749986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bb3c0-3f5a-41ea-a582-0f5d9cb747cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:14.752176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c29bb3c0-3f5a-41ea-a582-0f5d9cb747cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:14.764487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bb3c0-3f5a-41ea-a582-0f5d9cb747cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:14.766138 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bb3c0-3f5a-41ea-a582-0f5d9cb747cf service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:14.767270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1020/2073] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:14.776786 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a4b8d-6dbc-44f7-8dc6-a166ac213105 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:14.777078 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a4b8d-6dbc-44f7-8dc6-a166ac213105 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:14.777499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a4b8d-6dbc-44f7-8dc6-a166ac213105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:14.777623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1054/2074] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:59:14.799378 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-547a4b8d-6dbc-44f7-8dc6-a166ac213105 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:14.800683 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-547a4b8d-6dbc-44f7-8dc6-a166ac213105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:14.809891 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1021/2075] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:14.814428 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bb3c0-3f5a-41ea-a582-0f5d9cb747cf service nova] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:14.831437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bb3c0-3f5a-41ea-a582-0f5d9cb747cf service nova] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:14.844757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d36fa9-e78a-44e5-9487-cb06b09dab08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:14.845687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d36fa9-e78a-44e5-9487-cb06b09dab08 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:14.846301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d36fa9-e78a-44e5-9487-cb06b09dab08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:14.846778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d36fa9-e78a-44e5-9487-cb06b09dab08 admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:14.847659 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d36fa9-e78a-44e5-9487-cb06b09dab08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:59:14.848123 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d36fa9-e78a-44e5-9487-cb06b09dab08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:14.853976 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d36fa9-e78a-44e5-9487-cb06b09dab08 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:14.868304 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1055/2076] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:59:14.872698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a4b8d-6dbc-44f7-8dc6-a166ac213105 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:14.883690 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a4b8d-6dbc-44f7-8dc6-a166ac213105 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:14.888626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146d6fa-92ba-43ff-9971-54d3d76aff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:14.889240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146d6fa-92ba-43ff-9971-54d3d76aff3f admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:14.889518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146d6fa-92ba-43ff-9971-54d3d76aff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:14.889788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146d6fa-92ba-43ff-9971-54d3d76aff3f admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:14.890425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146d6fa-92ba-43ff-9971-54d3d76aff3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:14.892388 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146d6fa-92ba-43ff-9971-54d3d76aff3f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:15.029797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1022/2077] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:14 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:59:15.034241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d36fa9-e78a-44e5-9487-cb06b09dab08 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:15.044455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d36fa9-e78a-44e5-9487-cb06b09dab08 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:15.123567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc6292-e0ac-4d27-b39c-6196325e4fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:15.124308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc6292-e0ac-4d27-b39c-6196325e4fff admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:15.128644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc6292-e0ac-4d27-b39c-6196325e4fff admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:15.128644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc6292-e0ac-4d27-b39c-6196325e4fff admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:15.128644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc6292-e0ac-4d27-b39c-6196325e4fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:15.128644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc6292-e0ac-4d27-b39c-6196325e4fff admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:15.245944 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1056/2078] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:15 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:59:15.250204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146d6fa-92ba-43ff-9971-54d3d76aff3f admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:15.261713 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146d6fa-92ba-43ff-9971-54d3d76aff3f admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:15.267390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287c0b8-9585-4ef5-a3b5-c4967d18dd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:15.269218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287c0b8-9585-4ef5-a3b5-c4967d18dd6a admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:15.270014 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287c0b8-9585-4ef5-a3b5-c4967d18dd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:15.270443 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287c0b8-9585-4ef5-a3b5-c4967d18dd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:15.271297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287c0b8-9585-4ef5-a3b5-c4967d18dd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:15.273825 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287c0b8-9585-4ef5-a3b5-c4967d18dd6a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:15.291628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1023/2079] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:15.295598 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc6292-e0ac-4d27-b39c-6196325e4fff admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:15.309706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc6292-e0ac-4d27-b39c-6196325e4fff admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:15.319929 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e5d78-6836-4be7-bf23-18299f52bcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:15.320589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e5d78-6836-4be7-bf23-18299f52bcaa admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:15.320995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e5d78-6836-4be7-bf23-18299f52bcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:15.321774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e5d78-6836-4be7-bf23-18299f52bcaa admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:15.327726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e5d78-6836-4be7-bf23-18299f52bcaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:15.327726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e5d78-6836-4be7-bf23-18299f52bcaa admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:15.358241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1057/2080] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:15.362836 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287c0b8-9585-4ef5-a3b5-c4967d18dd6a admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:15.377992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287c0b8-9585-4ef5-a3b5-c4967d18dd6a admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:15.383259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d89420-f1e0-4aee-8779-1a7e421b919c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:15.383887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89420-f1e0-4aee-8779-1a7e421b919c admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:15.385342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89420-f1e0-4aee-8779-1a7e421b919c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:15.385342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89420-f1e0-4aee-8779-1a7e421b919c admin admin] PATH_INFO: `/v3/projects/0fc6523b3ba940729a426648a2afd16d/users/23faea4118eb484f82b33ef97cf85f52/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:15.406012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d89420-f1e0-4aee-8779-1a7e421b919c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc6523b3ba940729a426648a2afd16d, user_id=23faea4118eb484f82b33ef97cf85f52, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:15.408923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d89420-f1e0-4aee-8779-1a7e421b919c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:15.493286 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1024/2081] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:15 2022] PUT /identity/v3/projects/0fc6523b3ba940729a426648a2afd16d/users/23faea4118eb484f82b33ef97cf85f52/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:15.508079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b330a-0c48-49bd-8168-e32ff71ed074 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:15.509355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b330a-0c48-49bd-8168-e32ff71ed074 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:15.509728 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b330a-0c48-49bd-8168-e32ff71ed074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:15.515859 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:15.544533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-316b330a-0c48-49bd-8168-e32ff71ed074 None None] MFA Rules not processed for user `23faea4118eb484f82b33ef97cf85f52`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:15.545841 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-316b330a-0c48-49bd-8168-e32ff71ed074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:15.576882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:15.656886 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d89420-f1e0-4aee-8779-1a7e421b919c admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:15.658757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1058/2082] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:15.782347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d89420-f1e0-4aee-8779-1a7e421b919c admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:15.818702 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed872e-0c5e-49f9-8009-1d3d1e5f21cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:15.818702 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed872e-0c5e-49f9-8009-1d3d1e5f21cb admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:15.818702 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed872e-0c5e-49f9-8009-1d3d1e5f21cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:15.818702 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed872e-0c5e-49f9-8009-1d3d1e5f21cb admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:15.819090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed872e-0c5e-49f9-8009-1d3d1e5f21cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:15.819090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed872e-0c5e-49f9-8009-1d3d1e5f21cb admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:16.020714 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1025/2083] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:15 2022] POST /identity/v3/projects => generated 375 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:59:16.022960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b330a-0c48-49bd-8168-e32ff71ed074 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:16.059625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b330a-0c48-49bd-8168-e32ff71ed074 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:16.195996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfb025-ae71-4561-8e21-da762b690a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:16.199839 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfb025-ae71-4561-8e21-da762b690a18 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:16.200411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfb025-ae71-4561-8e21-da762b690a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:16.200844 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfb025-ae71-4561-8e21-da762b690a18 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:16.201903 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfb025-ae71-4561-8e21-da762b690a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:16.217277 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfb025-ae71-4561-8e21-da762b690a18 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:16.357996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1059/2084] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:16 2022] POST /identity/v3/users => generated 288 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:16.361857 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed872e-0c5e-49f9-8009-1d3d1e5f21cb admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:16.377383 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed872e-0c5e-49f9-8009-1d3d1e5f21cb admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:16.384094 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfed09-b0a8-445c-afa9-5aae32df62d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:16.385419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfed09-b0a8-445c-afa9-5aae32df62d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:16.385703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfed09-b0a8-445c-afa9-5aae32df62d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:16.386021 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfed09-b0a8-445c-afa9-5aae32df62d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:16.387057 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfed09-b0a8-445c-afa9-5aae32df62d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:16.389248 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfed09-b0a8-445c-afa9-5aae32df62d0 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:16.402233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1026/2085] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:16.406987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfb025-ae71-4561-8e21-da762b690a18 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:16.420119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfb025-ae71-4561-8e21-da762b690a18 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:16.431296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa150b-b984-4d64-a79f-3826d8953cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:16.432289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa150b-b984-4d64-a79f-3826d8953cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:16.432663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa150b-b984-4d64-a79f-3826d8953cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:16.433017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa150b-b984-4d64-a79f-3826d8953cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:16.433749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa150b-b984-4d64-a79f-3826d8953cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:16.435456 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa150b-b984-4d64-a79f-3826d8953cb3 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:16.457360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1060/2086] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:16.459427 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfed09-b0a8-445c-afa9-5aae32df62d0 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:16.471202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfed09-b0a8-445c-afa9-5aae32df62d0 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:16.486597 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45037bd5-6980-4dd4-b6d9-ea78c0f1e850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:16.487827 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45037bd5-6980-4dd4-b6d9-ea78c0f1e850 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:16.488373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45037bd5-6980-4dd4-b6d9-ea78c0f1e850 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:16.490539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45037bd5-6980-4dd4-b6d9-ea78c0f1e850 admin admin] PATH_INFO: `/v3/projects/f23f8055fc50471f8ff50ad82e3d26f7/users/20acd51fcb884414a969ede42c20eb8b/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:16.538645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45037bd5-6980-4dd4-b6d9-ea78c0f1e850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23f8055fc50471f8ff50ad82e3d26f7, user_id=20acd51fcb884414a969ede42c20eb8b, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:16.547909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45037bd5-6980-4dd4-b6d9-ea78c0f1e850 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:16.648868 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1027/2087] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:16 2022] PUT /identity/v3/projects/f23f8055fc50471f8ff50ad82e3d26f7/users/20acd51fcb884414a969ede42c20eb8b/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:16.662218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6288712-5c40-4a33-bc9d-3b053505543f None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:16.662768 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6288712-5c40-4a33-bc9d-3b053505543f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:16.662768 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6288712-5c40-4a33-bc9d-3b053505543f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:16.700391 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-e6288712-5c40-4a33-bc9d-3b053505543f None None] MFA Rules not processed for user `20acd51fcb884414a969ede42c20eb8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:16.702179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e6288712-5c40-4a33-bc9d-3b053505543f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:16.798389 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1061/2088] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:16.804232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45037bd5-6980-4dd4-b6d9-ea78c0f1e850 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:16.831471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:16.918343 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45037bd5-6980-4dd4-b6d9-ea78c0f1e850 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:16.924298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09edf65-d88e-4dfd-afca-e13aad1fb246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:16.925231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09edf65-d88e-4dfd-afca-e13aad1fb246 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:16.926142 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09edf65-d88e-4dfd-afca-e13aad1fb246 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:16.926506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09edf65-d88e-4dfd-afca-e13aad1fb246 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:16.927280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09edf65-d88e-4dfd-afca-e13aad1fb246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:16.929406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09edf65-d88e-4dfd-afca-e13aad1fb246 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:16.930684 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:17.047073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1028/2089] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:16 2022] POST /identity/v3/projects => generated 375 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:17.048853 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6288712-5c40-4a33-bc9d-3b053505543f None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:17.103866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6288712-5c40-4a33-bc9d-3b053505543f None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:17.208910 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b1a1e-1595-4bed-ba7c-a4406ee3e8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:17.209661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b1a1e-1595-4bed-ba7c-a4406ee3e8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:17.210007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b1a1e-1595-4bed-ba7c-a4406ee3e8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:17.210348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b1a1e-1595-4bed-ba7c-a4406ee3e8a4 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:17.211089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b1a1e-1595-4bed-ba7c-a4406ee3e8a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:17.213645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b1a1e-1595-4bed-ba7c-a4406ee3e8a4 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:17.333128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1062/2090] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:17 2022] POST /identity/v3/users => generated 294 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:17.337415 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09edf65-d88e-4dfd-afca-e13aad1fb246 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:17.358699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09edf65-d88e-4dfd-afca-e13aad1fb246 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:17.366181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7d36a-1a77-41b1-bcf5-a53d91e34a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:17.366810 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7d36a-1a77-41b1-bcf5-a53d91e34a0c admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:17.367090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7d36a-1a77-41b1-bcf5-a53d91e34a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:17.367364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7d36a-1a77-41b1-bcf5-a53d91e34a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:17.368813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7d36a-1a77-41b1-bcf5-a53d91e34a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:17.379157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7d36a-1a77-41b1-bcf5-a53d91e34a0c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:17.403862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1029/2091] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:17.409690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b1a1e-1595-4bed-ba7c-a4406ee3e8a4 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:17.436916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b1a1e-1595-4bed-ba7c-a4406ee3e8a4 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:17.439967 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5f12f-f7ec-4e96-ab0a-bf035fe3f155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:17.440686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5f12f-f7ec-4e96-ab0a-bf035fe3f155 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:17.440969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5f12f-f7ec-4e96-ab0a-bf035fe3f155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:17.441245 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5f12f-f7ec-4e96-ab0a-bf035fe3f155 admin admin] PATH_INFO: `/v3/projects/bf130458fb5c4f0bb0632b888bab89b4/users/b42a27f47f4a4891bb5a2bceb08c6c1b/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:17.462785 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7d36a-1a77-41b1-bcf5-a53d91e34a0c admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:17.470982 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-26d7d36a-1a77-41b1-bcf5-a53d91e34a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:17.471134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5f12f-f7ec-4e96-ab0a-bf035fe3f155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf130458fb5c4f0bb0632b888bab89b4, user_id=b42a27f47f4a4891bb5a2bceb08c6c1b, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:17.474276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5f12f-f7ec-4e96-ab0a-bf035fe3f155 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:17.560980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7d36a-1a77-41b1-bcf5-a53d91e34a0c admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:17.565193 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1063/2092] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:17 2022] PUT /identity/v3/projects/bf130458fb5c4f0bb0632b888bab89b4/users/b42a27f47f4a4891bb5a2bceb08c6c1b/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:17.574836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5f12f-f7ec-4e96-ab0a-bf035fe3f155 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:17.644822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb734d-af54-4875-8315-7c1aab0c72c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:17.648055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb734d-af54-4875-8315-7c1aab0c72c3 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:17.648835 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb734d-af54-4875-8315-7c1aab0c72c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:17.651155 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb734d-af54-4875-8315-7c1aab0c72c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:17.657050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f5fb734d-af54-4875-8315-7c1aab0c72c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:17.704239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5f12f-f7ec-4e96-ab0a-bf035fe3f155 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:17.720111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcfdb4-c8b2-4c89-9f13-7d810226a662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:17.721008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcfdb4-c8b2-4c89-9f13-7d810226a662 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:17.721363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcfdb4-c8b2-4c89-9f13-7d810226a662 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:17.722941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcfdb4-c8b2-4c89-9f13-7d810226a662 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:17.723773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcfdb4-c8b2-4c89-9f13-7d810226a662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:17.725511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcfdb4-c8b2-4c89-9f13-7d810226a662 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:17.750280 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1064/2093] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:17.755383 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcfdb4-c8b2-4c89-9f13-7d810226a662 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:17.768779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcfdb4-c8b2-4c89-9f13-7d810226a662 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:17.774082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98875209-de25-477a-863a-7e1caf5e4345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:17.775665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98875209-de25-477a-863a-7e1caf5e4345 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:17.776223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98875209-de25-477a-863a-7e1caf5e4345 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:17.776223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98875209-de25-477a-863a-7e1caf5e4345 admin admin] PATH_INFO: `/v3/projects/bf130458fb5c4f0bb0632b888bab89b4/users/b42a27f47f4a4891bb5a2bceb08c6c1b/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:17.778443 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98875209-de25-477a-863a-7e1caf5e4345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf130458fb5c4f0bb0632b888bab89b4, user_id=b42a27f47f4a4891bb5a2bceb08c6c1b, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:17.781477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98875209-de25-477a-863a-7e1caf5e4345 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:17.806555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:17.807075 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1065/2094] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:17 2022] PUT /identity/v3/projects/bf130458fb5c4f0bb0632b888bab89b4/users/b42a27f47f4a4891bb5a2bceb08c6c1b/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:17.808562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a1026-2e6f-4ef5-a5d5-0048b5884934 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:17.819592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a1026-2e6f-4ef5-a5d5-0048b5884934 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:17.819592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a1026-2e6f-4ef5-a5d5-0048b5884934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:17.820424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:17.820864 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb734d-af54-4875-8315-7c1aab0c72c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:17.822375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb734d-af54-4875-8315-7c1aab0c72c3 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:17.860410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1030/2095] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:17.894152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-4e5a1026-2e6f-4ef5-a5d5-0048b5884934 None None] MFA Rules not processed for user `b42a27f47f4a4891bb5a2bceb08c6c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:17.895517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4e5a1026-2e6f-4ef5-a5d5-0048b5884934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:18.005414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1066/2096] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:18.014360 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb734d-af54-4875-8315-7c1aab0c72c3 service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:18.027886 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb734d-af54-4875-8315-7c1aab0c72c3 service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:18.122415 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da49023-5dfd-4ce1-96f5-ff96e65be7db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:18.123114 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da49023-5dfd-4ce1-96f5-ff96e65be7db service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:18.123402 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da49023-5dfd-4ce1-96f5-ff96e65be7db service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:18.123672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da49023-5dfd-4ce1-96f5-ff96e65be7db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:18.219691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da49023-5dfd-4ce1-96f5-ff96e65be7db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:18.221220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da49023-5dfd-4ce1-96f5-ff96e65be7db service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:18.235409 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1031/2097] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:18.421426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd7de7-dc53-48cf-baa4-d85645f6afdf None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:18.422151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd7de7-dc53-48cf-baa4-d85645f6afdf None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:18.422679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd7de7-dc53-48cf-baa4-d85645f6afdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:18.451532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-c0dd7de7-dc53-48cf-baa4-d85645f6afdf None None] MFA Rules not processed for user `fbdd4001b2ea4c6cbd6e012f497275cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:18.453046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c0dd7de7-dc53-48cf-baa4-d85645f6afdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:18.547632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1067/2098] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:19.062092 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:20.453403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da49023-5dfd-4ce1-96f5-ff96e65be7db service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:20.456315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8da49023-5dfd-4ce1-96f5-ff96e65be7db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:20.471162 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da49023-5dfd-4ce1-96f5-ff96e65be7db service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:20.477126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17552188-ab82-4f61-81e7-a1bb2d68e5b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:20.479169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17552188-ab82-4f61-81e7-a1bb2d68e5b1 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:20.479644 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17552188-ab82-4f61-81e7-a1bb2d68e5b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:20.480059 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17552188-ab82-4f61-81e7-a1bb2d68e5b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:20.565222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17552188-ab82-4f61-81e7-a1bb2d68e5b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:20.566868 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17552188-ab82-4f61-81e7-a1bb2d68e5b1 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:20.578862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1032/2099] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:22.313109 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd7de7-dc53-48cf-baa4-d85645f6afdf None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:22.324087 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd7de7-dc53-48cf-baa4-d85645f6afdf None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:22.327763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ea4ea-644b-47d8-93ea-1a3392fae154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:22.328415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ea4ea-644b-47d8-93ea-1a3392fae154 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:22.328697 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ea4ea-644b-47d8-93ea-1a3392fae154 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:22.328968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ea4ea-644b-47d8-93ea-1a3392fae154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:22.345156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ea4ea-644b-47d8-93ea-1a3392fae154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:22.346656 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ea4ea-644b-47d8-93ea-1a3392fae154 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:22.357272 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1068/2100] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:23.589920 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17552188-ab82-4f61-81e7-a1bb2d68e5b1 service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:23.591663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-17552188-ab82-4f61-81e7-a1bb2d68e5b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:23.646460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:23.672519 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17552188-ab82-4f61-81e7-a1bb2d68e5b1 service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:23.693641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3eaa9-f954-4b5b-8f25-23d6c83612b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:23.695611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3eaa9-f954-4b5b-8f25-23d6c83612b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:23.696361 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3eaa9-f954-4b5b-8f25-23d6c83612b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:23.706429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3eaa9-f954-4b5b-8f25-23d6c83612b9 admin admin] PATH_INFO: `/v3/users/4e7ca425cf0d47b89c881f6ef599a347` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:23.706429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3eaa9-f954-4b5b-8f25-23d6c83612b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e7ca425cf0d47b89c881f6ef599a347)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:23.706429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3eaa9-f954-4b5b-8f25-23d6c83612b9 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:23.881991 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-37e3eaa9-f954-4b5b-8f25-23d6c83612b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e7ca425cf0d47b89c881f6ef599a347'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:23.882771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-37e3eaa9-f954-4b5b-8f25-23d6c83612b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e7ca425cf0d47b89c881f6ef599a347'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:23.883618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-37e3eaa9-f954-4b5b-8f25-23d6c83612b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e7ca425cf0d47b89c881f6ef599a347'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:23.898473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-37e3eaa9-f954-4b5b-8f25-23d6c83612b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e7ca425cf0d47b89c881f6ef599a347'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:23.921857 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-37e3eaa9-f954-4b5b-8f25-23d6c83612b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e7ca425cf0d47b89c881f6ef599a347'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:24.000670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1033/2101] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:23 2022] DELETE /identity/v3/users/4e7ca425cf0d47b89c881f6ef599a347 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:24.005115 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abb9f8-c72a-4444-bd46-a23407b30a83 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:24.005653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abb9f8-c72a-4444-bd46-a23407b30a83 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:24.005750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abb9f8-c72a-4444-bd46-a23407b30a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:24.027056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-61abb9f8-c72a-4444-bd46-a23407b30a83 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:24.028437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-61abb9f8-c72a-4444-bd46-a23407b30a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:24.104533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1069/2102] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:24.114175 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3eaa9-f954-4b5b-8f25-23d6c83612b9 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:24.115605 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-37e3eaa9-f954-4b5b-8f25-23d6c83612b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:24.178883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3eaa9-f954-4b5b-8f25-23d6c83612b9 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:24.183622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c0d61-1ca1-465e-84df-6ae2c6450ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:24.184302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c0d61-1ca1-465e-84df-6ae2c6450ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:24.184638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c0d61-1ca1-465e-84df-6ae2c6450ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:24.184858 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c0d61-1ca1-465e-84df-6ae2c6450ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:24.194415 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c0d61-1ca1-465e-84df-6ae2c6450ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:24.196033 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c0d61-1ca1-465e-84df-6ae2c6450ce3 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:24.208231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1034/2103] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:24.841494 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abb9f8-c72a-4444-bd46-a23407b30a83 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:24.843001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-61abb9f8-c72a-4444-bd46-a23407b30a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:24.890230 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abb9f8-c72a-4444-bd46-a23407b30a83 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:24.897536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62e33f-1082-4a4a-95ba-2b778f6fae47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:24.898197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62e33f-1082-4a4a-95ba-2b778f6fae47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:24.899416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62e33f-1082-4a4a-95ba-2b778f6fae47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:24.899906 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62e33f-1082-4a4a-95ba-2b778f6fae47 admin admin] PATH_INFO: `/v3/projects/19b0eedc2c7c45f6a10a85a4295f7ca6` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:24.907036 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62e33f-1082-4a4a-95ba-2b778f6fae47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b0eedc2c7c45f6a10a85a4295f7ca6)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:24.909134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62e33f-1082-4a4a-95ba-2b778f6fae47 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:25.069468 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7b62e33f-1082-4a4a-95ba-2b778f6fae47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b0eedc2c7c45f6a10a85a4295f7ca6', 'request_id': 'req-7b62e33f-1082-4a4a-95ba-2b778f6fae47'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:25.078151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7b62e33f-1082-4a4a-95ba-2b778f6fae47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b0eedc2c7c45f6a10a85a4295f7ca6', 'request_id': 'req-7b62e33f-1082-4a4a-95ba-2b778f6fae47'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:25.086274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7b62e33f-1082-4a4a-95ba-2b778f6fae47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b0eedc2c7c45f6a10a85a4295f7ca6', 'request_id': 'req-7b62e33f-1082-4a4a-95ba-2b778f6fae47'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:25.221737 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7b62e33f-1082-4a4a-95ba-2b778f6fae47 admin admin] The token cache is being invalidate because project 19b0eedc2c7c45f6a10a85a4295f7ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:25.226505 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7b62e33f-1082-4a4a-95ba-2b778f6fae47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:25.226505 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7b62e33f-1082-4a4a-95ba-2b778f6fae47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:25.226505 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1070/2104] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:24 2022] DELETE /identity/v3/projects/19b0eedc2c7c45f6a10a85a4295f7ca6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:25.229366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c0d61-1ca1-465e-84df-6ae2c6450ce3 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:25.239670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c0d61-1ca1-465e-84df-6ae2c6450ce3 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:25.300618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6dcb0-8ff2-4346-9e2c-04c5cf2877cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:25.301598 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6dcb0-8ff2-4346-9e2c-04c5cf2877cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:25.302017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6dcb0-8ff2-4346-9e2c-04c5cf2877cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:25.302590 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6dcb0-8ff2-4346-9e2c-04c5cf2877cc admin admin] PATH_INFO: `/v3/users/008629d28120430a9641a7a760d92865` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:25.303899 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6dcb0-8ff2-4346-9e2c-04c5cf2877cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=008629d28120430a9641a7a760d92865)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:25.306205 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6dcb0-8ff2-4346-9e2c-04c5cf2877cc admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:25.319581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:25.519327 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-63c6dcb0-8ff2-4346-9e2c-04c5cf2877cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008629d28120430a9641a7a760d92865'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:25.520054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-63c6dcb0-8ff2-4346-9e2c-04c5cf2877cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008629d28120430a9641a7a760d92865'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:25.520818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-63c6dcb0-8ff2-4346-9e2c-04c5cf2877cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008629d28120430a9641a7a760d92865'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:25.535409 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-63c6dcb0-8ff2-4346-9e2c-04c5cf2877cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008629d28120430a9641a7a760d92865'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:25.542640 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-63c6dcb0-8ff2-4346-9e2c-04c5cf2877cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008629d28120430a9641a7a760d92865'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:25.623615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1035/2105] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:25 2022] DELETE /identity/v3/users/008629d28120430a9641a7a760d92865 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:26.265513 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62e33f-1082-4a4a-95ba-2b778f6fae47 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:26.267150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-7b62e33f-1082-4a4a-95ba-2b778f6fae47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:26.283234 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62e33f-1082-4a4a-95ba-2b778f6fae47 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:26.335875 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:26.356658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792bb80-030e-4d87-8cc5-cb8a5025ff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:26.357217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792bb80-030e-4d87-8cc5-cb8a5025ff85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:26.357599 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792bb80-030e-4d87-8cc5-cb8a5025ff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:26.357877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792bb80-030e-4d87-8cc5-cb8a5025ff85 admin admin] PATH_INFO: `/v3/projects/d54a2be077054f0e8fed27027d956f4a` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:26.359009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792bb80-030e-4d87-8cc5-cb8a5025ff85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54a2be077054f0e8fed27027d956f4a)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:26.360980 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792bb80-030e-4d87-8cc5-cb8a5025ff85 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:26.483817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8792bb80-030e-4d87-8cc5-cb8a5025ff85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54a2be077054f0e8fed27027d956f4a', 'request_id': 'req-8792bb80-030e-4d87-8cc5-cb8a5025ff85'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:26.489637 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8792bb80-030e-4d87-8cc5-cb8a5025ff85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54a2be077054f0e8fed27027d956f4a', 'request_id': 'req-8792bb80-030e-4d87-8cc5-cb8a5025ff85'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:26.495511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8792bb80-030e-4d87-8cc5-cb8a5025ff85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54a2be077054f0e8fed27027d956f4a', 'request_id': 'req-8792bb80-030e-4d87-8cc5-cb8a5025ff85'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:26.578578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8792bb80-030e-4d87-8cc5-cb8a5025ff85 admin admin] The token cache is being invalidate because project d54a2be077054f0e8fed27027d956f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:26.579070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8792bb80-030e-4d87-8cc5-cb8a5025ff85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:26.579715 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8792bb80-030e-4d87-8cc5-cb8a5025ff85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:26.581279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1071/2106] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:26 2022] DELETE /identity/v3/projects/d54a2be077054f0e8fed27027d956f4a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:26.586372 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed91ef-8f94-4e64-b39d-6e8f45234d97 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:26.586820 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed91ef-8f94-4e64-b39d-6e8f45234d97 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:26.587186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed91ef-8f94-4e64-b39d-6e8f45234d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:26.607521 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-75ed91ef-8f94-4e64-b39d-6e8f45234d97 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:26.608808 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-75ed91ef-8f94-4e64-b39d-6e8f45234d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:26.682564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1036/2107] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:26.702398 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53886e6-f371-4411-a843-57f1f3750b2d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:26.702776 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53886e6-f371-4411-a843-57f1f3750b2d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:26.703100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53886e6-f371-4411-a843-57f1f3750b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:26.728693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-a53886e6-f371-4411-a843-57f1f3750b2d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:26.730073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a53886e6-f371-4411-a843-57f1f3750b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:26.745460 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1072/2108] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:26.750129 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed91ef-8f94-4e64-b39d-6e8f45234d97 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:26.763359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed91ef-8f94-4e64-b39d-6e8f45234d97 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:26.768762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7701a2-378f-4727-b686-b74720b8b5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:26.769425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7701a2-378f-4727-b686-b74720b8b5ed admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:26.770815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7701a2-378f-4727-b686-b74720b8b5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:26.771107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7701a2-378f-4727-b686-b74720b8b5ed admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:26.771793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7701a2-378f-4727-b686-b74720b8b5ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:59:26.772103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7701a2-378f-4727-b686-b74720b8b5ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:26.773772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7701a2-378f-4727-b686-b74720b8b5ed admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:26.789848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1037/2109] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:59:26.798760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53886e6-f371-4411-a843-57f1f3750b2d None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:26.810224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53886e6-f371-4411-a843-57f1f3750b2d None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:26.815321 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30399f03-3247-4d04-aa43-aee2b3e3e61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:26.815937 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30399f03-3247-4d04-aa43-aee2b3e3e61b admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:26.816313 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30399f03-3247-4d04-aa43-aee2b3e3e61b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:26.816626 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30399f03-3247-4d04-aa43-aee2b3e3e61b admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:26.817496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30399f03-3247-4d04-aa43-aee2b3e3e61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:26.819570 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30399f03-3247-4d04-aa43-aee2b3e3e61b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:26.984592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1073/2110] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:26 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:59:26.985477 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7701a2-378f-4727-b686-b74720b8b5ed admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:26.998886 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7701a2-378f-4727-b686-b74720b8b5ed admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:27.059951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f931ced-330a-4176-b231-47af3e1d156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:27.060661 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f931ced-330a-4176-b231-47af3e1d156e admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:27.061014 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f931ced-330a-4176-b231-47af3e1d156e admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:27.061434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f931ced-330a-4176-b231-47af3e1d156e admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:27.062191 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f931ced-330a-4176-b231-47af3e1d156e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:27.064147 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f931ced-330a-4176-b231-47af3e1d156e admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:27.171679 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1038/2111] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:26 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:59:27.177281 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30399f03-3247-4d04-aa43-aee2b3e3e61b admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:27.206800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30399f03-3247-4d04-aa43-aee2b3e3e61b admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:27.211933 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6bcda-644a-4a47-ab08-8326f69758f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:27.214745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6bcda-644a-4a47-ab08-8326f69758f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:27.215099 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6bcda-644a-4a47-ab08-8326f69758f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:27.215445 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6bcda-644a-4a47-ab08-8326f69758f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:27.216358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6bcda-644a-4a47-ab08-8326f69758f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:27.218056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6bcda-644a-4a47-ab08-8326f69758f3 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:27.230396 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1074/2112] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:27.234422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f931ced-330a-4176-b231-47af3e1d156e admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:27.241897 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:27.247562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f931ced-330a-4176-b231-47af3e1d156e admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:27.255375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee44619-8e9e-4c96-8421-3056e5f2d196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:27.256005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee44619-8e9e-4c96-8421-3056e5f2d196 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:27.256321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee44619-8e9e-4c96-8421-3056e5f2d196 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:27.256601 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee44619-8e9e-4c96-8421-3056e5f2d196 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:27.257260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee44619-8e9e-4c96-8421-3056e5f2d196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:27.258938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee44619-8e9e-4c96-8421-3056e5f2d196 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:27.271460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1039/2113] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:27.275911 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6bcda-644a-4a47-ab08-8326f69758f3 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:27.286951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6bcda-644a-4a47-ab08-8326f69758f3 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:27.292774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802829b2-8c6b-430e-912b-186eaab9d7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:27.293555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802829b2-8c6b-430e-912b-186eaab9d7c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:27.293906 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802829b2-8c6b-430e-912b-186eaab9d7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:27.294243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802829b2-8c6b-430e-912b-186eaab9d7c3 admin admin] PATH_INFO: `/v3/projects/a23eaa1afa8e4a698d7376363257d276/users/2306e21e6de1416c8fcb9b4d9fcdff6b/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:27.312741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802829b2-8c6b-430e-912b-186eaab9d7c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23eaa1afa8e4a698d7376363257d276, user_id=2306e21e6de1416c8fcb9b4d9fcdff6b, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:27.315594 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802829b2-8c6b-430e-912b-186eaab9d7c3 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:27.415825 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1075/2114] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:27 2022] PUT /identity/v3/projects/a23eaa1afa8e4a698d7376363257d276/users/2306e21e6de1416c8fcb9b4d9fcdff6b/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:27.419635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceddb6c-65f8-4eb6-b9db-9b68db78ef79 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:27.419866 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceddb6c-65f8-4eb6-b9db-9b68db78ef79 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:27.420174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceddb6c-65f8-4eb6-b9db-9b68db78ef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:27.454709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-cceddb6c-65f8-4eb6-b9db-9b68db78ef79 None None] MFA Rules not processed for user `2306e21e6de1416c8fcb9b4d9fcdff6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:27.456225 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-cceddb6c-65f8-4eb6-b9db-9b68db78ef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:27.548522 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1040/2115] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:27.776909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802829b2-8c6b-430e-912b-186eaab9d7c3 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:27.778662 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-802829b2-8c6b-430e-912b-186eaab9d7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:27.854815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802829b2-8c6b-430e-912b-186eaab9d7c3 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:27.858646 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd472cc-3eb4-441d-a0ba-ca35b941b7c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:27.859508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd472cc-3eb4-441d-a0ba-ca35b941b7c3 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:27.859789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd472cc-3eb4-441d-a0ba-ca35b941b7c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:27.860060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd472cc-3eb4-441d-a0ba-ca35b941b7c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:27.872706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd472cc-3eb4-441d-a0ba-ca35b941b7c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:27.877576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd472cc-3eb4-441d-a0ba-ca35b941b7c3 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:27.889686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1076/2116] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:28.348336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceddb6c-65f8-4eb6-b9db-9b68db78ef79 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:28.349924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-cceddb6c-65f8-4eb6-b9db-9b68db78ef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:28.421611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceddb6c-65f8-4eb6-b9db-9b68db78ef79 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:28.430674 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ced9cf-3d2d-459c-b3e2-6244ed2e6d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:28.432986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ced9cf-3d2d-459c-b3e2-6244ed2e6d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:28.433271 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ced9cf-3d2d-459c-b3e2-6244ed2e6d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:28.433545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ced9cf-3d2d-459c-b3e2-6244ed2e6d77 admin admin] PATH_INFO: `/v3/users/23faea4118eb484f82b33ef97cf85f52` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:28.434782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ced9cf-3d2d-459c-b3e2-6244ed2e6d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23faea4118eb484f82b33ef97cf85f52)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:28.436924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ced9cf-3d2d-459c-b3e2-6244ed2e6d77 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:28.644394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-47ced9cf-3d2d-459c-b3e2-6244ed2e6d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23faea4118eb484f82b33ef97cf85f52'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:28.645163 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-47ced9cf-3d2d-459c-b3e2-6244ed2e6d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23faea4118eb484f82b33ef97cf85f52'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:28.645890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-47ced9cf-3d2d-459c-b3e2-6244ed2e6d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23faea4118eb484f82b33ef97cf85f52'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:28.660078 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-47ced9cf-3d2d-459c-b3e2-6244ed2e6d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23faea4118eb484f82b33ef97cf85f52'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:28.668681 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-47ced9cf-3d2d-459c-b3e2-6244ed2e6d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23faea4118eb484f82b33ef97cf85f52'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:28.758676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1041/2117] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:28 2022] DELETE /identity/v3/users/23faea4118eb484f82b33ef97cf85f52 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:28.763592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec4c63-8c7f-4d40-b35c-6b3a95834aac None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:28.764101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec4c63-8c7f-4d40-b35c-6b3a95834aac None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:28.764325 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec4c63-8c7f-4d40-b35c-6b3a95834aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:28.784818 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-6eec4c63-8c7f-4d40-b35c-6b3a95834aac None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:28.790538 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-6eec4c63-8c7f-4d40-b35c-6b3a95834aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:28.792446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:28.849754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1077/2118] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:28.866774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ced9cf-3d2d-459c-b3e2-6244ed2e6d77 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:28.869040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-47ced9cf-3d2d-459c-b3e2-6244ed2e6d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:28.877517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:28.945863 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ced9cf-3d2d-459c-b3e2-6244ed2e6d77 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:28.950233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13e622-c23f-4a3b-8c92-84736f10772a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:28.950860 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13e622-c23f-4a3b-8c92-84736f10772a service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:28.951133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13e622-c23f-4a3b-8c92-84736f10772a service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:28.951413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13e622-c23f-4a3b-8c92-84736f10772a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:28.965950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13e622-c23f-4a3b-8c92-84736f10772a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:28.967569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13e622-c23f-4a3b-8c92-84736f10772a service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:28.979764 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1042/2119] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:29.529160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec4c63-8c7f-4d40-b35c-6b3a95834aac None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:29.530642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-6eec4c63-8c7f-4d40-b35c-6b3a95834aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:29.545316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec4c63-8c7f-4d40-b35c-6b3a95834aac None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:29.551561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf25f0-c71e-43fb-8b3a-494ca8611754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:29.551561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf25f0-c71e-43fb-8b3a-494ca8611754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:29.551561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf25f0-c71e-43fb-8b3a-494ca8611754 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:29.551561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf25f0-c71e-43fb-8b3a-494ca8611754 admin admin] PATH_INFO: `/v3/projects/0fc6523b3ba940729a426648a2afd16d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:29.552836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf25f0-c71e-43fb-8b3a-494ca8611754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc6523b3ba940729a426648a2afd16d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:29.554820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf25f0-c71e-43fb-8b3a-494ca8611754 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:29.717787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8cdf25f0-c71e-43fb-8b3a-494ca8611754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc6523b3ba940729a426648a2afd16d', 'request_id': 'req-8cdf25f0-c71e-43fb-8b3a-494ca8611754'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:29.725121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8cdf25f0-c71e-43fb-8b3a-494ca8611754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc6523b3ba940729a426648a2afd16d', 'request_id': 'req-8cdf25f0-c71e-43fb-8b3a-494ca8611754'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:29.731731 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8cdf25f0-c71e-43fb-8b3a-494ca8611754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc6523b3ba940729a426648a2afd16d', 'request_id': 'req-8cdf25f0-c71e-43fb-8b3a-494ca8611754'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:29.809306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8cdf25f0-c71e-43fb-8b3a-494ca8611754 admin admin] The token cache is being invalidate because project 0fc6523b3ba940729a426648a2afd16d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:29.809306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8cdf25f0-c71e-43fb-8b3a-494ca8611754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:29.809306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8cdf25f0-c71e-43fb-8b3a-494ca8611754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:29.809306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1078/2120] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:29 2022] DELETE /identity/v3/projects/0fc6523b3ba940729a426648a2afd16d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:29.810081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13e622-c23f-4a3b-8c92-84736f10772a service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:29.819710 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13e622-c23f-4a3b-8c92-84736f10772a service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:29.885525 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f51002-53f9-40eb-82e8-f0900aefc401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:29.886164 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f51002-53f9-40eb-82e8-f0900aefc401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:29.886473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f51002-53f9-40eb-82e8-f0900aefc401 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:29.886750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f51002-53f9-40eb-82e8-f0900aefc401 admin admin] PATH_INFO: `/v3/users/20acd51fcb884414a969ede42c20eb8b` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:29.887897 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f51002-53f9-40eb-82e8-f0900aefc401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20acd51fcb884414a969ede42c20eb8b)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:29.889933 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f51002-53f9-40eb-82e8-f0900aefc401 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:30.055055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-54f51002-53f9-40eb-82e8-f0900aefc401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20acd51fcb884414a969ede42c20eb8b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:30.055786 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-54f51002-53f9-40eb-82e8-f0900aefc401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20acd51fcb884414a969ede42c20eb8b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:30.057726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-54f51002-53f9-40eb-82e8-f0900aefc401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20acd51fcb884414a969ede42c20eb8b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:30.072879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-54f51002-53f9-40eb-82e8-f0900aefc401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20acd51fcb884414a969ede42c20eb8b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:30.079940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-54f51002-53f9-40eb-82e8-f0900aefc401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20acd51fcb884414a969ede42c20eb8b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:30.166783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1043/2121] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:29 2022] DELETE /identity/v3/users/20acd51fcb884414a969ede42c20eb8b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:30.595683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf25f0-c71e-43fb-8b3a-494ca8611754 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:30.599082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8cdf25f0-c71e-43fb-8b3a-494ca8611754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:30.612788 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf25f0-c71e-43fb-8b3a-494ca8611754 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:30.671848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424b130-34a8-49cc-81cc-89fc1de235cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:30.672512 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424b130-34a8-49cc-81cc-89fc1de235cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:30.672793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424b130-34a8-49cc-81cc-89fc1de235cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:30.673056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424b130-34a8-49cc-81cc-89fc1de235cc admin admin] PATH_INFO: `/v3/projects/f23f8055fc50471f8ff50ad82e3d26f7` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:30.674193 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424b130-34a8-49cc-81cc-89fc1de235cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f23f8055fc50471f8ff50ad82e3d26f7)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:30.676091 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424b130-34a8-49cc-81cc-89fc1de235cc admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:30.802800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:30.812066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b424b130-34a8-49cc-81cc-89fc1de235cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f23f8055fc50471f8ff50ad82e3d26f7', 'request_id': 'req-b424b130-34a8-49cc-81cc-89fc1de235cc'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:30.818621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b424b130-34a8-49cc-81cc-89fc1de235cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f23f8055fc50471f8ff50ad82e3d26f7', 'request_id': 'req-b424b130-34a8-49cc-81cc-89fc1de235cc'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:30.825614 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b424b130-34a8-49cc-81cc-89fc1de235cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f23f8055fc50471f8ff50ad82e3d26f7', 'request_id': 'req-b424b130-34a8-49cc-81cc-89fc1de235cc'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:30.922068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b424b130-34a8-49cc-81cc-89fc1de235cc admin admin] The token cache is being invalidate because project f23f8055fc50471f8ff50ad82e3d26f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:30.922467 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b424b130-34a8-49cc-81cc-89fc1de235cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:30.923471 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b424b130-34a8-49cc-81cc-89fc1de235cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:30.928249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1079/2122] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:30 2022] DELETE /identity/v3/projects/f23f8055fc50471f8ff50ad82e3d26f7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:30.929680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f51002-53f9-40eb-82e8-f0900aefc401 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:30.931712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-54f51002-53f9-40eb-82e8-f0900aefc401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:30.946457 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f51002-53f9-40eb-82e8-f0900aefc401 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:30.969900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:31.023293 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd20824-f6b9-4c60-9397-d1ad9f7e3eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:31.023945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd20824-f6b9-4c60-9397-d1ad9f7e3eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:31.024293 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd20824-f6b9-4c60-9397-d1ad9f7e3eed admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:31.024538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd20824-f6b9-4c60-9397-d1ad9f7e3eed admin admin] PATH_INFO: `/v3/users/b42a27f47f4a4891bb5a2bceb08c6c1b` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:31.026586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd20824-f6b9-4c60-9397-d1ad9f7e3eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42a27f47f4a4891bb5a2bceb08c6c1b)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:31.028590 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd20824-f6b9-4c60-9397-d1ad9f7e3eed admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:31.254727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-1fd20824-f6b9-4c60-9397-d1ad9f7e3eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42a27f47f4a4891bb5a2bceb08c6c1b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:31.256070 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-1fd20824-f6b9-4c60-9397-d1ad9f7e3eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42a27f47f4a4891bb5a2bceb08c6c1b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:31.257206 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-1fd20824-f6b9-4c60-9397-d1ad9f7e3eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42a27f47f4a4891bb5a2bceb08c6c1b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:31.270453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-1fd20824-f6b9-4c60-9397-d1ad9f7e3eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42a27f47f4a4891bb5a2bceb08c6c1b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:31.278284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-1fd20824-f6b9-4c60-9397-d1ad9f7e3eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42a27f47f4a4891bb5a2bceb08c6c1b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:31.360199 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1044/2123] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:30 2022] DELETE /identity/v3/users/b42a27f47f4a4891bb5a2bceb08c6c1b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:31.517422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424b130-34a8-49cc-81cc-89fc1de235cc admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:31.518846 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b424b130-34a8-49cc-81cc-89fc1de235cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:31.579599 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424b130-34a8-49cc-81cc-89fc1de235cc admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:31.646435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59fedd-7bcc-46dd-b12f-a930ab932224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:31.647091 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59fedd-7bcc-46dd-b12f-a930ab932224 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:31.647560 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59fedd-7bcc-46dd-b12f-a930ab932224 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:31.650305 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59fedd-7bcc-46dd-b12f-a930ab932224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:31.650305 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ef59fedd-7bcc-46dd-b12f-a930ab932224 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:31.720733 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59fedd-7bcc-46dd-b12f-a930ab932224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:31.730751 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59fedd-7bcc-46dd-b12f-a930ab932224 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:31.733900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1080/2124] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:31.944136 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd20824-f6b9-4c60-9397-d1ad9f7e3eed admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:31.947789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1fd20824-f6b9-4c60-9397-d1ad9f7e3eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:32.026296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd20824-f6b9-4c60-9397-d1ad9f7e3eed admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:32.033850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dde30-be43-4bcb-9729-bdeeb73d9586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:32.034510 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dde30-be43-4bcb-9729-bdeeb73d9586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:32.034851 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dde30-be43-4bcb-9729-bdeeb73d9586 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:32.049387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dde30-be43-4bcb-9729-bdeeb73d9586 admin admin] PATH_INFO: `/v3/projects/bf130458fb5c4f0bb0632b888bab89b4` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:32.049387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43dde30-be43-4bcb-9729-bdeeb73d9586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf130458fb5c4f0bb0632b888bab89b4)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:32.049387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43dde30-be43-4bcb-9729-bdeeb73d9586 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:32.183654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:32.187262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a43dde30-be43-4bcb-9729-bdeeb73d9586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf130458fb5c4f0bb0632b888bab89b4', 'request_id': 'req-a43dde30-be43-4bcb-9729-bdeeb73d9586'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:32.234215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a43dde30-be43-4bcb-9729-bdeeb73d9586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf130458fb5c4f0bb0632b888bab89b4', 'request_id': 'req-a43dde30-be43-4bcb-9729-bdeeb73d9586'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:32.244908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a43dde30-be43-4bcb-9729-bdeeb73d9586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf130458fb5c4f0bb0632b888bab89b4', 'request_id': 'req-a43dde30-be43-4bcb-9729-bdeeb73d9586'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:32.263285 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a43dde30-be43-4bcb-9729-bdeeb73d9586 admin admin] The token cache is being invalidate because project bf130458fb5c4f0bb0632b888bab89b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:32.263609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a43dde30-be43-4bcb-9729-bdeeb73d9586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:32.264290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a43dde30-be43-4bcb-9729-bdeeb73d9586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:32.265828 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1045/2125] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:31 2022] DELETE /identity/v3/projects/bf130458fb5c4f0bb0632b888bab89b4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:32.270784 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fd9a6-4b09-4da0-949e-c1962d7982f9 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:32.271912 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fd9a6-4b09-4da0-949e-c1962d7982f9 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:32.272419 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fd9a6-4b09-4da0-949e-c1962d7982f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:32.310547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-927fd9a6-4b09-4da0-949e-c1962d7982f9 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:32.311932 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-927fd9a6-4b09-4da0-949e-c1962d7982f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:32.360727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:32.402824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1081/2126] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:32.410625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da859f62-0bee-49b3-a454-cbffd18aa72e None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:32.410914 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da859f62-0bee-49b3-a454-cbffd18aa72e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:32.411183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da859f62-0bee-49b3-a454-cbffd18aa72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:32.442129 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-da859f62-0bee-49b3-a454-cbffd18aa72e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:32.442129 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-da859f62-0bee-49b3-a454-cbffd18aa72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:32.451920 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1046/2127] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:32.456330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fd9a6-4b09-4da0-949e-c1962d7982f9 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:32.468501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fd9a6-4b09-4da0-949e-c1962d7982f9 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:32.473408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11858b-b5f4-4053-916f-5f7d01aad98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:32.474488 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11858b-b5f4-4053-916f-5f7d01aad98c admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:32.474930 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11858b-b5f4-4053-916f-5f7d01aad98c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:32.475358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11858b-b5f4-4053-916f-5f7d01aad98c admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:32.476166 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11858b-b5f4-4053-916f-5f7d01aad98c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:59:32.476660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11858b-b5f4-4053-916f-5f7d01aad98c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:32.478859 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11858b-b5f4-4053-916f-5f7d01aad98c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:32.500255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1082/2128] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:59:32.503902 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da859f62-0bee-49b3-a454-cbffd18aa72e None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:32.520783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da859f62-0bee-49b3-a454-cbffd18aa72e None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:32.527045 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729ae66-6464-496c-9189-979a3ec97dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:32.528254 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729ae66-6464-496c-9189-979a3ec97dfc admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:32.529091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729ae66-6464-496c-9189-979a3ec97dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:32.529614 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729ae66-6464-496c-9189-979a3ec97dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:32.530471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729ae66-6464-496c-9189-979a3ec97dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:32.533691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729ae66-6464-496c-9189-979a3ec97dfc admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:32.634449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1047/2129] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:32 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:59:32.638894 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11858b-b5f4-4053-916f-5f7d01aad98c admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:32.649471 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11858b-b5f4-4053-916f-5f7d01aad98c admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:32.714848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796b89d-579b-47fc-98e0-56ac3ed6fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:32.715560 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796b89d-579b-47fc-98e0-56ac3ed6fa21 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:32.715830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796b89d-579b-47fc-98e0-56ac3ed6fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:32.716108 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796b89d-579b-47fc-98e0-56ac3ed6fa21 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:32.716793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796b89d-579b-47fc-98e0-56ac3ed6fa21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:32.718732 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796b89d-579b-47fc-98e0-56ac3ed6fa21 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:32.812272 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1083/2130] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:32 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:32.816556 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729ae66-6464-496c-9189-979a3ec97dfc admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:32.830323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729ae66-6464-496c-9189-979a3ec97dfc admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:32.835720 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce906555-3e76-4d3b-b3b5-aef2614aebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:32.836383 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce906555-3e76-4d3b-b3b5-aef2614aebcc admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:32.836669 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce906555-3e76-4d3b-b3b5-aef2614aebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:32.836946 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce906555-3e76-4d3b-b3b5-aef2614aebcc admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:32.838571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce906555-3e76-4d3b-b3b5-aef2614aebcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:32.839405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce906555-3e76-4d3b-b3b5-aef2614aebcc admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:32.850941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1048/2131] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:32.865362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796b89d-579b-47fc-98e0-56ac3ed6fa21 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:32.876744 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796b89d-579b-47fc-98e0-56ac3ed6fa21 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:32.882880 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc4512-4f97-4a7d-93ad-ccf456abaec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:32.883570 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc4512-4f97-4a7d-93ad-ccf456abaec0 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:32.883819 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc4512-4f97-4a7d-93ad-ccf456abaec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:32.884250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc4512-4f97-4a7d-93ad-ccf456abaec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:32.885038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc4512-4f97-4a7d-93ad-ccf456abaec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:32.886645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc4512-4f97-4a7d-93ad-ccf456abaec0 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:32.901054 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1084/2132] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:32.906464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce906555-3e76-4d3b-b3b5-aef2614aebcc admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:32.918216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce906555-3e76-4d3b-b3b5-aef2614aebcc admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:32.923514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e2a4c-547c-4f78-9d91-49c6daee6ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:32.924856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e2a4c-547c-4f78-9d91-49c6daee6ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:32.924856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e2a4c-547c-4f78-9d91-49c6daee6ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:32.924856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e2a4c-547c-4f78-9d91-49c6daee6ad8 admin admin] PATH_INFO: `/v3/projects/1785a6a379474e088706e83fab7e3a89/users/2f6c2d623a504f20b55b19124797e97e/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:32.943091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e2a4c-547c-4f78-9d91-49c6daee6ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1785a6a379474e088706e83fab7e3a89, user_id=2f6c2d623a504f20b55b19124797e97e, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:32.945905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e2a4c-547c-4f78-9d91-49c6daee6ad8 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:33.000648 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1049/2133] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:32 2022] PUT /identity/v3/projects/1785a6a379474e088706e83fab7e3a89/users/2f6c2d623a504f20b55b19124797e97e/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:33.005665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3312cbd-9668-4ca5-b570-ed35433faabf None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:33.006499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3312cbd-9668-4ca5-b570-ed35433faabf None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:33.006499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3312cbd-9668-4ca5-b570-ed35433faabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:33.033515 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-d3312cbd-9668-4ca5-b570-ed35433faabf None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:33.034803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d3312cbd-9668-4ca5-b570-ed35433faabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:33.121608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1085/2134] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:33.136634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e2a4c-547c-4f78-9d91-49c6daee6ad8 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:33.136634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c93e2a4c-547c-4f78-9d91-49c6daee6ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:33.136820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3312cbd-9668-4ca5-b570-ed35433faabf None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:33.136820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d3312cbd-9668-4ca5-b570-ed35433faabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:33.148121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e2a4c-547c-4f78-9d91-49c6daee6ad8 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:33.157003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a682b-b7f2-4e53-a511-be312d12fc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:33.158813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a682b-b7f2-4e53-a511-be312d12fc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:33.159106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a682b-b7f2-4e53-a511-be312d12fc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:33.159466 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a682b-b7f2-4e53-a511-be312d12fc29 admin admin] PATH_INFO: `/v3/users/9653dbf85e6542e29cea9e46442d2f52` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:33.161789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a682b-b7f2-4e53-a511-be312d12fc29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9653dbf85e6542e29cea9e46442d2f52)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:33.164669 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a682b-b7f2-4e53-a511-be312d12fc29 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:33.189156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:33.206025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3312cbd-9668-4ca5-b570-ed35433faabf None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:33.209873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc387b3f-2c83-46bb-acb6-943295f46755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:33.210481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc387b3f-2c83-46bb-acb6-943295f46755 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:33.210811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc387b3f-2c83-46bb-acb6-943295f46755 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:33.211033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc387b3f-2c83-46bb-acb6-943295f46755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:33.221755 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc387b3f-2c83-46bb-acb6-943295f46755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:33.223252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc387b3f-2c83-46bb-acb6-943295f46755 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:33.234409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1086/2135] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:33.418774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-320a682b-b7f2-4e53-a511-be312d12fc29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9653dbf85e6542e29cea9e46442d2f52'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:33.419579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-320a682b-b7f2-4e53-a511-be312d12fc29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9653dbf85e6542e29cea9e46442d2f52'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:33.421056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-320a682b-b7f2-4e53-a511-be312d12fc29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9653dbf85e6542e29cea9e46442d2f52'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:33.445018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-320a682b-b7f2-4e53-a511-be312d12fc29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9653dbf85e6542e29cea9e46442d2f52'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:33.454442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-320a682b-b7f2-4e53-a511-be312d12fc29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9653dbf85e6542e29cea9e46442d2f52'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:33.525233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1050/2136] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:33 2022] DELETE /identity/v3/users/9653dbf85e6542e29cea9e46442d2f52 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:33.530133 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6de77c-3e77-4a56-8183-829d4f698756 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:33.530637 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6de77c-3e77-4a56-8183-829d4f698756 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:33.530901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6de77c-3e77-4a56-8183-829d4f698756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:33.559900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-be6de77c-3e77-4a56-8183-829d4f698756 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:33.561293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-be6de77c-3e77-4a56-8183-829d4f698756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:33.579571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a682b-b7f2-4e53-a511-be312d12fc29 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:33.581218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-320a682b-b7f2-4e53-a511-be312d12fc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:33.651442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:DELETE=14,keystone:SELECT=82,keystone:INSERT=4 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:33.675474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1087/2137] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:33.687959 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a682b-b7f2-4e53-a511-be312d12fc29 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:33.691754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6de77c-3e77-4a56-8183-829d4f698756 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:33.692933 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1f594-2a2a-4af0-801d-64232e0d9173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:33.693574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1f594-2a2a-4af0-801d-64232e0d9173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:33.693706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-be6de77c-3e77-4a56-8183-829d4f698756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:33.694019 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1f594-2a2a-4af0-801d-64232e0d9173 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:33.694294 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1f594-2a2a-4af0-801d-64232e0d9173 admin admin] PATH_INFO: `/v3/users/2306e21e6de1416c8fcb9b4d9fcdff6b` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:33.695608 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1f594-2a2a-4af0-801d-64232e0d9173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2306e21e6de1416c8fcb9b4d9fcdff6b)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:33.697940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1f594-2a2a-4af0-801d-64232e0d9173 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:33.780318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6de77c-3e77-4a56-8183-829d4f698756 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:33.785166 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a2d03-14ce-4fcd-8791-81d6b48d3a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:33.785822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a2d03-14ce-4fcd-8791-81d6b48d3a3f service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:33.787960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a2d03-14ce-4fcd-8791-81d6b48d3a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:33.788290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a2d03-14ce-4fcd-8791-81d6b48d3a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:33.799984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a2d03-14ce-4fcd-8791-81d6b48d3a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:33.801475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a2d03-14ce-4fcd-8791-81d6b48d3a3f service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:33.812918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1088/2138] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:33.961162 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-55b1f594-2a2a-4af0-801d-64232e0d9173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2306e21e6de1416c8fcb9b4d9fcdff6b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:33.962795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-55b1f594-2a2a-4af0-801d-64232e0d9173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2306e21e6de1416c8fcb9b4d9fcdff6b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:33.963146 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-55b1f594-2a2a-4af0-801d-64232e0d9173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2306e21e6de1416c8fcb9b4d9fcdff6b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:33.979454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-55b1f594-2a2a-4af0-801d-64232e0d9173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2306e21e6de1416c8fcb9b4d9fcdff6b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:33.989034 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-55b1f594-2a2a-4af0-801d-64232e0d9173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2306e21e6de1416c8fcb9b4d9fcdff6b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:34.314646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1051/2139] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:33 2022] DELETE /identity/v3/users/2306e21e6de1416c8fcb9b4d9fcdff6b => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:34.320294 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe34cf4-32d0-4c2f-8482-6c983ba76fa3 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:34.321377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe34cf4-32d0-4c2f-8482-6c983ba76fa3 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:34.322547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe34cf4-32d0-4c2f-8482-6c983ba76fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:34.357901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-4fe34cf4-32d0-4c2f-8482-6c983ba76fa3 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:34.360649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4fe34cf4-32d0-4c2f-8482-6c983ba76fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:34.496245 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1089/2140] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:59:34.516615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1f594-2a2a-4af0-801d-64232e0d9173 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:34.518792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-55b1f594-2a2a-4af0-801d-64232e0d9173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:34.601039 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1f594-2a2a-4af0-801d-64232e0d9173 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:34.605645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad830e-b0b5-4ef3-84a3-14c9a0665136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:34.606264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad830e-b0b5-4ef3-84a3-14c9a0665136 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:34.606552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad830e-b0b5-4ef3-84a3-14c9a0665136 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:34.606827 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad830e-b0b5-4ef3-84a3-14c9a0665136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:34.616293 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad830e-b0b5-4ef3-84a3-14c9a0665136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:34.618310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad830e-b0b5-4ef3-84a3-14c9a0665136 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:34.628993 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1052/2141] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:34.677683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe34cf4-32d0-4c2f-8482-6c983ba76fa3 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:34.679116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4fe34cf4-32d0-4c2f-8482-6c983ba76fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:34.693355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe34cf4-32d0-4c2f-8482-6c983ba76fa3 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:34.698787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97507ba6-b7bf-4bee-b8e8-4db14e9746f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:34.701482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97507ba6-b7bf-4bee-b8e8-4db14e9746f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:34.701482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97507ba6-b7bf-4bee-b8e8-4db14e9746f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:34.701482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97507ba6-b7bf-4bee-b8e8-4db14e9746f7 admin admin] PATH_INFO: `/v3/projects/cf7d543376754ac680284678d2496847` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:34.701801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97507ba6-b7bf-4bee-b8e8-4db14e9746f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7d543376754ac680284678d2496847)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:34.703741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97507ba6-b7bf-4bee-b8e8-4db14e9746f7 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:34.739709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:34.838541 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-97507ba6-b7bf-4bee-b8e8-4db14e9746f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7d543376754ac680284678d2496847', 'request_id': 'req-97507ba6-b7bf-4bee-b8e8-4db14e9746f7'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:34.846186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-97507ba6-b7bf-4bee-b8e8-4db14e9746f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7d543376754ac680284678d2496847', 'request_id': 'req-97507ba6-b7bf-4bee-b8e8-4db14e9746f7'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:34.854718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-97507ba6-b7bf-4bee-b8e8-4db14e9746f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7d543376754ac680284678d2496847', 'request_id': 'req-97507ba6-b7bf-4bee-b8e8-4db14e9746f7'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:34.916981 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-97507ba6-b7bf-4bee-b8e8-4db14e9746f7 admin admin] The token cache is being invalidate because project cf7d543376754ac680284678d2496847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:34.917328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-97507ba6-b7bf-4bee-b8e8-4db14e9746f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:34.918112 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-97507ba6-b7bf-4bee-b8e8-4db14e9746f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:34.920553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1090/2142] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:34 2022] DELETE /identity/v3/projects/cf7d543376754ac680284678d2496847 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:34.925307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e12930-417a-4c42-91d3-1163c36e4516 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:34.925760 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e12930-417a-4c42-91d3-1163c36e4516 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:34.926160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e12930-417a-4c42-91d3-1163c36e4516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:34.952605 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-a2e12930-417a-4c42-91d3-1163c36e4516 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:34.954217 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-a2e12930-417a-4c42-91d3-1163c36e4516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:35.028077 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f0161-fb54-4dcf-abbb-f2299f280a2a None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:35.029133 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f0161-fb54-4dcf-abbb-f2299f280a2a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:35.029964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f0161-fb54-4dcf-abbb-f2299f280a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:35.112536 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1053/2143] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:35.121160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55997a-4d1c-49fe-8a1f-9c96336f2bcf None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:35.121641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55997a-4d1c-49fe-8a1f-9c96336f2bcf None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:35.121779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-590f0161-fb54-4dcf-abbb-f2299f280a2a None None] MFA Rules not processed for user `2f6c2d623a504f20b55b19124797e97e`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:35.122102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55997a-4d1c-49fe-8a1f-9c96336f2bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:35.123031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-590f0161-fb54-4dcf-abbb-f2299f280a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:35.137278 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:35.152839 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-5c55997a-4d1c-49fe-8a1f-9c96336f2bcf None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:35.154944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5c55997a-4d1c-49fe-8a1f-9c96336f2bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:35.168887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1054/2144] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:35.170003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55997a-4d1c-49fe-8a1f-9c96336f2bcf None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:35.183272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55997a-4d1c-49fe-8a1f-9c96336f2bcf None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:35.192289 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0bf88-8601-4a84-83f5-27e811dc4139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:35.197438 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0bf88-8601-4a84-83f5-27e811dc4139 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:35.197438 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0bf88-8601-4a84-83f5-27e811dc4139 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:35.197438 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0bf88-8601-4a84-83f5-27e811dc4139 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:35.198728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0bf88-8601-4a84-83f5-27e811dc4139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:59:35.199045 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0bf88-8601-4a84-83f5-27e811dc4139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:35.200835 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0bf88-8601-4a84-83f5-27e811dc4139 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:35.218478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1055/2145] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:59:35.220047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0bf88-8601-4a84-83f5-27e811dc4139 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:35.232861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0bf88-8601-4a84-83f5-27e811dc4139 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:35.239010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b781e7-861c-4081-a91c-afa3ae60f654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:35.239742 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b781e7-861c-4081-a91c-afa3ae60f654 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:35.240777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b781e7-861c-4081-a91c-afa3ae60f654 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:35.241181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b781e7-861c-4081-a91c-afa3ae60f654 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:35.241835 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b781e7-861c-4081-a91c-afa3ae60f654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:35.247373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b781e7-861c-4081-a91c-afa3ae60f654 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:35.262725 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1091/2146] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:35.275791 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f0161-fb54-4dcf-abbb-f2299f280a2a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:35.276799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-590f0161-fb54-4dcf-abbb-f2299f280a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:35.349541 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1056/2147] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:35 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:59:35.351595 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b781e7-861c-4081-a91c-afa3ae60f654 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:35.353278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f0161-fb54-4dcf-abbb-f2299f280a2a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:35.355705 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d2b781e7-861c-4081-a91c-afa3ae60f654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:35.427117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1dc26-cb87-452e-80b0-d75c684126e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:35.427823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1dc26-cb87-452e-80b0-d75c684126e9 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:35.428104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1dc26-cb87-452e-80b0-d75c684126e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:35.428422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1dc26-cb87-452e-80b0-d75c684126e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:35.436157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:35.459080 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b781e7-861c-4081-a91c-afa3ae60f654 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:35.464169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bed24a-d70c-45f1-a741-d30ac8553a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:35.464846 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bed24a-d70c-45f1-a741-d30ac8553a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:35.465295 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bed24a-d70c-45f1-a741-d30ac8553a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:35.465572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bed24a-d70c-45f1-a741-d30ac8553a91 admin admin] PATH_INFO: `/v3/projects/a23eaa1afa8e4a698d7376363257d276` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:35.466990 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bed24a-d70c-45f1-a741-d30ac8553a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23eaa1afa8e4a698d7376363257d276)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:35.469191 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bed24a-d70c-45f1-a741-d30ac8553a91 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:35.504780 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1dc26-cb87-452e-80b0-d75c684126e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:35.506244 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1dc26-cb87-452e-80b0-d75c684126e9 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:35.517906 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1092/2148] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:59:35.518739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1dc26-cb87-452e-80b0-d75c684126e9 service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:35.530688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1dc26-cb87-452e-80b0-d75c684126e9 service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:35.535474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbff841-cfdd-42c5-9453-2d5117827e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:35.536136 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbff841-cfdd-42c5-9453-2d5117827e2f admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:35.536456 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbff841-cfdd-42c5-9453-2d5117827e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:35.536688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbff841-cfdd-42c5-9453-2d5117827e2f admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:35.537434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbff841-cfdd-42c5-9453-2d5117827e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:35.539279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbff841-cfdd-42c5-9453-2d5117827e2f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:35.559242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e1bed24a-d70c-45f1-a741-d30ac8553a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23eaa1afa8e4a698d7376363257d276', 'request_id': 'req-e1bed24a-d70c-45f1-a741-d30ac8553a91'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:35.616986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1093/2149] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:35 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:35.621863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbff841-cfdd-42c5-9453-2d5117827e2f admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:35.631799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbff841-cfdd-42c5-9453-2d5117827e2f admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:35.639762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e1bed24a-d70c-45f1-a741-d30ac8553a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23eaa1afa8e4a698d7376363257d276', 'request_id': 'req-e1bed24a-d70c-45f1-a741-d30ac8553a91'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:35.646874 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e1bed24a-d70c-45f1-a741-d30ac8553a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23eaa1afa8e4a698d7376363257d276', 'request_id': 'req-e1bed24a-d70c-45f1-a741-d30ac8553a91'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:35.661531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e1bed24a-d70c-45f1-a741-d30ac8553a91 admin admin] The token cache is being invalidate because project a23eaa1afa8e4a698d7376363257d276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:35.661818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e1bed24a-d70c-45f1-a741-d30ac8553a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:35.662505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e1bed24a-d70c-45f1-a741-d30ac8553a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:35.664392 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1057/2150] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:35 2022] DELETE /identity/v3/projects/a23eaa1afa8e4a698d7376363257d276 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:35.696808 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d13c3-e088-4d95-a73f-13c5f66f5378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:35.697544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d13c3-e088-4d95-a73f-13c5f66f5378 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:35.697883 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d13c3-e088-4d95-a73f-13c5f66f5378 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:35.698234 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d13c3-e088-4d95-a73f-13c5f66f5378 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:35.698911 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d13c3-e088-4d95-a73f-13c5f66f5378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:35.700629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d13c3-e088-4d95-a73f-13c5f66f5378 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:35.713108 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1094/2151] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:35.717171 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bed24a-d70c-45f1-a741-d30ac8553a91 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:35.718925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e1bed24a-d70c-45f1-a741-d30ac8553a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:35.734829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bed24a-d70c-45f1-a741-d30ac8553a91 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:35.740077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782b558-7a8d-489b-ba6f-9dae3a9e774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:35.740753 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782b558-7a8d-489b-ba6f-9dae3a9e774a admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:35.741115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782b558-7a8d-489b-ba6f-9dae3a9e774a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:35.741399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782b558-7a8d-489b-ba6f-9dae3a9e774a admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:35.742083 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782b558-7a8d-489b-ba6f-9dae3a9e774a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:35.744554 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782b558-7a8d-489b-ba6f-9dae3a9e774a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:35.755721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1058/2152] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:35.760895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d13c3-e088-4d95-a73f-13c5f66f5378 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:35.772574 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d13c3-e088-4d95-a73f-13c5f66f5378 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:35.778596 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9232595-94e1-4c77-a0e0-b2ba23502a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:35.779298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9232595-94e1-4c77-a0e0-b2ba23502a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:35.779586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9232595-94e1-4c77-a0e0-b2ba23502a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:35.779866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9232595-94e1-4c77-a0e0-b2ba23502a3b admin admin] PATH_INFO: `/v3/projects/5d972e5d638a44bf9ea32d9f2ab53071/users/34a21428d4a04c6dab61220dd3381625/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:35.798014 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9232595-94e1-4c77-a0e0-b2ba23502a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d972e5d638a44bf9ea32d9f2ab53071, user_id=34a21428d4a04c6dab61220dd3381625, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:35.801140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9232595-94e1-4c77-a0e0-b2ba23502a3b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:35.943012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1095/2153] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:35 2022] PUT /identity/v3/projects/5d972e5d638a44bf9ea32d9f2ab53071/users/34a21428d4a04c6dab61220dd3381625/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:35.954135 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207dd4e-5833-4ef9-8eab-5ae3ea2f9d17 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:35.954414 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207dd4e-5833-4ef9-8eab-5ae3ea2f9d17 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:35.954687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207dd4e-5833-4ef9-8eab-5ae3ea2f9d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:35.987441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-1207dd4e-5833-4ef9-8eab-5ae3ea2f9d17 None None] MFA Rules not processed for user `34a21428d4a04c6dab61220dd3381625`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:35.989174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1207dd4e-5833-4ef9-8eab-5ae3ea2f9d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:36.025709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:36.063929 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1059/2154] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:36.075425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9232595-94e1-4c77-a0e0-b2ba23502a3b admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:36.077178 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d9232595-94e1-4c77-a0e0-b2ba23502a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:36.144808 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9232595-94e1-4c77-a0e0-b2ba23502a3b admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:36.160849 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5d826-771e-4035-926b-466dfca6a14a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:36.160849 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5d826-771e-4035-926b-466dfca6a14a service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:36.160849 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5d826-771e-4035-926b-466dfca6a14a service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:36.160849 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5d826-771e-4035-926b-466dfca6a14a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:36.169121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5d826-771e-4035-926b-466dfca6a14a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:36.170813 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5d826-771e-4035-926b-466dfca6a14a service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:36.183278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1096/2155] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:36.237822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207dd4e-5833-4ef9-8eab-5ae3ea2f9d17 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:36.324625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207dd4e-5833-4ef9-8eab-5ae3ea2f9d17 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:36.334551 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59c49b-39ac-43e7-ac74-5de1fab9db41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:36.336069 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59c49b-39ac-43e7-ac74-5de1fab9db41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:36.336390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59c49b-39ac-43e7-ac74-5de1fab9db41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:36.338397 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59c49b-39ac-43e7-ac74-5de1fab9db41 admin admin] PATH_INFO: `/v3/users/34a21428d4a04c6dab61220dd3381625` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:36.338695 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59c49b-39ac-43e7-ac74-5de1fab9db41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a21428d4a04c6dab61220dd3381625)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:36.341564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59c49b-39ac-43e7-ac74-5de1fab9db41 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:36.577487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3c59c49b-39ac-43e7-ac74-5de1fab9db41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a21428d4a04c6dab61220dd3381625'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:36.578209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3c59c49b-39ac-43e7-ac74-5de1fab9db41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a21428d4a04c6dab61220dd3381625'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:36.578964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3c59c49b-39ac-43e7-ac74-5de1fab9db41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a21428d4a04c6dab61220dd3381625'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:36.593031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3c59c49b-39ac-43e7-ac74-5de1fab9db41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a21428d4a04c6dab61220dd3381625'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:36.603574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3c59c49b-39ac-43e7-ac74-5de1fab9db41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a21428d4a04c6dab61220dd3381625'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:36.754308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1060/2156] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:36 2022] DELETE /identity/v3/users/34a21428d4a04c6dab61220dd3381625 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:36.761367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd264b8-0358-4fbe-8d99-c7e223103380 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:36.761367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd264b8-0358-4fbe-8d99-c7e223103380 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:36.761367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd264b8-0358-4fbe-8d99-c7e223103380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:36.767642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:36.779862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-3cd264b8-0358-4fbe-8d99-c7e223103380 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:36.788142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-3cd264b8-0358-4fbe-8d99-c7e223103380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:36.857843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1097/2157] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:36.868102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59c49b-39ac-43e7-ac74-5de1fab9db41 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:36.870763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-3c59c49b-39ac-43e7-ac74-5de1fab9db41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:36.942850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59c49b-39ac-43e7-ac74-5de1fab9db41 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:36.946854 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2276c4-5a9a-4648-80c5-512aaa6d8f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:36.947868 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2276c4-5a9a-4648-80c5-512aaa6d8f6f service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:36.948115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2276c4-5a9a-4648-80c5-512aaa6d8f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:36.948400 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2276c4-5a9a-4648-80c5-512aaa6d8f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:36.960647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2276c4-5a9a-4648-80c5-512aaa6d8f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:36.962617 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2276c4-5a9a-4648-80c5-512aaa6d8f6f service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:36.973012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1061/2158] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:37.154222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:37.524536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd264b8-0358-4fbe-8d99-c7e223103380 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:37.527917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-3cd264b8-0358-4fbe-8d99-c7e223103380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:37.552714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd264b8-0358-4fbe-8d99-c7e223103380 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:37.579435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8d603-a6eb-4177-aabe-01a89b42ad60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:37.585661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8d603-a6eb-4177-aabe-01a89b42ad60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:37.585661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8d603-a6eb-4177-aabe-01a89b42ad60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:37.585661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8d603-a6eb-4177-aabe-01a89b42ad60 admin admin] PATH_INFO: `/v3/projects/5d972e5d638a44bf9ea32d9f2ab53071` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:37.586213 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8d603-a6eb-4177-aabe-01a89b42ad60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d972e5d638a44bf9ea32d9f2ab53071)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:37.590601 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8d603-a6eb-4177-aabe-01a89b42ad60 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:37.813091 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-eee8d603-a6eb-4177-aabe-01a89b42ad60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d972e5d638a44bf9ea32d9f2ab53071', 'request_id': 'req-eee8d603-a6eb-4177-aabe-01a89b42ad60'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:37.820383 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-eee8d603-a6eb-4177-aabe-01a89b42ad60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d972e5d638a44bf9ea32d9f2ab53071', 'request_id': 'req-eee8d603-a6eb-4177-aabe-01a89b42ad60'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:37.827654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-eee8d603-a6eb-4177-aabe-01a89b42ad60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d972e5d638a44bf9ea32d9f2ab53071', 'request_id': 'req-eee8d603-a6eb-4177-aabe-01a89b42ad60'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:37.909165 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-eee8d603-a6eb-4177-aabe-01a89b42ad60 admin admin] The token cache is being invalidate because project 5d972e5d638a44bf9ea32d9f2ab53071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:37.909461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-eee8d603-a6eb-4177-aabe-01a89b42ad60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:37.910160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-eee8d603-a6eb-4177-aabe-01a89b42ad60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:37.911674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1098/2159] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:37 2022] DELETE /identity/v3/projects/5d972e5d638a44bf9ea32d9f2ab53071 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:37.916631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e53d10-49a7-431f-91ec-20c6d79e8853 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:37.917147 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e53d10-49a7-431f-91ec-20c6d79e8853 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:37.917269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e53d10-49a7-431f-91ec-20c6d79e8853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:37.938679 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-71e53d10-49a7-431f-91ec-20c6d79e8853 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:37.939804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-71e53d10-49a7-431f-91ec-20c6d79e8853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:38.004991 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1062/2160] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:38.014590 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d08a5b-b719-4720-b2bf-624a57a60af5 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:38.014877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d08a5b-b719-4720-b2bf-624a57a60af5 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:38.015181 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d08a5b-b719-4720-b2bf-624a57a60af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:38.035720 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f2d08a5b-b719-4720-b2bf-624a57a60af5 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:38.037071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f2d08a5b-b719-4720-b2bf-624a57a60af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:38.045986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1099/2161] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:38.050189 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e53d10-49a7-431f-91ec-20c6d79e8853 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:38.060470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e53d10-49a7-431f-91ec-20c6d79e8853 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:38.065076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca63b98-c5b4-4b4c-8b6a-a15f4da31841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:38.065683 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca63b98-c5b4-4b4c-8b6a-a15f4da31841 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:38.065965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca63b98-c5b4-4b4c-8b6a-a15f4da31841 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:38.066238 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca63b98-c5b4-4b4c-8b6a-a15f4da31841 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:38.066951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca63b98-c5b4-4b4c-8b6a-a15f4da31841 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:59:38.067252 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca63b98-c5b4-4b4c-8b6a-a15f4da31841 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:38.068880 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca63b98-c5b4-4b4c-8b6a-a15f4da31841 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:38.081592 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1063/2162] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 22:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:59:38.085947 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d08a5b-b719-4720-b2bf-624a57a60af5 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:38.096555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d08a5b-b719-4720-b2bf-624a57a60af5 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:38.101508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a059b1-1abd-4864-9c61-43140e48c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:38.102108 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a059b1-1abd-4864-9c61-43140e48c166 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:38.102418 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a059b1-1abd-4864-9c61-43140e48c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:38.102687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a059b1-1abd-4864-9c61-43140e48c166 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:38.103364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a059b1-1abd-4864-9c61-43140e48c166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:38.105291 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a059b1-1abd-4864-9c61-43140e48c166 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:38.172918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1100/2163] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:38 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:38.177509 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca63b98-c5b4-4b4c-8b6a-a15f4da31841 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:38.194000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca63b98-c5b4-4b4c-8b6a-a15f4da31841 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:38.245883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddced3aa-8790-48c9-9716-84ac655803a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:38.246491 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddced3aa-8790-48c9-9716-84ac655803a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:38.246772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddced3aa-8790-48c9-9716-84ac655803a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:38.247046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddced3aa-8790-48c9-9716-84ac655803a2 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:38.247720 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddced3aa-8790-48c9-9716-84ac655803a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:38.249670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddced3aa-8790-48c9-9716-84ac655803a2 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:38.363084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1064/2164] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:38 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:38.364284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a059b1-1abd-4864-9c61-43140e48c166 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:38.377183 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a059b1-1abd-4864-9c61-43140e48c166 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:38.382527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e120c39-74e8-4d35-a229-d288a3a8da89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:38.383238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e120c39-74e8-4d35-a229-d288a3a8da89 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:38.383524 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e120c39-74e8-4d35-a229-d288a3a8da89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:38.383862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e120c39-74e8-4d35-a229-d288a3a8da89 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:38.385245 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e120c39-74e8-4d35-a229-d288a3a8da89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:38.388124 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e120c39-74e8-4d35-a229-d288a3a8da89 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:38.400266 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1101/2165] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:38.402964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e50dbd-5ed0-46ea-aa74-ebf4e83133d6 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:38.403340 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e50dbd-5ed0-46ea-aa74-ebf4e83133d6 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:38.403540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e50dbd-5ed0-46ea-aa74-ebf4e83133d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:38.404625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e120c39-74e8-4d35-a229-d288a3a8da89 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:38.415453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e120c39-74e8-4d35-a229-d288a3a8da89 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:38.424628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-38e50dbd-5ed0-46ea-aa74-ebf4e83133d6 None None] MFA Rules not processed for user `2f6c2d623a504f20b55b19124797e97e`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:38.425646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-38e50dbd-5ed0-46ea-aa74-ebf4e83133d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:38.426620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cf661-8fd4-4bb5-9980-4e63dafdb84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:38.427240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf661-8fd4-4bb5-9980-4e63dafdb84b admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:38.427524 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf661-8fd4-4bb5-9980-4e63dafdb84b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:38.428048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf661-8fd4-4bb5-9980-4e63dafdb84b admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:38.428776 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cf661-8fd4-4bb5-9980-4e63dafdb84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:38.430449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cf661-8fd4-4bb5-9980-4e63dafdb84b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:38.443517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1102/2166] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:38.447952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cf661-8fd4-4bb5-9980-4e63dafdb84b admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:38.459276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cf661-8fd4-4bb5-9980-4e63dafdb84b admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:38.464247 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d030ba-7549-4420-9d3c-480f0f734690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:38.464921 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d030ba-7549-4420-9d3c-480f0f734690 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:38.465202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d030ba-7549-4420-9d3c-480f0f734690 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:38.465485 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d030ba-7549-4420-9d3c-480f0f734690 admin admin] PATH_INFO: `/v3/projects/16e2a804be034bf0a59018d9956543c5/users/3d263cfd9bca462f9a894b9c58c62933/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:38.483762 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d030ba-7549-4420-9d3c-480f0f734690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e2a804be034bf0a59018d9956543c5, user_id=3d263cfd9bca462f9a894b9c58c62933, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:38.486546 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d030ba-7549-4420-9d3c-480f0f734690 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:38.496295 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1065/2167] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:38.567659 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1103/2168] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:38 2022] PUT /identity/v3/projects/16e2a804be034bf0a59018d9956543c5/users/3d263cfd9bca462f9a894b9c58c62933/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:38.579043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef683a-42fe-4f02-927d-dcf5523ccffc None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:38.579332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef683a-42fe-4f02-927d-dcf5523ccffc None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:38.579613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef683a-42fe-4f02-927d-dcf5523ccffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:38.611115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-c2ef683a-42fe-4f02-927d-dcf5523ccffc None None] MFA Rules not processed for user `3d263cfd9bca462f9a894b9c58c62933`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:38.612403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c2ef683a-42fe-4f02-927d-dcf5523ccffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:38.616708 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:38.696804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1066/2169] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:38.709329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d030ba-7549-4420-9d3c-480f0f734690 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:38.711898 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-51d030ba-7549-4420-9d3c-480f0f734690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:38.734024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:38.803449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d030ba-7549-4420-9d3c-480f0f734690 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:38.809491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd374a5d-9f81-458c-853e-3c0058fc9830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:38.810458 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd374a5d-9f81-458c-853e-3c0058fc9830 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:38.817311 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd374a5d-9f81-458c-853e-3c0058fc9830 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:38.817311 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd374a5d-9f81-458c-853e-3c0058fc9830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:38.824294 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd374a5d-9f81-458c-853e-3c0058fc9830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:38.825766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd374a5d-9f81-458c-853e-3c0058fc9830 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:38.835508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1104/2170] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:40.602629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523300e-c968-42de-b3dd-38e2106ba365 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:40.603127 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523300e-c968-42de-b3dd-38e2106ba365 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:40.603127 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523300e-c968-42de-b3dd-38e2106ba365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:40.624940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-9523300e-c968-42de-b3dd-38e2106ba365 None None] MFA Rules not processed for user `3d263cfd9bca462f9a894b9c58c62933`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:40.626285 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9523300e-c968-42de-b3dd-38e2106ba365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:40.637043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1067/2171] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 22:59:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:49.170491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=20 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:50.617872 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=28 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:01.533122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd374a5d-9f81-458c-853e-3c0058fc9830 service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:01.534671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-dd374a5d-9f81-458c-853e-3c0058fc9830 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:01.611274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd374a5d-9f81-458c-853e-3c0058fc9830 service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:01.615670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2acc4-bbd5-40da-b617-1945047f7b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:01.616385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2acc4-bbd5-40da-b617-1945047f7b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:01.616665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2acc4-bbd5-40da-b617-1945047f7b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:01.616943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2acc4-bbd5-40da-b617-1945047f7b67 admin admin] PATH_INFO: `/v3/users/39e089e6b2234e37bd6d140de7ef8d4a` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:01.622144 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2acc4-bbd5-40da-b617-1945047f7b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39e089e6b2234e37bd6d140de7ef8d4a)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:01.622144 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2acc4-bbd5-40da-b617-1945047f7b67 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:01.860249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d1b2acc4-bbd5-40da-b617-1945047f7b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39e089e6b2234e37bd6d140de7ef8d4a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:01.868020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d1b2acc4-bbd5-40da-b617-1945047f7b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39e089e6b2234e37bd6d140de7ef8d4a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:01.977271 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d1b2acc4-bbd5-40da-b617-1945047f7b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39e089e6b2234e37bd6d140de7ef8d4a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:01.977928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d1b2acc4-bbd5-40da-b617-1945047f7b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39e089e6b2234e37bd6d140de7ef8d4a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:01.991062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d1b2acc4-bbd5-40da-b617-1945047f7b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39e089e6b2234e37bd6d140de7ef8d4a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:01.997614 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1105/2172] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:00:01 2022] DELETE /identity/v3/users/39e089e6b2234e37bd6d140de7ef8d4a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:00:02.287496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523300e-c968-42de-b3dd-38e2106ba365 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:02.303354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523300e-c968-42de-b3dd-38e2106ba365 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:02.371854 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd60122-9cf3-4759-b28b-d63339808cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:02.372604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd60122-9cf3-4759-b28b-d63339808cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:02.372841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd60122-9cf3-4759-b28b-d63339808cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:02.373454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd60122-9cf3-4759-b28b-d63339808cfd admin admin] PATH_INFO: `/v3/projects/0a5cc96149984dd6b16b2a29165a698a` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:02.374663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd60122-9cf3-4759-b28b-d63339808cfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5cc96149984dd6b16b2a29165a698a)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:02.376866 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd60122-9cf3-4759-b28b-d63339808cfd admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:02.523770 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8fd60122-9cf3-4759-b28b-d63339808cfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5cc96149984dd6b16b2a29165a698a', 'request_id': 'req-8fd60122-9cf3-4759-b28b-d63339808cfd'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:02.617483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8fd60122-9cf3-4759-b28b-d63339808cfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5cc96149984dd6b16b2a29165a698a', 'request_id': 'req-8fd60122-9cf3-4759-b28b-d63339808cfd'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:02.625343 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8fd60122-9cf3-4759-b28b-d63339808cfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5cc96149984dd6b16b2a29165a698a', 'request_id': 'req-8fd60122-9cf3-4759-b28b-d63339808cfd'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:02.636445 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8fd60122-9cf3-4759-b28b-d63339808cfd admin admin] The token cache is being invalidate because project 0a5cc96149984dd6b16b2a29165a698a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:00:02.636756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8fd60122-9cf3-4759-b28b-d63339808cfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:02.637531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8fd60122-9cf3-4759-b28b-d63339808cfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:02.642464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1068/2173] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:00:02 2022] DELETE /identity/v3/projects/0a5cc96149984dd6b16b2a29165a698a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:00:02.643414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2acc4-bbd5-40da-b617-1945047f7b67 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:02.645240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d1b2acc4-bbd5-40da-b617-1945047f7b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:02.660856 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2acc4-bbd5-40da-b617-1945047f7b67 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:02.759768 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8475819-5033-492d-847d-b7654c5de4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:02.760452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8475819-5033-492d-847d-b7654c5de4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:02.760731 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8475819-5033-492d-847d-b7654c5de4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:02.761003 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8475819-5033-492d-847d-b7654c5de4c2 admin admin] PATH_INFO: `/v3/users/7b3a24e07f9843f383483e55cd47b7a1` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:02.763316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8475819-5033-492d-847d-b7654c5de4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b3a24e07f9843f383483e55cd47b7a1)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:02.765391 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8475819-5033-492d-847d-b7654c5de4c2 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:02.805082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:03.055851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b8475819-5033-492d-847d-b7654c5de4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b3a24e07f9843f383483e55cd47b7a1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:03.069542 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b8475819-5033-492d-847d-b7654c5de4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b3a24e07f9843f383483e55cd47b7a1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:03.143156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b8475819-5033-492d-847d-b7654c5de4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b3a24e07f9843f383483e55cd47b7a1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:03.144437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b8475819-5033-492d-847d-b7654c5de4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b3a24e07f9843f383483e55cd47b7a1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:03.169161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b8475819-5033-492d-847d-b7654c5de4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b3a24e07f9843f383483e55cd47b7a1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:03.178861 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1106/2174] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:00:02 2022] DELETE /identity/v3/users/7b3a24e07f9843f383483e55cd47b7a1 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:00:03.518895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd60122-9cf3-4759-b28b-d63339808cfd admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:03.519434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8fd60122-9cf3-4759-b28b-d63339808cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:03.545625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd60122-9cf3-4759-b28b-d63339808cfd admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:03.609928 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38409186-5d2c-4699-a405-f5034e2e9ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:03.610574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38409186-5d2c-4699-a405-f5034e2e9ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:03.610859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38409186-5d2c-4699-a405-f5034e2e9ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:03.611139 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38409186-5d2c-4699-a405-f5034e2e9ab0 admin admin] PATH_INFO: `/v3/projects/a774a3efab544584ac348a3085f8e583` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:03.612340 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38409186-5d2c-4699-a405-f5034e2e9ab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a774a3efab544584ac348a3085f8e583)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:03.614317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38409186-5d2c-4699-a405-f5034e2e9ab0 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:03.726559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:03.739519 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-38409186-5d2c-4699-a405-f5034e2e9ab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a774a3efab544584ac348a3085f8e583', 'request_id': 'req-38409186-5d2c-4699-a405-f5034e2e9ab0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:03.822799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-38409186-5d2c-4699-a405-f5034e2e9ab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a774a3efab544584ac348a3085f8e583', 'request_id': 'req-38409186-5d2c-4699-a405-f5034e2e9ab0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:03.831029 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-38409186-5d2c-4699-a405-f5034e2e9ab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a774a3efab544584ac348a3085f8e583', 'request_id': 'req-38409186-5d2c-4699-a405-f5034e2e9ab0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:03.842659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-38409186-5d2c-4699-a405-f5034e2e9ab0 admin admin] The token cache is being invalidate because project a774a3efab544584ac348a3085f8e583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:00:03.842952 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-38409186-5d2c-4699-a405-f5034e2e9ab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:03.843620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-38409186-5d2c-4699-a405-f5034e2e9ab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:03.845210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1069/2175] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:00:03 2022] DELETE /identity/v3/projects/a774a3efab544584ac348a3085f8e583 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:00:03.850632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccf1ad-8040-4995-8c92-ebbe364fe3f6 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:03.851115 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccf1ad-8040-4995-8c92-ebbe364fe3f6 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:03.851324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccf1ad-8040-4995-8c92-ebbe364fe3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:03.872025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-15ccf1ad-8040-4995-8c92-ebbe364fe3f6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:03.873364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-15ccf1ad-8040-4995-8c92-ebbe364fe3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:03.939834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1107/2176] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:03.948657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c6f16-37af-4608-a624-73a57879671e None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:03.948949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c6f16-37af-4608-a624-73a57879671e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:03.949886 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c6f16-37af-4608-a624-73a57879671e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:03.970748 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-386c6f16-37af-4608-a624-73a57879671e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:03.971914 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-386c6f16-37af-4608-a624-73a57879671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:03.980133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1070/2177] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:03.984655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccf1ad-8040-4995-8c92-ebbe364fe3f6 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:03.995608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccf1ad-8040-4995-8c92-ebbe364fe3f6 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:04.001206 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba5988-1113-4d68-bbba-eee638f44d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:04.001825 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba5988-1113-4d68-bbba-eee638f44d8f admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:04.002109 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba5988-1113-4d68-bbba-eee638f44d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:04.002382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba5988-1113-4d68-bbba-eee638f44d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:04.004249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba5988-1113-4d68-bbba-eee638f44d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:00:04.004249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba5988-1113-4d68-bbba-eee638f44d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:04.004992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba5988-1113-4d68-bbba-eee638f44d8f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:04.021768 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1108/2178] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:00:04.023023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c6f16-37af-4608-a624-73a57879671e None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:04.038399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c6f16-37af-4608-a624-73a57879671e None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:04.038399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa0282-1efe-490e-ba4e-e9e720914d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:04.038399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa0282-1efe-490e-ba4e-e9e720914d46 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:04.038399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa0282-1efe-490e-ba4e-e9e720914d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:04.038822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa0282-1efe-490e-ba4e-e9e720914d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:04.039350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa0282-1efe-490e-ba4e-e9e720914d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:04.041305 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa0282-1efe-490e-ba4e-e9e720914d46 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:04.129471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1071/2179] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:00:04 2022] POST /identity/v3/projects => generated 359 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:00:04.133848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba5988-1113-4d68-bbba-eee638f44d8f admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:04.144872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba5988-1113-4d68-bbba-eee638f44d8f admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:04.212441 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b1aa4-a5ec-453f-acdc-239bb6ff7e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:04.213072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b1aa4-a5ec-453f-acdc-239bb6ff7e3a admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:04.213360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b1aa4-a5ec-453f-acdc-239bb6ff7e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:04.213640 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b1aa4-a5ec-453f-acdc-239bb6ff7e3a admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:04.214287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b1aa4-a5ec-453f-acdc-239bb6ff7e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:04.216323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b1aa4-a5ec-453f-acdc-239bb6ff7e3a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:04.318219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1109/2180] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:00:04 2022] POST /identity/v3/users => generated 280 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:00:04.322457 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa0282-1efe-490e-ba4e-e9e720914d46 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:04.333428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa0282-1efe-490e-ba4e-e9e720914d46 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:04.338299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6df06-56a5-4cff-b095-d4e39a114ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:04.338911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6df06-56a5-4cff-b095-d4e39a114ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:04.339192 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6df06-56a5-4cff-b095-d4e39a114ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:04.339461 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6df06-56a5-4cff-b095-d4e39a114ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:04.340166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6df06-56a5-4cff-b095-d4e39a114ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:04.341847 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6df06-56a5-4cff-b095-d4e39a114ae1 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:04.352203 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1072/2181] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:00:04.357086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b1aa4-a5ec-453f-acdc-239bb6ff7e3a admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:04.367843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b1aa4-a5ec-453f-acdc-239bb6ff7e3a admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:04.373225 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a1f7b-f1ed-412c-adba-d84b6e0e0496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:04.373831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a1f7b-f1ed-412c-adba-d84b6e0e0496 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:04.374111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a1f7b-f1ed-412c-adba-d84b6e0e0496 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:04.374385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a1f7b-f1ed-412c-adba-d84b6e0e0496 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:04.375059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a1f7b-f1ed-412c-adba-d84b6e0e0496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:04.376735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a1f7b-f1ed-412c-adba-d84b6e0e0496 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:04.388707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1110/2182] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:00:04.392771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6df06-56a5-4cff-b095-d4e39a114ae1 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:04.403862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6df06-56a5-4cff-b095-d4e39a114ae1 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:04.409019 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154e4b7-e8ec-410c-98eb-0ace2603f962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:04.409879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154e4b7-e8ec-410c-98eb-0ace2603f962 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:04.410164 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154e4b7-e8ec-410c-98eb-0ace2603f962 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:04.410434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154e4b7-e8ec-410c-98eb-0ace2603f962 admin admin] PATH_INFO: `/v3/projects/9d58aa3ac86c469ebc0bd51e95bdcb23/users/4e2bb0a5a0a841fe883375481b41dccc/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:04.428267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154e4b7-e8ec-410c-98eb-0ace2603f962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d58aa3ac86c469ebc0bd51e95bdcb23, user_id=4e2bb0a5a0a841fe883375481b41dccc, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:04.431093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154e4b7-e8ec-410c-98eb-0ace2603f962 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:04.561227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1073/2183] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:00:04 2022] PUT /identity/v3/projects/9d58aa3ac86c469ebc0bd51e95bdcb23/users/4e2bb0a5a0a841fe883375481b41dccc/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:00:04.574478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fd367-77da-42da-900c-64aabfb68ba3 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:04.574478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fd367-77da-42da-900c-64aabfb68ba3 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:04.574478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fd367-77da-42da-900c-64aabfb68ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:04.584890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:04.607549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-277fd367-77da-42da-900c-64aabfb68ba3 None None] MFA Rules not processed for user `4e2bb0a5a0a841fe883375481b41dccc`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:04.608707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-277fd367-77da-42da-900c-64aabfb68ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:04.678155 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1111/2184] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:00:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:00:04.715960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154e4b7-e8ec-410c-98eb-0ace2603f962 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:04.717957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-a154e4b7-e8ec-410c-98eb-0ace2603f962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:04.776975 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154e4b7-e8ec-410c-98eb-0ace2603f962 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:04.782029 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf07dba-af17-4c0c-b213-998ac1c6de99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:04.782867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf07dba-af17-4c0c-b213-998ac1c6de99 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:04.783373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf07dba-af17-4c0c-b213-998ac1c6de99 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:04.783650 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf07dba-af17-4c0c-b213-998ac1c6de99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:04.793738 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf07dba-af17-4c0c-b213-998ac1c6de99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:04.795196 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf07dba-af17-4c0c-b213-998ac1c6de99 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:04.804090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1074/2185] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:00:04.820789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fd367-77da-42da-900c-64aabfb68ba3 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:04.884362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fd367-77da-42da-900c-64aabfb68ba3 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:04.890108 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246edd26-e4af-49aa-bb24-15a3c8131c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:04.903928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246edd26-e4af-49aa-bb24-15a3c8131c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:04.903928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246edd26-e4af-49aa-bb24-15a3c8131c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:04.903928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246edd26-e4af-49aa-bb24-15a3c8131c35 admin admin] PATH_INFO: `/v3/users/4e2bb0a5a0a841fe883375481b41dccc` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:04.903928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246edd26-e4af-49aa-bb24-15a3c8131c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2bb0a5a0a841fe883375481b41dccc)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:04.903928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246edd26-e4af-49aa-bb24-15a3c8131c35 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:05.055822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-246edd26-e4af-49aa-bb24-15a3c8131c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2bb0a5a0a841fe883375481b41dccc'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:05.065319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-246edd26-e4af-49aa-bb24-15a3c8131c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2bb0a5a0a841fe883375481b41dccc'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:05.138321 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-246edd26-e4af-49aa-bb24-15a3c8131c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2bb0a5a0a841fe883375481b41dccc'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:05.138965 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-246edd26-e4af-49aa-bb24-15a3c8131c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2bb0a5a0a841fe883375481b41dccc'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:05.151768 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-246edd26-e4af-49aa-bb24-15a3c8131c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2bb0a5a0a841fe883375481b41dccc'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:05.158771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1112/2186] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:00:04 2022] DELETE /identity/v3/users/4e2bb0a5a0a841fe883375481b41dccc => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:00:05.164575 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40004dbe-71a1-4c10-9787-4c153dcdd441 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:05.167260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40004dbe-71a1-4c10-9787-4c153dcdd441 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:05.167260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40004dbe-71a1-4c10-9787-4c153dcdd441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:05.186629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-40004dbe-71a1-4c10-9787-4c153dcdd441 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:05.187873 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-40004dbe-71a1-4c10-9787-4c153dcdd441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:05.253705 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:05.273662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1075/2187] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:05.286053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246edd26-e4af-49aa-bb24-15a3c8131c35 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:05.287694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-246edd26-e4af-49aa-bb24-15a3c8131c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:05.317862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:05.367183 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246edd26-e4af-49aa-bb24-15a3c8131c35 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:05.373747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b19ce-ca39-4378-8778-0615fbfcaa32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:05.373747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b19ce-ca39-4378-8778-0615fbfcaa32 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:05.373747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b19ce-ca39-4378-8778-0615fbfcaa32 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:05.373747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b19ce-ca39-4378-8778-0615fbfcaa32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:05.384638 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b19ce-ca39-4378-8778-0615fbfcaa32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:05.385608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b19ce-ca39-4378-8778-0615fbfcaa32 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:05.402376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1113/2188] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:00:06.041953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40004dbe-71a1-4c10-9787-4c153dcdd441 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:06.051102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-40004dbe-71a1-4c10-9787-4c153dcdd441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:06.069010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40004dbe-71a1-4c10-9787-4c153dcdd441 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:06.075973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eae6ea-d473-457b-85e8-0315a63cf5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:06.076998 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eae6ea-d473-457b-85e8-0315a63cf5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:06.077450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eae6ea-d473-457b-85e8-0315a63cf5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:06.077888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eae6ea-d473-457b-85e8-0315a63cf5ca admin admin] PATH_INFO: `/v3/projects/9d58aa3ac86c469ebc0bd51e95bdcb23` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:06.079359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eae6ea-d473-457b-85e8-0315a63cf5ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d58aa3ac86c469ebc0bd51e95bdcb23)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:06.082143 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eae6ea-d473-457b-85e8-0315a63cf5ca admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:06.182166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-11eae6ea-d473-457b-85e8-0315a63cf5ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d58aa3ac86c469ebc0bd51e95bdcb23', 'request_id': 'req-11eae6ea-d473-457b-85e8-0315a63cf5ca'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:06.268942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-11eae6ea-d473-457b-85e8-0315a63cf5ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d58aa3ac86c469ebc0bd51e95bdcb23', 'request_id': 'req-11eae6ea-d473-457b-85e8-0315a63cf5ca'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:06.277318 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-11eae6ea-d473-457b-85e8-0315a63cf5ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d58aa3ac86c469ebc0bd51e95bdcb23', 'request_id': 'req-11eae6ea-d473-457b-85e8-0315a63cf5ca'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:06.300495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-11eae6ea-d473-457b-85e8-0315a63cf5ca admin admin] The token cache is being invalidate because project 9d58aa3ac86c469ebc0bd51e95bdcb23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:00:06.301101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-11eae6ea-d473-457b-85e8-0315a63cf5ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:06.302240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-11eae6ea-d473-457b-85e8-0315a63cf5ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:06.303847 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1076/2189] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:00:06 2022] DELETE /identity/v3/projects/9d58aa3ac86c469ebc0bd51e95bdcb23 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:00:10.368711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c17338-8787-40dd-ade6-7467f3ee709d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:10.369283 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c17338-8787-40dd-ade6-7467f3ee709d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:10.369283 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c17338-8787-40dd-ade6-7467f3ee709d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:10.394661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-75c17338-8787-40dd-ade6-7467f3ee709d None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:10.395896 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-75c17338-8787-40dd-ade6-7467f3ee709d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:10.455392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1114/2190] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Aug 29 23:00:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:10.502946 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eae6ea-d473-457b-85e8-0315a63cf5ca admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:10.504405 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-11eae6ea-d473-457b-85e8-0315a63cf5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:10.584531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eae6ea-d473-457b-85e8-0315a63cf5ca admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:10.589999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17b32d-312e-44ef-8581-273e4705fb76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:10.590708 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17b32d-312e-44ef-8581-273e4705fb76 service swift] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:10.591060 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17b32d-312e-44ef-8581-273e4705fb76 service swift] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:10.591337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17b32d-312e-44ef-8581-273e4705fb76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:10.602271 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17b32d-312e-44ef-8581-273e4705fb76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:10.603873 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17b32d-312e-44ef-8581-273e4705fb76 service swift] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:10.613149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1077/2191] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 23:00:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:00:11.440209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddf802-4ccf-4036-9251-ee623764dfec None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:11.440209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddf802-4ccf-4036-9251-ee623764dfec None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:11.440209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddf802-4ccf-4036-9251-ee623764dfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:11.457426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-0eddf802-4ccf-4036-9251-ee623764dfec None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:11.458646 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-0eddf802-4ccf-4036-9251-ee623764dfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:11.467315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1115/2192] 10.222.0.72 () {58 vars in 967 bytes} [Mon Aug 29 23:00:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:00:11.480572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17b32d-312e-44ef-8581-273e4705fb76 service swift] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:11.491935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17b32d-312e-44ef-8581-273e4705fb76 service swift] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:11.497675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21067ea-245b-433d-8ffa-0916808efb05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:11.498278 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21067ea-245b-433d-8ffa-0916808efb05 service swift] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:11.498560 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21067ea-245b-433d-8ffa-0916808efb05 service swift] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:11.498834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21067ea-245b-433d-8ffa-0916808efb05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:11.507238 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21067ea-245b-433d-8ffa-0916808efb05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:11.508855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21067ea-245b-433d-8ffa-0916808efb05 service swift] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:11.518111 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1078/2193] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 23:00:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:00:12.185884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b00cc6-b2d7-442b-a8e4-efc42a8757a6 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:12.186169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b00cc6-b2d7-442b-a8e4-efc42a8757a6 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:12.186441 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b00cc6-b2d7-442b-a8e4-efc42a8757a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:12.207022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-13b00cc6-b2d7-442b-a8e4-efc42a8757a6 None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:12.208067 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-13b00cc6-b2d7-442b-a8e4-efc42a8757a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:12.221830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1116/2194] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Aug 29 23:00:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:12.241562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21067ea-245b-433d-8ffa-0916808efb05 service swift] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:12.253030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21067ea-245b-433d-8ffa-0916808efb05 service swift] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:12.261414 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665185a-1fe3-4081-9b52-324600c4520a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:12.261414 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665185a-1fe3-4081-9b52-324600c4520a service swift] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:12.261414 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665185a-1fe3-4081-9b52-324600c4520a service swift] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:12.261414 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665185a-1fe3-4081-9b52-324600c4520a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:12.283465 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665185a-1fe3-4081-9b52-324600c4520a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:12.285315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665185a-1fe3-4081-9b52-324600c4520a service swift] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:12.307934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1079/2195] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 23:00:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:00:12.878234 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71728577-7763-41e9-bb6c-2dbf0abef4eb None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:12.878759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71728577-7763-41e9-bb6c-2dbf0abef4eb None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:12.878759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71728577-7763-41e9-bb6c-2dbf0abef4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:12.915560 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-71728577-7763-41e9-bb6c-2dbf0abef4eb None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:12.917207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-71728577-7763-41e9-bb6c-2dbf0abef4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:12.930984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1117/2196] 10.222.0.72 () {58 vars in 967 bytes} [Mon Aug 29 23:00:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:12.943673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665185a-1fe3-4081-9b52-324600c4520a service swift] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:12.954740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665185a-1fe3-4081-9b52-324600c4520a service swift] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:12.959875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019137e8-4c96-46be-8c6b-9533203a3272 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:12.960514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019137e8-4c96-46be-8c6b-9533203a3272 service swift] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:12.960794 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019137e8-4c96-46be-8c6b-9533203a3272 service swift] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:12.961070 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019137e8-4c96-46be-8c6b-9533203a3272 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:12.970858 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019137e8-4c96-46be-8c6b-9533203a3272 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:12.972599 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019137e8-4c96-46be-8c6b-9533203a3272 service swift] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:12.981916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1080/2197] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 23:00:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:00:15.712721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71728577-7763-41e9-bb6c-2dbf0abef4eb None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:15.714179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-71728577-7763-41e9-bb6c-2dbf0abef4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:15.781925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71728577-7763-41e9-bb6c-2dbf0abef4eb None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:15.788223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71997ef8-d06a-46c0-b08a-197425c894f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:15.788870 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71997ef8-d06a-46c0-b08a-197425c894f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:15.789196 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71997ef8-d06a-46c0-b08a-197425c894f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:15.789476 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71997ef8-d06a-46c0-b08a-197425c894f4 admin admin] PATH_INFO: `/v3/users/3d263cfd9bca462f9a894b9c58c62933` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:15.790853 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71997ef8-d06a-46c0-b08a-197425c894f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d263cfd9bca462f9a894b9c58c62933)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:15.792832 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71997ef8-d06a-46c0-b08a-197425c894f4 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:16.029323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:16.032172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-71997ef8-d06a-46c0-b08a-197425c894f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d263cfd9bca462f9a894b9c58c62933'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:16.039212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-71997ef8-d06a-46c0-b08a-197425c894f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d263cfd9bca462f9a894b9c58c62933'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:16.108798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-71997ef8-d06a-46c0-b08a-197425c894f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d263cfd9bca462f9a894b9c58c62933'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:16.109462 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-71997ef8-d06a-46c0-b08a-197425c894f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d263cfd9bca462f9a894b9c58c62933'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:16.124446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-71997ef8-d06a-46c0-b08a-197425c894f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d263cfd9bca462f9a894b9c58c62933'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:16.130753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1118/2198] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:00:15 2022] DELETE /identity/v3/users/3d263cfd9bca462f9a894b9c58c62933 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:00:16.135727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986647b8-4045-4382-91fd-daec05f21add None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:16.136229 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986647b8-4045-4382-91fd-daec05f21add None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:16.136430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986647b8-4045-4382-91fd-daec05f21add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:16.158259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-986647b8-4045-4382-91fd-daec05f21add None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:16.159475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-986647b8-4045-4382-91fd-daec05f21add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:16.193471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:16.223686 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1081/2199] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:16.234063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71997ef8-d06a-46c0-b08a-197425c894f4 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:16.235543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-71997ef8-d06a-46c0-b08a-197425c894f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:16.296910 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71997ef8-d06a-46c0-b08a-197425c894f4 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:16.300744 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9075a33-857d-4615-aeb9-c412b34c0436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:16.301590 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9075a33-857d-4615-aeb9-c412b34c0436 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:16.301717 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9075a33-857d-4615-aeb9-c412b34c0436 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:16.302066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9075a33-857d-4615-aeb9-c412b34c0436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:16.312810 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9075a33-857d-4615-aeb9-c412b34c0436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:16.314694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9075a33-857d-4615-aeb9-c412b34c0436 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:16.324977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1119/2200] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:00:16.762235 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986647b8-4045-4382-91fd-daec05f21add None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:16.764004 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-986647b8-4045-4382-91fd-daec05f21add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:16.779338 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986647b8-4045-4382-91fd-daec05f21add None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:16.784397 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8b62c-6279-4182-842c-a9fd8088e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:16.786218 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8b62c-6279-4182-842c-a9fd8088e985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:16.790693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8b62c-6279-4182-842c-a9fd8088e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:16.790693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8b62c-6279-4182-842c-a9fd8088e985 admin admin] PATH_INFO: `/v3/projects/16e2a804be034bf0a59018d9956543c5` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:16.790693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8b62c-6279-4182-842c-a9fd8088e985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e2a804be034bf0a59018d9956543c5)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:16.790693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8b62c-6279-4182-842c-a9fd8088e985 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:16.893388 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-41c8b62c-6279-4182-842c-a9fd8088e985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e2a804be034bf0a59018d9956543c5', 'request_id': 'req-41c8b62c-6279-4182-842c-a9fd8088e985'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:16.955032 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-41c8b62c-6279-4182-842c-a9fd8088e985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e2a804be034bf0a59018d9956543c5', 'request_id': 'req-41c8b62c-6279-4182-842c-a9fd8088e985'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:16.963494 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-41c8b62c-6279-4182-842c-a9fd8088e985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e2a804be034bf0a59018d9956543c5', 'request_id': 'req-41c8b62c-6279-4182-842c-a9fd8088e985'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:16.974014 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-41c8b62c-6279-4182-842c-a9fd8088e985 admin admin] The token cache is being invalidate because project 16e2a804be034bf0a59018d9956543c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:00:16.974466 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-41c8b62c-6279-4182-842c-a9fd8088e985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:16.975055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-41c8b62c-6279-4182-842c-a9fd8088e985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:16.976918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1082/2201] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:00:16 2022] DELETE /identity/v3/projects/16e2a804be034bf0a59018d9956543c5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:00:16.982989 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec950edd-99aa-47a2-b612-cb20a0ae4ab4 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:16.983515 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec950edd-99aa-47a2-b612-cb20a0ae4ab4 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:16.983641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec950edd-99aa-47a2-b612-cb20a0ae4ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:17.005043 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-ec950edd-99aa-47a2-b612-cb20a0ae4ab4 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:17.006272 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ec950edd-99aa-47a2-b612-cb20a0ae4ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:17.096336 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1120/2202] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:17.108892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fc335-ae1f-4f41-b791-bffd19d8c956 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:17.109226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fc335-ae1f-4f41-b791-bffd19d8c956 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:17.109510 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fc335-ae1f-4f41-b791-bffd19d8c956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:17.132045 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-025fc335-ae1f-4f41-b791-bffd19d8c956 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:17.133350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-025fc335-ae1f-4f41-b791-bffd19d8c956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:17.142690 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1083/2203] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:17.147045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec950edd-99aa-47a2-b612-cb20a0ae4ab4 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:17.157892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec950edd-99aa-47a2-b612-cb20a0ae4ab4 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:17.162940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a04fad-6e21-47bf-ace8-9edf78434a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:17.163554 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a04fad-6e21-47bf-ace8-9edf78434a92 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:17.163834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a04fad-6e21-47bf-ace8-9edf78434a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:17.164221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a04fad-6e21-47bf-ace8-9edf78434a92 admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:17.164909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a04fad-6e21-47bf-ace8-9edf78434a92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:00:17.165219 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a04fad-6e21-47bf-ace8-9edf78434a92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:17.166833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a04fad-6e21-47bf-ace8-9edf78434a92 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:17.180170 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1121/2204] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:00:17.185193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fc335-ae1f-4f41-b791-bffd19d8c956 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:17.196424 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fc335-ae1f-4f41-b791-bffd19d8c956 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:17.201195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b128a01-0818-4e94-bc0f-3ce616252f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:17.201806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128a01-0818-4e94-bc0f-3ce616252f9b admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:17.202081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128a01-0818-4e94-bc0f-3ce616252f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:17.202345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128a01-0818-4e94-bc0f-3ce616252f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:17.202978 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b128a01-0818-4e94-bc0f-3ce616252f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:17.205023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b128a01-0818-4e94-bc0f-3ce616252f9b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:17.300540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1084/2205] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:00:17 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:00:17.304740 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a04fad-6e21-47bf-ace8-9edf78434a92 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:17.315893 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a04fad-6e21-47bf-ace8-9edf78434a92 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:17.375769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:17.387686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa9255-bb96-4c15-9c91-42034ff52427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:17.388724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa9255-bb96-4c15-9c91-42034ff52427 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:17.388724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa9255-bb96-4c15-9c91-42034ff52427 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:17.389014 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa9255-bb96-4c15-9c91-42034ff52427 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:17.389665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa9255-bb96-4c15-9c91-42034ff52427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:17.391584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa9255-bb96-4c15-9c91-42034ff52427 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:17.469221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1122/2206] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:00:17 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:00:17.473598 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b128a01-0818-4e94-bc0f-3ce616252f9b admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:17.485026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b128a01-0818-4e94-bc0f-3ce616252f9b admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:17.489890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e13ed0-aa94-47b8-a13a-48f87a379e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:17.490479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e13ed0-aa94-47b8-a13a-48f87a379e31 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:17.490757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e13ed0-aa94-47b8-a13a-48f87a379e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:17.491028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e13ed0-aa94-47b8-a13a-48f87a379e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:17.491729 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e13ed0-aa94-47b8-a13a-48f87a379e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:17.493335 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e13ed0-aa94-47b8-a13a-48f87a379e31 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:17.504051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1085/2207] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:00:17.508826 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa9255-bb96-4c15-9c91-42034ff52427 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:17.519937 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa9255-bb96-4c15-9c91-42034ff52427 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:17.524868 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccdd1d-4bf5-46fc-992e-b809ec51488f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:17.525479 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccdd1d-4bf5-46fc-992e-b809ec51488f admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:17.525760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccdd1d-4bf5-46fc-992e-b809ec51488f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:17.526034 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccdd1d-4bf5-46fc-992e-b809ec51488f admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:17.526674 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccdd1d-4bf5-46fc-992e-b809ec51488f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:17.529195 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccdd1d-4bf5-46fc-992e-b809ec51488f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:17.539845 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1123/2208] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:00:17.544708 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e13ed0-aa94-47b8-a13a-48f87a379e31 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:17.557790 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e13ed0-aa94-47b8-a13a-48f87a379e31 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:17.564009 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67015fc4-294d-4899-9dde-283877e62671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:17.565198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67015fc4-294d-4899-9dde-283877e62671 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:17.565671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67015fc4-294d-4899-9dde-283877e62671 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:17.566143 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67015fc4-294d-4899-9dde-283877e62671 admin admin] PATH_INFO: `/v3/projects/2eb5d88dd35a4ce4b8605a301f1a5038/users/ae2af5bc339341e8afce388894910fdd/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:17.583986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67015fc4-294d-4899-9dde-283877e62671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb5d88dd35a4ce4b8605a301f1a5038, user_id=ae2af5bc339341e8afce388894910fdd, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:17.586660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67015fc4-294d-4899-9dde-283877e62671 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:17.648398 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1086/2209] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:00:17 2022] PUT /identity/v3/projects/2eb5d88dd35a4ce4b8605a301f1a5038/users/ae2af5bc339341e8afce388894910fdd/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:00:17.660783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61700d5-4637-4fa8-b5fb-38cf21832655 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:17.661138 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61700d5-4637-4fa8-b5fb-38cf21832655 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:17.661509 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61700d5-4637-4fa8-b5fb-38cf21832655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:17.692586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-d61700d5-4637-4fa8-b5fb-38cf21832655 None None] MFA Rules not processed for user `ae2af5bc339341e8afce388894910fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:17.693712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d61700d5-4637-4fa8-b5fb-38cf21832655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:17.775728 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1124/2210] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:00:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:17.787789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67015fc4-294d-4899-9dde-283877e62671 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:17.789818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-67015fc4-294d-4899-9dde-283877e62671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:17.862720 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67015fc4-294d-4899-9dde-283877e62671 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:17.867983 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59da7d5-8ef8-4633-86d1-3c496e8e8453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:17.868972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59da7d5-8ef8-4633-86d1-3c496e8e8453 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:17.869326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59da7d5-8ef8-4633-86d1-3c496e8e8453 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:17.869718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59da7d5-8ef8-4633-86d1-3c496e8e8453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:17.878217 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:17.882288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59da7d5-8ef8-4633-86d1-3c496e8e8453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:17.883980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59da7d5-8ef8-4633-86d1-3c496e8e8453 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:17.895767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1087/2211] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:00:19.031943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a59f4-2157-43bc-8647-176ec6274be7 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:19.038143 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a59f4-2157-43bc-8647-176ec6274be7 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:19.038143 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a59f4-2157-43bc-8647-176ec6274be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:19.054516 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-b20a59f4-2157-43bc-8647-176ec6274be7 None None] MFA Rules not processed for user `c50a3ef2f80040f9a4372568ee984096`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:19.055734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b20a59f4-2157-43bc-8647-176ec6274be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:19.125450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1125/2212] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:00:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:24.268618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bcda5-1d77-4940-b4df-0eff322cdda6 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:24.269149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bcda5-1d77-4940-b4df-0eff322cdda6 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:24.269149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bcda5-1d77-4940-b4df-0eff322cdda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:24.291629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-cb2bcda5-1d77-4940-b4df-0eff322cdda6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:24.293570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-cb2bcda5-1d77-4940-b4df-0eff322cdda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:24.381567 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1088/2213] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 23:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:00:24.416633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a59f4-2157-43bc-8647-176ec6274be7 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:24.416633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b20a59f4-2157-43bc-8647-176ec6274be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:24.530935 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:24.537547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a59f4-2157-43bc-8647-176ec6274be7 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:24.544751 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f669586-58ad-47ac-a881-d8c44f35d7a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:24.545377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f669586-58ad-47ac-a881-d8c44f35d7a0 service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:24.545660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f669586-58ad-47ac-a881-d8c44f35d7a0 service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:24.545936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f669586-58ad-47ac-a881-d8c44f35d7a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:24.563941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f669586-58ad-47ac-a881-d8c44f35d7a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:24.566038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f669586-58ad-47ac-a881-d8c44f35d7a0 service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:24.582671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1126/2214] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:00:29.997524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bcda5-1d77-4940-b4df-0eff322cdda6 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:30.008181 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bcda5-1d77-4940-b4df-0eff322cdda6 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:30.013210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0443a2-c6d9-42bc-b273-f4ec4c32b33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:30.013927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0443a2-c6d9-42bc-b273-f4ec4c32b33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:30.014206 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0443a2-c6d9-42bc-b273-f4ec4c32b33c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:30.014475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0443a2-c6d9-42bc-b273-f4ec4c32b33c admin admin] PATH_INFO: `/v3/users/ae2af5bc339341e8afce388894910fdd` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:30.015591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0443a2-c6d9-42bc-b273-f4ec4c32b33c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2af5bc339341e8afce388894910fdd)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:30.017759 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0443a2-c6d9-42bc-b273-f4ec4c32b33c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:30.187364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3c0443a2-c6d9-42bc-b273-f4ec4c32b33c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2af5bc339341e8afce388894910fdd'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:30.188318 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3c0443a2-c6d9-42bc-b273-f4ec4c32b33c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2af5bc339341e8afce388894910fdd'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:30.188957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3c0443a2-c6d9-42bc-b273-f4ec4c32b33c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2af5bc339341e8afce388894910fdd'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:30.201945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3c0443a2-c6d9-42bc-b273-f4ec4c32b33c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2af5bc339341e8afce388894910fdd'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:30.209874 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3c0443a2-c6d9-42bc-b273-f4ec4c32b33c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2af5bc339341e8afce388894910fdd'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:30.304023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1089/2215] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:00:29 2022] DELETE /identity/v3/users/ae2af5bc339341e8afce388894910fdd => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:00:30.309142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cba52-bc43-42da-a0fe-a28f01d3bd58 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:30.309602 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cba52-bc43-42da-a0fe-a28f01d3bd58 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:30.309694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cba52-bc43-42da-a0fe-a28f01d3bd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:30.330280 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-c96cba52-bc43-42da-a0fe-a28f01d3bd58 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:30.331857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c96cba52-bc43-42da-a0fe-a28f01d3bd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:30.394776 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1127/2216] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:00:30.404345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0443a2-c6d9-42bc-b273-f4ec4c32b33c admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:30.405898 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-3c0443a2-c6d9-42bc-b273-f4ec4c32b33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:30.468049 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0443a2-c6d9-42bc-b273-f4ec4c32b33c admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:30.473102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b25043-b383-423f-bf24-9e38aba52bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:30.473719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b25043-b383-423f-bf24-9e38aba52bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:30.473998 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b25043-b383-423f-bf24-9e38aba52bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:30.474268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b25043-b383-423f-bf24-9e38aba52bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:30.483620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b25043-b383-423f-bf24-9e38aba52bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:30.485308 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b25043-b383-423f-bf24-9e38aba52bd3 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:30.495025 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1090/2217] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:00:30.951595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cba52-bc43-42da-a0fe-a28f01d3bd58 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:30.953233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c96cba52-bc43-42da-a0fe-a28f01d3bd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:30.966186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cba52-bc43-42da-a0fe-a28f01d3bd58 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:30.971324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2d27e-2adc-4ee4-b5d5-c45c4327d9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:30.972150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2d27e-2adc-4ee4-b5d5-c45c4327d9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:30.972469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2d27e-2adc-4ee4-b5d5-c45c4327d9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:30.972741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2d27e-2adc-4ee4-b5d5-c45c4327d9dd admin admin] PATH_INFO: `/v3/projects/2eb5d88dd35a4ce4b8605a301f1a5038` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:30.973905 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2d27e-2adc-4ee4-b5d5-c45c4327d9dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eb5d88dd35a4ce4b8605a301f1a5038)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:30.976823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2d27e-2adc-4ee4-b5d5-c45c4327d9dd admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:31.077448 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-e4a2d27e-2adc-4ee4-b5d5-c45c4327d9dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eb5d88dd35a4ce4b8605a301f1a5038', 'request_id': 'req-e4a2d27e-2adc-4ee4-b5d5-c45c4327d9dd'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:31.084355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-e4a2d27e-2adc-4ee4-b5d5-c45c4327d9dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eb5d88dd35a4ce4b8605a301f1a5038', 'request_id': 'req-e4a2d27e-2adc-4ee4-b5d5-c45c4327d9dd'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:31.090137 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-e4a2d27e-2adc-4ee4-b5d5-c45c4327d9dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eb5d88dd35a4ce4b8605a301f1a5038', 'request_id': 'req-e4a2d27e-2adc-4ee4-b5d5-c45c4327d9dd'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:31.155939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-e4a2d27e-2adc-4ee4-b5d5-c45c4327d9dd admin admin] The token cache is being invalidate because project 2eb5d88dd35a4ce4b8605a301f1a5038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:00:31.156309 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-e4a2d27e-2adc-4ee4-b5d5-c45c4327d9dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:31.157034 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-e4a2d27e-2adc-4ee4-b5d5-c45c4327d9dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:31.158865 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1128/2218] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:00:30 2022] DELETE /identity/v3/projects/2eb5d88dd35a4ce4b8605a301f1a5038 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:00:31.163822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a50f24-0c20-4114-8c2e-e7e5e9facae9 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:31.164367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a50f24-0c20-4114-8c2e-e7e5e9facae9 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:31.164475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a50f24-0c20-4114-8c2e-e7e5e9facae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:31.186097 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-88a50f24-0c20-4114-8c2e-e7e5e9facae9 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:31.187366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-88a50f24-0c20-4114-8c2e-e7e5e9facae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:31.195386 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:31.257155 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1091/2219] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:31.264836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c12ee-14e0-4113-b041-2b2b85bb6861 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:31.265122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c12ee-14e0-4113-b041-2b2b85bb6861 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:31.265400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c12ee-14e0-4113-b041-2b2b85bb6861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:31.287881 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f60c12ee-14e0-4113-b041-2b2b85bb6861 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:31.289683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f60c12ee-14e0-4113-b041-2b2b85bb6861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:31.298636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1129/2220] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:00:31.303734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a50f24-0c20-4114-8c2e-e7e5e9facae9 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:31.314091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a50f24-0c20-4114-8c2e-e7e5e9facae9 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:31.319838 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3875dd7-97f0-4117-8e16-144d43a35ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:31.320524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3875dd7-97f0-4117-8e16-144d43a35ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:31.320802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3875dd7-97f0-4117-8e16-144d43a35ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:31.321072 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3875dd7-97f0-4117-8e16-144d43a35ba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:31.321725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3875dd7-97f0-4117-8e16-144d43a35ba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:00:31.322030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3875dd7-97f0-4117-8e16-144d43a35ba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:31.323651 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3875dd7-97f0-4117-8e16-144d43a35ba0 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:31.336755 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1092/2221] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:00:31.341241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c12ee-14e0-4113-b041-2b2b85bb6861 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:31.352038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c12ee-14e0-4113-b041-2b2b85bb6861 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:31.357455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfc43f-f4f8-4c19-ab8b-ca0327de9d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:31.358075 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfc43f-f4f8-4c19-ab8b-ca0327de9d27 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:31.358359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfc43f-f4f8-4c19-ab8b-ca0327de9d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:31.358644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfc43f-f4f8-4c19-ab8b-ca0327de9d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:31.359402 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfc43f-f4f8-4c19-ab8b-ca0327de9d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:31.362086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfc43f-f4f8-4c19-ab8b-ca0327de9d27 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:31.457798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1130/2222] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:00:31 2022] POST /identity/v3/projects => generated 395 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:00:31.459304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3875dd7-97f0-4117-8e16-144d43a35ba0 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:31.470541 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3875dd7-97f0-4117-8e16-144d43a35ba0 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:31.533186 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5246dd-193a-469d-b3d0-06b2099b836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:31.533812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5246dd-193a-469d-b3d0-06b2099b836a admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:31.534095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5246dd-193a-469d-b3d0-06b2099b836a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:31.534372 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5246dd-193a-469d-b3d0-06b2099b836a admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:31.535011 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5246dd-193a-469d-b3d0-06b2099b836a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:31.537008 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5246dd-193a-469d-b3d0-06b2099b836a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:31.648690 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1093/2223] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:00:31 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:00:31.652900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfc43f-f4f8-4c19-ab8b-ca0327de9d27 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:31.664206 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfc43f-f4f8-4c19-ab8b-ca0327de9d27 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:31.668854 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d02ab7-7212-4b8e-b41c-64b0ea0c5bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:31.669453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d02ab7-7212-4b8e-b41c-64b0ea0c5bcb admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:31.669775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d02ab7-7212-4b8e-b41c-64b0ea0c5bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:31.669990 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d02ab7-7212-4b8e-b41c-64b0ea0c5bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:31.670627 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d02ab7-7212-4b8e-b41c-64b0ea0c5bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:31.673313 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d02ab7-7212-4b8e-b41c-64b0ea0c5bcb admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:31.686639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1131/2224] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:00:31.690957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5246dd-193a-469d-b3d0-06b2099b836a admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:31.703395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5246dd-193a-469d-b3d0-06b2099b836a admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:31.709927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2c917-8d7b-4cfa-b59d-4dd7ad0e725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:31.713921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2c917-8d7b-4cfa-b59d-4dd7ad0e725d admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:31.713921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2c917-8d7b-4cfa-b59d-4dd7ad0e725d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:31.713921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2c917-8d7b-4cfa-b59d-4dd7ad0e725d admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:31.713921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2c917-8d7b-4cfa-b59d-4dd7ad0e725d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:31.713921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2c917-8d7b-4cfa-b59d-4dd7ad0e725d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:31.726053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1094/2225] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:00:31.730287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d02ab7-7212-4b8e-b41c-64b0ea0c5bcb admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:31.742504 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d02ab7-7212-4b8e-b41c-64b0ea0c5bcb admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:31.750738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d12da-de48-457d-b105-ad5ad7c64f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:31.751897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d12da-de48-457d-b105-ad5ad7c64f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:31.752185 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d12da-de48-457d-b105-ad5ad7c64f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:31.752494 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d12da-de48-457d-b105-ad5ad7c64f3d admin admin] PATH_INFO: `/v3/projects/57166a9e39184cd8a808c2b6d377df70/users/334b3d664a164f279f2030a69121673d/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:31.773147 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d12da-de48-457d-b105-ad5ad7c64f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=57166a9e39184cd8a808c2b6d377df70, user_id=334b3d664a164f279f2030a69121673d, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:31.775804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d12da-de48-457d-b105-ad5ad7c64f3d admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:31.858629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1132/2226] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:00:31 2022] PUT /identity/v3/projects/57166a9e39184cd8a808c2b6d377df70/users/334b3d664a164f279f2030a69121673d/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:00:31.869935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4b2eb-83da-4a20-bebc-c8206154aa22 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:31.870221 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4b2eb-83da-4a20-bebc-c8206154aa22 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:31.870559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4b2eb-83da-4a20-bebc-c8206154aa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:31.901202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-ccf4b2eb-83da-4a20-bebc-c8206154aa22 None None] MFA Rules not processed for user `334b3d664a164f279f2030a69121673d`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:31.902527 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-ccf4b2eb-83da-4a20-bebc-c8206154aa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:31.990261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1095/2227] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:00:31 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:32.002295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d12da-de48-457d-b105-ad5ad7c64f3d admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:32.007959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-838d12da-de48-457d-b105-ad5ad7c64f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:32.021203 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:32.068800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d12da-de48-457d-b105-ad5ad7c64f3d admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:32.095842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6528dc-3c7c-46a6-a64a-5f791451ac62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:32.096551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6528dc-3c7c-46a6-a64a-5f791451ac62 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:32.106787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6528dc-3c7c-46a6-a64a-5f791451ac62 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:32.106787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6528dc-3c7c-46a6-a64a-5f791451ac62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:32.110243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6528dc-3c7c-46a6-a64a-5f791451ac62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:32.111756 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6528dc-3c7c-46a6-a64a-5f791451ac62 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:32.121427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1133/2228] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:32 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:00:32.501936 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a652ac-d3c6-41cf-9b4c-439f23451c02 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:32.502471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a652ac-d3c6-41cf-9b4c-439f23451c02 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:32.503210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a652ac-d3c6-41cf-9b4c-439f23451c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:32.518238 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:32.525014 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-65a652ac-d3c6-41cf-9b4c-439f23451c02 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:32.526244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-65a652ac-d3c6-41cf-9b4c-439f23451c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:32.611488 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1096/2229] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 23:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:32.651204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6528dc-3c7c-46a6-a64a-5f791451ac62 service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:32.658443 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-eb6528dc-3c7c-46a6-a64a-5f791451ac62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:32.749057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6528dc-3c7c-46a6-a64a-5f791451ac62 service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:32.755875 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f509f5-491d-4f0c-af3f-9c9ffdfd7b6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:32.756536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f509f5-491d-4f0c-af3f-9c9ffdfd7b6c service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:32.756815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f509f5-491d-4f0c-af3f-9c9ffdfd7b6c service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:32.757089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f509f5-491d-4f0c-af3f-9c9ffdfd7b6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:32.766468 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f509f5-491d-4f0c-af3f-9c9ffdfd7b6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:32.768085 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f509f5-491d-4f0c-af3f-9c9ffdfd7b6c service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:32.778748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1134/2230] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:00:36.489041 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fdd1f-dfe6-4a29-bc29-2a3f6d5437d3 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:36.491800 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fdd1f-dfe6-4a29-bc29-2a3f6d5437d3 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:36.491800 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fdd1f-dfe6-4a29-bc29-2a3f6d5437d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:36.510341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-8f2fdd1f-dfe6-4a29-bc29-2a3f6d5437d3 None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:36.514740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8f2fdd1f-dfe6-4a29-bc29-2a3f6d5437d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:36.573562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1097/2231] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Aug 29 23:00:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:36.587550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f509f5-491d-4f0c-af3f-9c9ffdfd7b6c service nova] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:36.589065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-91f509f5-491d-4f0c-af3f-9c9ffdfd7b6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:36.666378 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f509f5-491d-4f0c-af3f-9c9ffdfd7b6c service nova] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:36.672014 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4799ac-455c-4319-b74f-dfdfff99dd55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:36.672662 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4799ac-455c-4319-b74f-dfdfff99dd55 service swift] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:36.672942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4799ac-455c-4319-b74f-dfdfff99dd55 service swift] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:36.673213 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4799ac-455c-4319-b74f-dfdfff99dd55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:36.682534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4799ac-455c-4319-b74f-dfdfff99dd55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:36.684063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4799ac-455c-4319-b74f-dfdfff99dd55 service swift] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:36.692382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1135/2232] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 23:00:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:00:38.190136 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fdd1f-dfe6-4a29-bc29-2a3f6d5437d3 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:38.203357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fdd1f-dfe6-4a29-bc29-2a3f6d5437d3 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:38.209527 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4e6a7-5335-4d6d-a49a-9b68db661e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:38.210436 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e6a7-5335-4d6d-a49a-9b68db661e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:38.210756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e6a7-5335-4d6d-a49a-9b68db661e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:38.211046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e6a7-5335-4d6d-a49a-9b68db661e5c admin admin] PATH_INFO: `/v3/users/334b3d664a164f279f2030a69121673d` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:38.212427 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4e6a7-5335-4d6d-a49a-9b68db661e5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=334b3d664a164f279f2030a69121673d)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:38.215094 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4e6a7-5335-4d6d-a49a-9b68db661e5c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:38.432265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b7d4e6a7-5335-4d6d-a49a-9b68db661e5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '334b3d664a164f279f2030a69121673d'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:38.433548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b7d4e6a7-5335-4d6d-a49a-9b68db661e5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '334b3d664a164f279f2030a69121673d'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:38.434411 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b7d4e6a7-5335-4d6d-a49a-9b68db661e5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '334b3d664a164f279f2030a69121673d'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:38.465111 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b7d4e6a7-5335-4d6d-a49a-9b68db661e5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '334b3d664a164f279f2030a69121673d'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:38.474879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b7d4e6a7-5335-4d6d-a49a-9b68db661e5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '334b3d664a164f279f2030a69121673d'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:38.550771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1098/2233] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:00:38 2022] DELETE /identity/v3/users/334b3d664a164f279f2030a69121673d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:00:38.555617 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf3af5-71ab-4ca8-aea2-e0244d5d9873 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:38.556222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf3af5-71ab-4ca8-aea2-e0244d5d9873 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:38.556363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf3af5-71ab-4ca8-aea2-e0244d5d9873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:38.585209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-08cf3af5-71ab-4ca8-aea2-e0244d5d9873 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:38.587370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-08cf3af5-71ab-4ca8-aea2-e0244d5d9873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:38.614706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:38.663747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87649d55-772e-4069-9d58-da1408b27067 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:38.664491 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87649d55-772e-4069-9d58-da1408b27067 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:38.670287 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87649d55-772e-4069-9d58-da1408b27067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:38.670586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1136/2234] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:38.679562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf3af5-71ab-4ca8-aea2-e0244d5d9873 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:38.684407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-08cf3af5-71ab-4ca8-aea2-e0244d5d9873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:38.697571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-87649d55-772e-4069-9d58-da1408b27067 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:38.699338 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-87649d55-772e-4069-9d58-da1408b27067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:38.709511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1099/2235] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 23:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:38.764577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87649d55-772e-4069-9d58-da1408b27067 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:38.766377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-87649d55-772e-4069-9d58-da1408b27067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:38.772305 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf3af5-71ab-4ca8-aea2-e0244d5d9873 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:38.780679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b3ccd-c760-41b6-9c86-ced838d8d579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:38.781318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b3ccd-c760-41b6-9c86-ced838d8d579 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:38.781597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b3ccd-c760-41b6-9c86-ced838d8d579 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:38.781874 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b3ccd-c760-41b6-9c86-ced838d8d579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:38.794001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:38.796701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b3ccd-c760-41b6-9c86-ced838d8d579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:38.802300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b3ccd-c760-41b6-9c86-ced838d8d579 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:38.821590 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1137/2236] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:00:38.921482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87649d55-772e-4069-9d58-da1408b27067 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:38.943248 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f289810-9d98-439f-bdf4-5a544dafe519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:38.943874 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f289810-9d98-439f-bdf4-5a544dafe519 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:38.944154 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f289810-9d98-439f-bdf4-5a544dafe519 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:38.944458 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f289810-9d98-439f-bdf4-5a544dafe519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:38.961351 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f289810-9d98-439f-bdf4-5a544dafe519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:38.964711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f289810-9d98-439f-bdf4-5a544dafe519 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:38.979709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1100/2237] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:00:39.390157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b3ccd-c760-41b6-9c86-ced838d8d579 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:39.391690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-943b3ccd-c760-41b6-9c86-ced838d8d579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:39.416485 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b3ccd-c760-41b6-9c86-ced838d8d579 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:39.442076 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a2397-697e-437a-bed7-33a0dc8c5964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:39.442660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a2397-697e-437a-bed7-33a0dc8c5964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:39.442950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a2397-697e-437a-bed7-33a0dc8c5964 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:39.443230 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a2397-697e-437a-bed7-33a0dc8c5964 admin admin] PATH_INFO: `/v3/projects/57166a9e39184cd8a808c2b6d377df70` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:39.445994 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a2397-697e-437a-bed7-33a0dc8c5964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57166a9e39184cd8a808c2b6d377df70)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:39.448943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a2397-697e-437a-bed7-33a0dc8c5964 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:39.582953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-407a2397-697e-437a-bed7-33a0dc8c5964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57166a9e39184cd8a808c2b6d377df70', 'request_id': 'req-407a2397-697e-437a-bed7-33a0dc8c5964'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:39.590465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-407a2397-697e-437a-bed7-33a0dc8c5964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57166a9e39184cd8a808c2b6d377df70', 'request_id': 'req-407a2397-697e-437a-bed7-33a0dc8c5964'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:39.604912 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-407a2397-697e-437a-bed7-33a0dc8c5964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57166a9e39184cd8a808c2b6d377df70', 'request_id': 'req-407a2397-697e-437a-bed7-33a0dc8c5964'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:40.041755 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-407a2397-697e-437a-bed7-33a0dc8c5964 admin admin] The token cache is being invalidate because project 57166a9e39184cd8a808c2b6d377df70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:00:40.045127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-407a2397-697e-437a-bed7-33a0dc8c5964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:40.045127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-407a2397-697e-437a-bed7-33a0dc8c5964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:00:40.045127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1138/2238] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:00:39 2022] DELETE /identity/v3/projects/57166a9e39184cd8a808c2b6d377df70 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:00:49.023325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=26 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:50.038345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=68,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:51.547768 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b9997-8359-4935-9376-c5c634d56de5 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:51.548347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b9997-8359-4935-9376-c5c634d56de5 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:51.548347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b9997-8359-4935-9376-c5c634d56de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:51.569352 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-5d2b9997-8359-4935-9376-c5c634d56de5 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:51.570593 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5d2b9997-8359-4935-9376-c5c634d56de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:51.635029 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1101/2239] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 23:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:51.660407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a2397-697e-437a-bed7-33a0dc8c5964 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:51.662158 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-407a2397-697e-437a-bed7-33a0dc8c5964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:51.746362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a2397-697e-437a-bed7-33a0dc8c5964 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:51.752561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68d913-0335-45a6-a79c-a6a1e80219eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:51.753012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d913-0335-45a6-a79c-a6a1e80219eb service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:51.753290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d913-0335-45a6-a79c-a6a1e80219eb service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:51.753565 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d913-0335-45a6-a79c-a6a1e80219eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:51.764572 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68d913-0335-45a6-a79c-a6a1e80219eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:51.766287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68d913-0335-45a6-a79c-a6a1e80219eb service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:51.777950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1139/2240] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:00:56.907771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ce122-7817-41c8-b161-8737bb2f397e None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:56.908348 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ce122-7817-41c8-b161-8737bb2f397e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:56.908572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ce122-7817-41c8-b161-8737bb2f397e None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:56.910670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1102/2241] 10.222.0.72 () {54 vars in 921 bytes} [Mon Aug 29 23:00:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:00:56.917803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077a649-7796-482f-8fa2-59befe472893 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:56.918302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077a649-7796-482f-8fa2-59befe472893 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:56.918398 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077a649-7796-482f-8fa2-59befe472893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:56.942430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-e077a649-7796-482f-8fa2-59befe472893 None None] MFA Rules not processed for user `0be09bd9ba7443aaa31879f56ca4aad1`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:56.942430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e077a649-7796-482f-8fa2-59befe472893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:56.952513 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1140/2242] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Aug 29 23:00:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:56.965740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ce122-7817-41c8-b161-8737bb2f397e None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:56.967556 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d79ce122-7817-41c8-b161-8737bb2f397e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:57.030643 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ce122-7817-41c8-b161-8737bb2f397e None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:57.034311 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5bfc8-5aae-41f4-a080-0a310bfbc9a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e72cc048a0418cac062d68b8df402f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:57.034923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5bfc8-5aae-41f4-a080-0a310bfbc9a2 service glance] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:57.035205 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5bfc8-5aae-41f4-a080-0a310bfbc9a2 service glance] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:57.035490 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5bfc8-5aae-41f4-a080-0a310bfbc9a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:57.046940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5bfc8-5aae-41f4-a080-0a310bfbc9a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:57.048399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5bfc8-5aae-41f4-a080-0a310bfbc9a2 service glance] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:57.060281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1103/2243] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:00:57.294771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2fc28-4c0a-474a-9d5c-b6fa253f055f None None] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:57.295052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2fc28-4c0a-474a-9d5c-b6fa253f055f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:57.295526 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2fc28-4c0a-474a-9d5c-b6fa253f055f None None] PATH_INFO: `/` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:57.296955 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1141/2244] 10.222.0.72 () {54 vars in 921 bytes} [Mon Aug 29 23:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:00:57.303800 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e6ed5-76fb-45e9-ac95-bc09586185ce None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:57.304687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e6ed5-76fb-45e9-ac95-bc09586185ce None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:57.305341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e6ed5-76fb-45e9-ac95-bc09586185ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:57.330135 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-297e6ed5-76fb-45e9-ac95-bc09586185ce None None] MFA Rules not processed for user `380c6683b4ab4d08a6cf377e620439e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:57.331415 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-297e6ed5-76fb-45e9-ac95-bc09586185ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:57.392769 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1104/2245] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Aug 29 23:00:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:57.405593 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2fc28-4c0a-474a-9d5c-b6fa253f055f None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:57.407649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-fef2fc28-4c0a-474a-9d5c-b6fa253f055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:57.422400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2fc28-4c0a-474a-9d5c-b6fa253f055f None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:57.426520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8b412-978c-441a-b7d5-110fb36f3064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:57.427145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8b412-978c-441a-b7d5-110fb36f3064 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:57.427435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8b412-978c-441a-b7d5-110fb36f3064 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:57.427706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8b412-978c-441a-b7d5-110fb36f3064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:57.437175 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8b412-978c-441a-b7d5-110fb36f3064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:57.438679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8b412-978c-441a-b7d5-110fb36f3064 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:57.447578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1142/2246] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:00:57.535692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee21a3-09ba-4402-8b64-2e82c1798dd1 None None] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:57.536180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee21a3-09ba-4402-8b64-2e82c1798dd1 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:57.536649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee21a3-09ba-4402-8b64-2e82c1798dd1 None None] PATH_INFO: `/` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:57.538242 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1105/2247] 10.222.0.72 () {54 vars in 921 bytes} [Mon Aug 29 23:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:00:57.545586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ea07e-fd90-417d-a6cb-ea6245545fd3 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:57.545800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ea07e-fd90-417d-a6cb-ea6245545fd3 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:57.546081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ea07e-fd90-417d-a6cb-ea6245545fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:57.569118 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-cf9ea07e-fd90-417d-a6cb-ea6245545fd3 None None] MFA Rules not processed for user `0be09bd9ba7443aaa31879f56ca4aad1`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:57.570521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-cf9ea07e-fd90-417d-a6cb-ea6245545fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:57.580476 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1143/2248] 10.222.0.72 () {58 vars in 1018 bytes} [Mon Aug 29 23:00:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:57.591780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee21a3-09ba-4402-8b64-2e82c1798dd1 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:57.604698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee21a3-09ba-4402-8b64-2e82c1798dd1 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:57.608624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9a6d9-efae-454e-8e3a-a5a240f70361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:57.609248 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9a6d9-efae-454e-8e3a-a5a240f70361 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:57.609521 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9a6d9-efae-454e-8e3a-a5a240f70361 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:57.609792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9a6d9-efae-454e-8e3a-a5a240f70361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:57.625343 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9a6d9-efae-454e-8e3a-a5a240f70361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:57.626922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9a6d9-efae-454e-8e3a-a5a240f70361 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:57.646121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1106/2249] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:00:57.857066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc84d78-af40-432b-b51b-bcf9f2777e43 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:57.857411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc84d78-af40-432b-b51b-bcf9f2777e43 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:57.857965 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc84d78-af40-432b-b51b-bcf9f2777e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:57.891072 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-2bc84d78-af40-432b-b51b-bcf9f2777e43 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:57.892506 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-2bc84d78-af40-432b-b51b-bcf9f2777e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:57.903622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1144/2250] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 23:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:57.935444 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9a6d9-efae-454e-8e3a-a5a240f70361 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:57.938413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-74d9a6d9-efae-454e-8e3a-a5a240f70361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:57.956459 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9a6d9-efae-454e-8e3a-a5a240f70361 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:57.964216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd779c-ef47-4172-bd76-9683e13e2f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:57.964857 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd779c-ef47-4172-bd76-9683e13e2f52 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:57.965134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd779c-ef47-4172-bd76-9683e13e2f52 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:57.965739 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd779c-ef47-4172-bd76-9683e13e2f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:57.977108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd779c-ef47-4172-bd76-9683e13e2f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:57.979380 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd779c-ef47-4172-bd76-9683e13e2f52 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:57.991724 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1107/2251] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:01:01.231592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935cb5c-d59e-4a3e-b84a-5c35194e414d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:01:01.232098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935cb5c-d59e-4a3e-b84a-5c35194e414d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:01:01.232218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935cb5c-d59e-4a3e-b84a-5c35194e414d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:01:01.253933 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-e935cb5c-d59e-4a3e-b84a-5c35194e414d None None] MFA Rules not processed for user `fbdd4001b2ea4c6cbd6e012f497275cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:01:01.255067 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e935cb5c-d59e-4a3e-b84a-5c35194e414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:01:01.313411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1145/2252] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:01:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:01:01.390303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd779c-ef47-4172-bd76-9683e13e2f52 service nova] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:01:01.392297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1cdd779c-ef47-4172-bd76-9683e13e2f52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:01:01.435131 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:01.487037 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd779c-ef47-4172-bd76-9683e13e2f52 service nova] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:01:01.493381 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e97f20-16ea-4315-a344-fcd5ef32307d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5fb88d96640089eba545f4c8d3c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:01:01.494002 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e97f20-16ea-4315-a344-fcd5ef32307d service placement] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:01:01.494281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e97f20-16ea-4315-a344-fcd5ef32307d service placement] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:01:01.494556 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e97f20-16ea-4315-a344-fcd5ef32307d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:01:01.496362 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d0e97f20-16ea-4315-a344-fcd5ef32307d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:01:01.511115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e97f20-16ea-4315-a344-fcd5ef32307d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:01:01.512692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e97f20-16ea-4315-a344-fcd5ef32307d service placement] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:01:01.523576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1108/2253] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:01:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:01:02.161997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59b5ce-db6a-4438-a827-84cf74393213 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:01:02.165736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59b5ce-db6a-4438-a827-84cf74393213 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:01:02.165736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59b5ce-db6a-4438-a827-84cf74393213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:01:02.192626 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-5b59b5ce-db6a-4438-a827-84cf74393213 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:01:02.193911 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-5b59b5ce-db6a-4438-a827-84cf74393213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:01:02.209807 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1146/2254] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 23:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:01:02.251320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e97f20-16ea-4315-a344-fcd5ef32307d service placement] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:01:02.290695 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e97f20-16ea-4315-a344-fcd5ef32307d service placement] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:01:02.297290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86ea72-2842-42e1-945d-6b22107e3c2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:01:02.297867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86ea72-2842-42e1-945d-6b22107e3c2b service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:01:02.298121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86ea72-2842-42e1-945d-6b22107e3c2b service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:01:02.298377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86ea72-2842-42e1-945d-6b22107e3c2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:01:02.308637 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86ea72-2842-42e1-945d-6b22107e3c2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:01:02.310306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86ea72-2842-42e1-945d-6b22107e3c2b service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:01:02.320636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1109/2255] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:01:07.967326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8caf7-3f10-47d3-baf6-ab3389fab2d3 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:01:07.967806 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8caf7-3f10-47d3-baf6-ab3389fab2d3 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:01:07.968083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8caf7-3f10-47d3-baf6-ab3389fab2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:01:07.988901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-eae8caf7-3f10-47d3-baf6-ab3389fab2d3 None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:01:07.989991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-eae8caf7-3f10-47d3-baf6-ab3389fab2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:01:08.042077 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:08.052816 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1147/2256] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Aug 29 23:01:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:01:08.065967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86ea72-2842-42e1-945d-6b22107e3c2b service nova] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:01:08.067601 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-6a86ea72-2842-42e1-945d-6b22107e3c2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:01:08.187793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86ea72-2842-42e1-945d-6b22107e3c2b service nova] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:01:08.189997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4ab70-9a42-420e-83ec-51dce719d3c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:01:08.190625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4ab70-9a42-420e-83ec-51dce719d3c3 service swift] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:01:08.191273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4ab70-9a42-420e-83ec-51dce719d3c3 service swift] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:01:08.191894 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4ab70-9a42-420e-83ec-51dce719d3c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:01:08.202998 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4ab70-9a42-420e-83ec-51dce719d3c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:01:08.205875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4ab70-9a42-420e-83ec-51dce719d3c3 service swift] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:01:08.228941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1110/2257] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 23:01:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:01:18.115811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:18.224295 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=58 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:29.991398 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78856152-ea9b-4019-b3ae-60b1a3d79d98 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:01:29.991834 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78856152-ea9b-4019-b3ae-60b1a3d79d98 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:01:29.992131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78856152-ea9b-4019-b3ae-60b1a3d79d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:01:30.012760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-78856152-ea9b-4019-b3ae-60b1a3d79d98 None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:01:30.014007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-78856152-ea9b-4019-b3ae-60b1a3d79d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:01:30.021335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1148/2258] 10.222.0.72 () {58 vars in 967 bytes} [Mon Aug 29 23:01:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:01:30.044280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4ab70-9a42-420e-83ec-51dce719d3c3 service swift] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:01:30.054862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4ab70-9a42-420e-83ec-51dce719d3c3 service swift] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:01:30.060787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eec690-88dd-4032-a8c5-16c970307a33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:01:30.061380 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eec690-88dd-4032-a8c5-16c970307a33 service swift] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:01:30.061663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eec690-88dd-4032-a8c5-16c970307a33 service swift] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:01:30.061940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eec690-88dd-4032-a8c5-16c970307a33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:01:30.070500 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eec690-88dd-4032-a8c5-16c970307a33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:01:30.072723 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eec690-88dd-4032-a8c5-16c970307a33 service swift] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:01:30.080954 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1111/2259] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 23:01:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:01:37.821557 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a731f-0fea-4861-a99c-4437f870c3cf None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:01:37.822130 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a731f-0fea-4861-a99c-4437f870c3cf None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:01:37.822389 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a731f-0fea-4861-a99c-4437f870c3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:01:37.842658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-026a731f-0fea-4861-a99c-4437f870c3cf None None] MFA Rules not processed for user `2f6c2d623a504f20b55b19124797e97e`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:01:37.844239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-026a731f-0fea-4861-a99c-4437f870c3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:01:37.902665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1149/2260] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:01:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:01:40.077905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=6 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:47.895748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=28 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:59.897923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1385806-d9bc-4df3-abe6-fb714e705569 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:01:59.898603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1385806-d9bc-4df3-abe6-fb714e705569 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:01:59.898603 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1385806-d9bc-4df3-abe6-fb714e705569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:01:59.922282 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-d1385806-d9bc-4df3-abe6-fb714e705569 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:01:59.923646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d1385806-d9bc-4df3-abe6-fb714e705569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:01:59.934360 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1112/2261] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 23:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:01:59.965182 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a731f-0fea-4861-a99c-4437f870c3cf None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:01:59.979401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a731f-0fea-4861-a99c-4437f870c3cf None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:01:59.985190 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce180e-c2e3-480e-96d5-f5b63ecb2f5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:01:59.985888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce180e-c2e3-480e-96d5-f5b63ecb2f5f service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:01:59.986174 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce180e-c2e3-480e-96d5-f5b63ecb2f5f service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:01:59.987679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce180e-c2e3-480e-96d5-f5b63ecb2f5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:01:59.996757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce180e-c2e3-480e-96d5-f5b63ecb2f5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:01:59.998348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce180e-c2e3-480e-96d5-f5b63ecb2f5f service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:02:00.008994 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1150/2262] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:02:04.483314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f18245-8555-46c7-95d9-d0851f162141 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:02:04.484016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f18245-8555-46c7-95d9-d0851f162141 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:02:04.484016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f18245-8555-46c7-95d9-d0851f162141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:02:04.504253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-30f18245-8555-46c7-95d9-d0851f162141 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:02:04.505470 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-30f18245-8555-46c7-95d9-d0851f162141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:02:04.513314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1113/2263] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 23:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:02:04.541056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce180e-c2e3-480e-96d5-f5b63ecb2f5f service nova] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:02:04.553471 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce180e-c2e3-480e-96d5-f5b63ecb2f5f service nova] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:02:04.559539 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67353e7-df54-49b7-b59f-1afe37867a61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:02:04.560440 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67353e7-df54-49b7-b59f-1afe37867a61 service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:02:04.560754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67353e7-df54-49b7-b59f-1afe37867a61 service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:02:04.561090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67353e7-df54-49b7-b59f-1afe37867a61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:02:04.571698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67353e7-df54-49b7-b59f-1afe37867a61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:02:04.573899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67353e7-df54-49b7-b59f-1afe37867a61 service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:02:04.584258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1151/2264] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:02:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:02:08.364561 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4afed-956c-4fea-b99b-c9773e99f429 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:02:08.365151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4afed-956c-4fea-b99b-c9773e99f429 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:02:08.365151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4afed-956c-4fea-b99b-c9773e99f429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:02:08.385833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-02f4afed-956c-4fea-b99b-c9773e99f429 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:02:08.387065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-02f4afed-956c-4fea-b99b-c9773e99f429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:02:08.395274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1114/2265] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 23:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:02:08.420333 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67353e7-df54-49b7-b59f-1afe37867a61 service nova] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:02:08.432723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67353e7-df54-49b7-b59f-1afe37867a61 service nova] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:02:08.438873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf07a0c-8396-482c-9051-3a1dc99744bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:02:08.439489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf07a0c-8396-482c-9051-3a1dc99744bc service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:02:08.439771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf07a0c-8396-482c-9051-3a1dc99744bc service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:02:08.440047 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf07a0c-8396-482c-9051-3a1dc99744bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:02:08.451438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf07a0c-8396-482c-9051-3a1dc99744bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:02:08.453292 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf07a0c-8396-482c-9051-3a1dc99744bc service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:02:08.464169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1152/2266] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:02:08.926811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eead78b-cae8-4066-b8e3-2ba529a25e72 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:02:08.927097 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eead78b-cae8-4066-b8e3-2ba529a25e72 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:02:08.927379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eead78b-cae8-4066-b8e3-2ba529a25e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:02:08.947291 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-8eead78b-cae8-4066-b8e3-2ba529a25e72 None None] MFA Rules not processed for user `c50a3ef2f80040f9a4372568ee984096`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:02:08.948778 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8eead78b-cae8-4066-b8e3-2ba529a25e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:02:09.006987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1115/2267] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:02:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:02:13.708298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9e38a-9d43-430c-8374-a7dfca8cb769 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:02:13.723613 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9e38a-9d43-430c-8374-a7dfca8cb769 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:02:13.723613 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9e38a-9d43-430c-8374-a7dfca8cb769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:02:13.729019 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-e8d9e38a-9d43-430c-8374-a7dfca8cb769 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:02:13.730279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e8d9e38a-9d43-430c-8374-a7dfca8cb769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:02:13.739642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1153/2268] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 23:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:02:13.764314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eead78b-cae8-4066-b8e3-2ba529a25e72 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:02:13.777553 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eead78b-cae8-4066-b8e3-2ba529a25e72 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:02:13.783135 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f9875-fd64-48a1-be80-8a61061d262a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:02:13.783731 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f9875-fd64-48a1-be80-8a61061d262a service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:02:13.784010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f9875-fd64-48a1-be80-8a61061d262a service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:02:13.784318 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f9875-fd64-48a1-be80-8a61061d262a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:02:13.793125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f9875-fd64-48a1-be80-8a61061d262a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:02:13.794701 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f9875-fd64-48a1-be80-8a61061d262a service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:02:13.804629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1116/2269] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:02:20.023183 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a910fd-0b86-4205-a173-9d8a00895fde None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:02:20.023744 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a910fd-0b86-4205-a173-9d8a00895fde None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:02:20.023744 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a910fd-0b86-4205-a173-9d8a00895fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:02:20.044111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-10a910fd-0b86-4205-a173-9d8a00895fde None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:02:20.045350 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-10a910fd-0b86-4205-a173-9d8a00895fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:02:20.053455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1154/2270] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 23:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:02:20.090170 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f9875-fd64-48a1-be80-8a61061d262a service nova] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:02:20.101313 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f9875-fd64-48a1-be80-8a61061d262a service nova] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:02:20.106766 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa753dce-9255-43fe-a342-d4a60b634657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:02:20.107354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa753dce-9255-43fe-a342-d4a60b634657 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:02:20.107631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa753dce-9255-43fe-a342-d4a60b634657 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:02:20.107900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa753dce-9255-43fe-a342-d4a60b634657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:02:20.116115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa753dce-9255-43fe-a342-d4a60b634657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:02:20.117796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa753dce-9255-43fe-a342-d4a60b634657 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:02:20.121621 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=45 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:20.127708 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1117/2271] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:02:30.038451 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=24 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:30.145019 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:39.200816 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00b9d9-39d3-4af8-abfe-e2703ad3536e None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:02:39.201347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00b9d9-39d3-4af8-abfe-e2703ad3536e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:02:39.201347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00b9d9-39d3-4af8-abfe-e2703ad3536e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:02:39.220761 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-6b00b9d9-39d3-4af8-abfe-e2703ad3536e None None] MFA Rules not processed for user `12245620ca0e4579890a93e4492e4fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:02:39.222010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-6b00b9d9-39d3-4af8-abfe-e2703ad3536e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:02:39.295294 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1155/2272] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:02:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:02:49.288578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=25 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:56.433974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa753dce-9255-43fe-a342-d4a60b634657 service nova] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:02:56.444418 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa753dce-9255-43fe-a342-d4a60b634657 service nova] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:02:56.448409 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2aa36-e54f-4ae7-9442-bae75017d022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:02:56.452481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2aa36-e54f-4ae7-9442-bae75017d022 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:02:56.452481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2aa36-e54f-4ae7-9442-bae75017d022 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:02:56.452481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2aa36-e54f-4ae7-9442-bae75017d022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:02:56.452481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8fe2aa36-e54f-4ae7-9442-bae75017d022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:02:56.466201 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2aa36-e54f-4ae7-9442-bae75017d022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:02:56.467671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2aa36-e54f-4ae7-9442-bae75017d022 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:02:56.480184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1118/2273] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:02:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:03:00.793489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00b9d9-39d3-4af8-abfe-e2703ad3536e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:00.796161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-6b00b9d9-39d3-4af8-abfe-e2703ad3536e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:00.824596 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00b9d9-39d3-4af8-abfe-e2703ad3536e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:00.829664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349af02a-3141-4e8c-a71b-954852506452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:00.830820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349af02a-3141-4e8c-a71b-954852506452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:00.831197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349af02a-3141-4e8c-a71b-954852506452 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:00.831776 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349af02a-3141-4e8c-a71b-954852506452 admin admin] PATH_INFO: `/v3/users/2f6c2d623a504f20b55b19124797e97e` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:00.833901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349af02a-3141-4e8c-a71b-954852506452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6c2d623a504f20b55b19124797e97e)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:00.835982 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349af02a-3141-4e8c-a71b-954852506452 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:01.090653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-349af02a-3141-4e8c-a71b-954852506452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6c2d623a504f20b55b19124797e97e'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:01.097910 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-349af02a-3141-4e8c-a71b-954852506452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6c2d623a504f20b55b19124797e97e'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:01.174113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-349af02a-3141-4e8c-a71b-954852506452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6c2d623a504f20b55b19124797e97e'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:01.174858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-349af02a-3141-4e8c-a71b-954852506452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6c2d623a504f20b55b19124797e97e'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:01.192018 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-349af02a-3141-4e8c-a71b-954852506452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6c2d623a504f20b55b19124797e97e'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:01.199079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1156/2274] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:03:00 2022] DELETE /identity/v3/users/2f6c2d623a504f20b55b19124797e97e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:03:01.672661 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2aa36-e54f-4ae7-9442-bae75017d022 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:01.685439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2aa36-e54f-4ae7-9442-bae75017d022 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:01.756700 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad9bb2-25cb-401f-8d30-2d0b89585c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:01.757477 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad9bb2-25cb-401f-8d30-2d0b89585c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:01.757863 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad9bb2-25cb-401f-8d30-2d0b89585c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:01.758246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad9bb2-25cb-401f-8d30-2d0b89585c58 admin admin] PATH_INFO: `/v3/projects/1785a6a379474e088706e83fab7e3a89` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:01.759536 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad9bb2-25cb-401f-8d30-2d0b89585c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1785a6a379474e088706e83fab7e3a89)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:01.761737 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad9bb2-25cb-401f-8d30-2d0b89585c58 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:01.894890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-23ad9bb2-25cb-401f-8d30-2d0b89585c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1785a6a379474e088706e83fab7e3a89', 'request_id': 'req-23ad9bb2-25cb-401f-8d30-2d0b89585c58'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:01.920430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17955c-3afa-4e68-80b5-b7d5bfae3d43 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:01.921306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17955c-3afa-4e68-80b5-b7d5bfae3d43 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:01.921580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17955c-3afa-4e68-80b5-b7d5bfae3d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:01.943609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-7f17955c-3afa-4e68-80b5-b7d5bfae3d43 None None] MFA Rules not processed for user `fbdd4001b2ea4c6cbd6e012f497275cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:01.944908 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-7f17955c-3afa-4e68-80b5-b7d5bfae3d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:01.992736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-23ad9bb2-25cb-401f-8d30-2d0b89585c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1785a6a379474e088706e83fab7e3a89', 'request_id': 'req-23ad9bb2-25cb-401f-8d30-2d0b89585c58'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:02.000637 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-23ad9bb2-25cb-401f-8d30-2d0b89585c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1785a6a379474e088706e83fab7e3a89', 'request_id': 'req-23ad9bb2-25cb-401f-8d30-2d0b89585c58'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:02.014435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-23ad9bb2-25cb-401f-8d30-2d0b89585c58 admin admin] The token cache is being invalidate because project 1785a6a379474e088706e83fab7e3a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:03:02.015030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-23ad9bb2-25cb-401f-8d30-2d0b89585c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:02.015701 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-23ad9bb2-25cb-401f-8d30-2d0b89585c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:02.017494 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1119/2275] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:03:01 2022] DELETE /identity/v3/projects/1785a6a379474e088706e83fab7e3a89 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:03:02.034047 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1157/2276] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:03:02.488873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17955c-3afa-4e68-80b5-b7d5bfae3d43 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:02.491337 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-7f17955c-3afa-4e68-80b5-b7d5bfae3d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:02.552173 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17955c-3afa-4e68-80b5-b7d5bfae3d43 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:02.555953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f4c76-f200-4515-91e2-a68e1dae475f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:02.556587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f4c76-f200-4515-91e2-a68e1dae475f service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:02.556866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f4c76-f200-4515-91e2-a68e1dae475f service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:02.557136 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f4c76-f200-4515-91e2-a68e1dae475f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:02.559119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-9b3f4c76-f200-4515-91e2-a68e1dae475f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:02.570364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f4c76-f200-4515-91e2-a68e1dae475f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:02.571792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f4c76-f200-4515-91e2-a68e1dae475f service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:02.575115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc57f44-7e09-4365-a61a-ab3c9aa5a812 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:02.578942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc57f44-7e09-4365-a61a-ab3c9aa5a812 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:02.578942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc57f44-7e09-4365-a61a-ab3c9aa5a812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:02.580180 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1158/2277] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:03:02.596130 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-dcc57f44-7e09-4365-a61a-ab3c9aa5a812 None None] MFA Rules not processed for user `24dbd95c579d44cd8c95ca63669fca24`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:02.597456 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-dcc57f44-7e09-4365-a61a-ab3c9aa5a812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:02.656619 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1120/2278] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:03:02.697638 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f4c76-f200-4515-91e2-a68e1dae475f service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:02.699145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-9b3f4c76-f200-4515-91e2-a68e1dae475f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:02.721545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:02.758712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f4c76-f200-4515-91e2-a68e1dae475f service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:02.762934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c69d07-8e8a-4fff-8b3d-f9a4f0110bf1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e72cc048a0418cac062d68b8df402f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:02.763935 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c69d07-8e8a-4fff-8b3d-f9a4f0110bf1 service glance] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:02.764330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c69d07-8e8a-4fff-8b3d-f9a4f0110bf1 service glance] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:02.764605 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c69d07-8e8a-4fff-8b3d-f9a4f0110bf1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:02.766434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e9c69d07-8e8a-4fff-8b3d-f9a4f0110bf1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:02.841501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c69d07-8e8a-4fff-8b3d-f9a4f0110bf1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:02.843023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c69d07-8e8a-4fff-8b3d-f9a4f0110bf1 service glance] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:02.854912 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1159/2279] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:03:02.979657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc57f44-7e09-4365-a61a-ab3c9aa5a812 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:02.981153 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-dcc57f44-7e09-4365-a61a-ab3c9aa5a812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:03.009606 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:03.059805 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc57f44-7e09-4365-a61a-ab3c9aa5a812 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:03.071346 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b70a81-2959-49a2-8c9f-fd1498389fc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5fb88d96640089eba545f4c8d3c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:03.072003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b70a81-2959-49a2-8c9f-fd1498389fc6 service placement] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:03.072329 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b70a81-2959-49a2-8c9f-fd1498389fc6 service placement] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:03.072607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b70a81-2959-49a2-8c9f-fd1498389fc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:03.074466 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-81b70a81-2959-49a2-8c9f-fd1498389fc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:03.087056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b70a81-2959-49a2-8c9f-fd1498389fc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:03.088796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b70a81-2959-49a2-8c9f-fd1498389fc6 service placement] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:03.099600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1121/2280] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:03:09.478614 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c69d07-8e8a-4fff-8b3d-f9a4f0110bf1 service glance] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:09.480098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e9c69d07-8e8a-4fff-8b3d-f9a4f0110bf1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:09.494560 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c69d07-8e8a-4fff-8b3d-f9a4f0110bf1 service glance] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:09.501775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466ba5e-05ec-4231-b61f-574c1cd7f75b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:09.502518 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466ba5e-05ec-4231-b61f-574c1cd7f75b service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:09.502927 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466ba5e-05ec-4231-b61f-574c1cd7f75b service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:09.503241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466ba5e-05ec-4231-b61f-574c1cd7f75b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:09.505052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-0466ba5e-05ec-4231-b61f-574c1cd7f75b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:09.515961 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466ba5e-05ec-4231-b61f-574c1cd7f75b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:09.517579 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466ba5e-05ec-4231-b61f-574c1cd7f75b service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:09.526729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1160/2281] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:03:13.304165 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=22 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:14.314272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b70a81-2959-49a2-8c9f-fd1498389fc6 service placement] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:14.325063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b70a81-2959-49a2-8c9f-fd1498389fc6 service placement] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:14.329053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909aeaf4-7ca3-4644-a134-e08f6b5d11e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:14.329934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aeaf4-7ca3-4644-a134-e08f6b5d11e0 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:14.330224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aeaf4-7ca3-4644-a134-e08f6b5d11e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:14.330618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aeaf4-7ca3-4644-a134-e08f6b5d11e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:14.331089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466ba5e-05ec-4231-b61f-574c1cd7f75b service nova] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:14.333858 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-909aeaf4-7ca3-4644-a134-e08f6b5d11e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:14.345495 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466ba5e-05ec-4231-b61f-574c1cd7f75b service nova] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:14.346843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909aeaf4-7ca3-4644-a134-e08f6b5d11e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:14.350670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909aeaf4-7ca3-4644-a134-e08f6b5d11e0 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:14.351728 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8811d4-a409-42ab-ae0d-c20725cd660f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:14.352580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8811d4-a409-42ab-ae0d-c20725cd660f service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:14.352961 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8811d4-a409-42ab-ae0d-c20725cd660f service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:14.353341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8811d4-a409-42ab-ae0d-c20725cd660f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:14.362248 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8811d4-a409-42ab-ae0d-c20725cd660f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:14.364167 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8811d4-a409-42ab-ae0d-c20725cd660f service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:14.377146 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1122/2282] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:03:14.378333 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1161/2283] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:03:16.386889 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909aeaf4-7ca3-4644-a134-e08f6b5d11e0 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:16.400465 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909aeaf4-7ca3-4644-a134-e08f6b5d11e0 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:16.406227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca763f-a047-4973-bbe6-5fbd9c08bd0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:16.411939 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca763f-a047-4973-bbe6-5fbd9c08bd0e service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:16.411939 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca763f-a047-4973-bbe6-5fbd9c08bd0e service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:16.411939 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca763f-a047-4973-bbe6-5fbd9c08bd0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:16.411939 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-89ca763f-a047-4973-bbe6-5fbd9c08bd0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:16.477057 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca763f-a047-4973-bbe6-5fbd9c08bd0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:16.478641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca763f-a047-4973-bbe6-5fbd9c08bd0e service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:16.488765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1123/2284] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:16 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:03:24.371828 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=57 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:26.484343 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=34 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:27.714227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8811d4-a409-42ab-ae0d-c20725cd660f service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:27.715713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-bb8811d4-a409-42ab-ae0d-c20725cd660f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:27.733819 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8811d4-a409-42ab-ae0d-c20725cd660f service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:27.744975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9e136-72ef-4a98-8165-bf473d9bb044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:27.745610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9e136-72ef-4a98-8165-bf473d9bb044 service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:27.745894 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9e136-72ef-4a98-8165-bf473d9bb044 service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:27.746168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9e136-72ef-4a98-8165-bf473d9bb044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:27.748496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-9ab9e136-72ef-4a98-8165-bf473d9bb044 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:27.764888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9e136-72ef-4a98-8165-bf473d9bb044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:27.766578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9e136-72ef-4a98-8165-bf473d9bb044 service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:27.779146 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1162/2285] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:03:37.774216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=6 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:37.887963 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca763f-a047-4973-bbe6-5fbd9c08bd0e service nova] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:37.897265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca763f-a047-4973-bbe6-5fbd9c08bd0e service nova] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:37.902005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635c4a4-aa83-4ae8-abb2-d79c78a64c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:37.902608 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635c4a4-aa83-4ae8-abb2-d79c78a64c30 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:37.902888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635c4a4-aa83-4ae8-abb2-d79c78a64c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:37.903160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635c4a4-aa83-4ae8-abb2-d79c78a64c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:37.904945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8635c4a4-aa83-4ae8-abb2-d79c78a64c30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:37.970756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635c4a4-aa83-4ae8-abb2-d79c78a64c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:37.972223 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635c4a4-aa83-4ae8-abb2-d79c78a64c30 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:37.982014 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1124/2286] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:03:41.442767 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9e136-72ef-4a98-8165-bf473d9bb044 service nova] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:41.456829 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9e136-72ef-4a98-8165-bf473d9bb044 service nova] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:41.463680 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac76724-69d4-41db-997c-01d3b6c751be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:41.464421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac76724-69d4-41db-997c-01d3b6c751be service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:41.464929 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac76724-69d4-41db-997c-01d3b6c751be service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:41.465395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac76724-69d4-41db-997c-01d3b6c751be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:41.468074 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-7ac76724-69d4-41db-997c-01d3b6c751be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:41.537119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac76724-69d4-41db-997c-01d3b6c751be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:41.539634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac76724-69d4-41db-997c-01d3b6c751be service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:41.552168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1163/2287] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:03:42.008666 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635c4a4-aa83-4ae8-abb2-d79c78a64c30 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:42.010286 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8635c4a4-aa83-4ae8-abb2-d79c78a64c30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:42.023659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635c4a4-aa83-4ae8-abb2-d79c78a64c30 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:42.028787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8f986-d867-41c7-ad3c-5a4e8e79411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:42.029426 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8f986-d867-41c7-ad3c-5a4e8e79411f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:42.029840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8f986-d867-41c7-ad3c-5a4e8e79411f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:42.030124 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8f986-d867-41c7-ad3c-5a4e8e79411f admin admin] PATH_INFO: `/v3/users/c50a3ef2f80040f9a4372568ee984096` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:42.031263 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8f986-d867-41c7-ad3c-5a4e8e79411f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c50a3ef2f80040f9a4372568ee984096)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:42.033253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8f986-d867-41c7-ad3c-5a4e8e79411f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:42.217477 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8ef8f986-d867-41c7-ad3c-5a4e8e79411f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c50a3ef2f80040f9a4372568ee984096'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:42.218167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8ef8f986-d867-41c7-ad3c-5a4e8e79411f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c50a3ef2f80040f9a4372568ee984096'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:42.218807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8ef8f986-d867-41c7-ad3c-5a4e8e79411f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c50a3ef2f80040f9a4372568ee984096'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:42.232107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8ef8f986-d867-41c7-ad3c-5a4e8e79411f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c50a3ef2f80040f9a4372568ee984096'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:42.239069 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-8ef8f986-d867-41c7-ad3c-5a4e8e79411f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c50a3ef2f80040f9a4372568ee984096'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:42.321888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1125/2288] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:03:42 2022] DELETE /identity/v3/users/c50a3ef2f80040f9a4372568ee984096 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:03:42.633897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac76724-69d4-41db-997c-01d3b6c751be service nova] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:42.645454 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac76724-69d4-41db-997c-01d3b6c751be service nova] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:42.705643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97aab83-ca3d-4c3d-9902-8ab222a31d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:42.706207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97aab83-ca3d-4c3d-9902-8ab222a31d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:42.706490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97aab83-ca3d-4c3d-9902-8ab222a31d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:42.706769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97aab83-ca3d-4c3d-9902-8ab222a31d63 admin admin] PATH_INFO: `/v3/projects/269e950862de4817b49d3db302f89d35` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:42.708001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97aab83-ca3d-4c3d-9902-8ab222a31d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=269e950862de4817b49d3db302f89d35)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:42.709953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97aab83-ca3d-4c3d-9902-8ab222a31d63 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:42.838245 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c97aab83-ca3d-4c3d-9902-8ab222a31d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '269e950862de4817b49d3db302f89d35', 'request_id': 'req-c97aab83-ca3d-4c3d-9902-8ab222a31d63'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:42.844536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c97aab83-ca3d-4c3d-9902-8ab222a31d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '269e950862de4817b49d3db302f89d35', 'request_id': 'req-c97aab83-ca3d-4c3d-9902-8ab222a31d63'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:42.850146 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c97aab83-ca3d-4c3d-9902-8ab222a31d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '269e950862de4817b49d3db302f89d35', 'request_id': 'req-c97aab83-ca3d-4c3d-9902-8ab222a31d63'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:42.899349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c97aab83-ca3d-4c3d-9902-8ab222a31d63 admin admin] The token cache is being invalidate because project 269e950862de4817b49d3db302f89d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:03:42.899643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c97aab83-ca3d-4c3d-9902-8ab222a31d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:42.900305 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c97aab83-ca3d-4c3d-9902-8ab222a31d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:42.901803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1164/2289] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:03:42 2022] DELETE /identity/v3/projects/269e950862de4817b49d3db302f89d35 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:03:42.906835 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b924f-6634-4d69-8d2b-08de61996b06 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:42.907121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b924f-6634-4d69-8d2b-08de61996b06 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:42.907397 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b924f-6634-4d69-8d2b-08de61996b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:42.928352 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-4e4b924f-6634-4d69-8d2b-08de61996b06 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:42.930217 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4e4b924f-6634-4d69-8d2b-08de61996b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:42.993842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1126/2290] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:03:43.002428 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862f1b6-7968-4da6-9ec7-5b4bb4a3df13 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:43.002846 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862f1b6-7968-4da6-9ec7-5b4bb4a3df13 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:43.002979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862f1b6-7968-4da6-9ec7-5b4bb4a3df13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:43.024447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-0862f1b6-7968-4da6-9ec7-5b4bb4a3df13 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:43.025666 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-0862f1b6-7968-4da6-9ec7-5b4bb4a3df13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:43.033812 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1165/2291] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:03:43.040752 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b924f-6634-4d69-8d2b-08de61996b06 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:43.050909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b924f-6634-4d69-8d2b-08de61996b06 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:43.056682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bbc69-7b6d-4bc6-bf79-719327e8a71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:43.057307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bbc69-7b6d-4bc6-bf79-719327e8a71c admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:43.057594 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bbc69-7b6d-4bc6-bf79-719327e8a71c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:43.057900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bbc69-7b6d-4bc6-bf79-719327e8a71c admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:43.058812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bbc69-7b6d-4bc6-bf79-719327e8a71c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:03:43.059116 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bbc69-7b6d-4bc6-bf79-719327e8a71c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:43.060748 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bbc69-7b6d-4bc6-bf79-719327e8a71c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:43.066206 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:43.074520 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1127/2292] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:03:43.078971 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862f1b6-7968-4da6-9ec7-5b4bb4a3df13 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:43.088615 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862f1b6-7968-4da6-9ec7-5b4bb4a3df13 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:43.093339 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc3e49-0443-433c-9f97-4439716a73ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:43.093936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc3e49-0443-433c-9f97-4439716a73ee admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:43.094238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc3e49-0443-433c-9f97-4439716a73ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:43.094511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc3e49-0443-433c-9f97-4439716a73ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:43.095143 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc3e49-0443-433c-9f97-4439716a73ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:43.097077 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc3e49-0443-433c-9f97-4439716a73ee admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:43.187014 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:43.197856 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1166/2293] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:03:43 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:03:43.201877 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bbc69-7b6d-4bc6-bf79-719327e8a71c admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:43.215117 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bbc69-7b6d-4bc6-bf79-719327e8a71c admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:43.273665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5bea-aedc-4389-85a2-29b0ebffd121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:43.274849 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5bea-aedc-4389-85a2-29b0ebffd121 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:43.275135 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5bea-aedc-4389-85a2-29b0ebffd121 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:43.275410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5bea-aedc-4389-85a2-29b0ebffd121 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:43.276059 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb5bea-aedc-4389-85a2-29b0ebffd121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:43.278038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb5bea-aedc-4389-85a2-29b0ebffd121 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:43.379338 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1128/2294] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:03:43 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:03:43.384450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc3e49-0443-433c-9f97-4439716a73ee admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:43.396073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc3e49-0443-433c-9f97-4439716a73ee admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:43.401086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939b3fb-4b4a-4385-a9e4-dd617002db45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:43.401727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b3fb-4b4a-4385-a9e4-dd617002db45 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:43.402010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b3fb-4b4a-4385-a9e4-dd617002db45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:43.402286 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b3fb-4b4a-4385-a9e4-dd617002db45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:43.402978 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939b3fb-4b4a-4385-a9e4-dd617002db45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:43.404696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939b3fb-4b4a-4385-a9e4-dd617002db45 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:43.417239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1167/2295] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:03:43.421462 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5bea-aedc-4389-85a2-29b0ebffd121 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:43.434555 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5bea-aedc-4389-85a2-29b0ebffd121 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:43.439475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e928e9-0de7-4eea-8558-b533d265e230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:43.440109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e928e9-0de7-4eea-8558-b533d265e230 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:43.440430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e928e9-0de7-4eea-8558-b533d265e230 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:43.440708 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e928e9-0de7-4eea-8558-b533d265e230 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:43.441374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e928e9-0de7-4eea-8558-b533d265e230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:43.443274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e928e9-0de7-4eea-8558-b533d265e230 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:43.455214 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1129/2296] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:03:43.460120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939b3fb-4b4a-4385-a9e4-dd617002db45 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:43.471215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939b3fb-4b4a-4385-a9e4-dd617002db45 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:43.476209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b6c23-b0dd-42e1-b39b-d9abca9b7825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:43.477449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b6c23-b0dd-42e1-b39b-d9abca9b7825 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:43.477850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b6c23-b0dd-42e1-b39b-d9abca9b7825 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:43.478133 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b6c23-b0dd-42e1-b39b-d9abca9b7825 admin admin] PATH_INFO: `/v3/projects/cc75ebf8fd934e6fbf22a57c31a39a9c/users/e88053934dc446f98601c365be56c5de/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:43.495260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b6c23-b0dd-42e1-b39b-d9abca9b7825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc75ebf8fd934e6fbf22a57c31a39a9c, user_id=e88053934dc446f98601c365be56c5de, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:43.498113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b6c23-b0dd-42e1-b39b-d9abca9b7825 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:43.569217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1168/2297] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:03:43 2022] PUT /identity/v3/projects/cc75ebf8fd934e6fbf22a57c31a39a9c/users/e88053934dc446f98601c365be56c5de/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:03:43.579509 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4822c14-0081-4887-b05b-92902a3b0120 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:43.579815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4822c14-0081-4887-b05b-92902a3b0120 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:43.580094 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4822c14-0081-4887-b05b-92902a3b0120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:43.615001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-b4822c14-0081-4887-b05b-92902a3b0120 None None] MFA Rules not processed for user `e88053934dc446f98601c365be56c5de`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:43.616325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b4822c14-0081-4887-b05b-92902a3b0120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:43.683726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1130/2298] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:03:43.688632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b6c23-b0dd-42e1-b39b-d9abca9b7825 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:43.756215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b6c23-b0dd-42e1-b39b-d9abca9b7825 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:43.761683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804de815-8aff-407c-9c55-7a50739a5bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:43.762060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804de815-8aff-407c-9c55-7a50739a5bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:43.762341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804de815-8aff-407c-9c55-7a50739a5bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:43.762616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804de815-8aff-407c-9c55-7a50739a5bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:43.763268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804de815-8aff-407c-9c55-7a50739a5bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:43.765227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804de815-8aff-407c-9c55-7a50739a5bc8 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:43.856589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1169/2299] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:03:43 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:03:43.860550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4822c14-0081-4887-b05b-92902a3b0120 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:43.872241 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4822c14-0081-4887-b05b-92902a3b0120 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:43.932167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906522a-71d9-4c53-9fbf-5c3add0d70ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:43.932814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906522a-71d9-4c53-9fbf-5c3add0d70ce admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:43.933096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906522a-71d9-4c53-9fbf-5c3add0d70ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:43.933902 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906522a-71d9-4c53-9fbf-5c3add0d70ce admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:43.934563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906522a-71d9-4c53-9fbf-5c3add0d70ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:43.936494 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906522a-71d9-4c53-9fbf-5c3add0d70ce admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:43.946010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:44.026994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1131/2300] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:03:43 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:03:44.031450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804de815-8aff-407c-9c55-7a50739a5bc8 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:44.042895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804de815-8aff-407c-9c55-7a50739a5bc8 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:44.048406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793bf7-b32f-49a0-ac3e-3ed4a81ce69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:44.049118 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793bf7-b32f-49a0-ac3e-3ed4a81ce69e admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:44.049406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793bf7-b32f-49a0-ac3e-3ed4a81ce69e admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:44.049683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793bf7-b32f-49a0-ac3e-3ed4a81ce69e admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:44.050362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4793bf7-b32f-49a0-ac3e-3ed4a81ce69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:44.051965 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4793bf7-b32f-49a0-ac3e-3ed4a81ce69e admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:44.063560 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1170/2301] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:03:44.067906 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906522a-71d9-4c53-9fbf-5c3add0d70ce admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:44.078704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906522a-71d9-4c53-9fbf-5c3add0d70ce admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:44.083435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7d89f-c1c8-4e90-9f46-7948452ac472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:44.084100 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7d89f-c1c8-4e90-9f46-7948452ac472 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:44.084433 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7d89f-c1c8-4e90-9f46-7948452ac472 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:44.084703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7d89f-c1c8-4e90-9f46-7948452ac472 admin admin] PATH_INFO: `/v3/projects/d9024383b53c4464be812f7f45f4ea7d/users/0ac9f13099e9407caacfdb35b66796d6/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:44.101109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7d89f-c1c8-4e90-9f46-7948452ac472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9024383b53c4464be812f7f45f4ea7d, user_id=0ac9f13099e9407caacfdb35b66796d6, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:44.104937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7d89f-c1c8-4e90-9f46-7948452ac472 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:44.169935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1132/2302] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:03:44 2022] PUT /identity/v3/projects/d9024383b53c4464be812f7f45f4ea7d/users/0ac9f13099e9407caacfdb35b66796d6/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:03:44.173966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793bf7-b32f-49a0-ac3e-3ed4a81ce69e admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:44.184576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793bf7-b32f-49a0-ac3e-3ed4a81ce69e admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:44.241683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21619cbe-cb1b-4054-87b7-536a45a121f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:44.242283 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21619cbe-cb1b-4054-87b7-536a45a121f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:44.242587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21619cbe-cb1b-4054-87b7-536a45a121f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:44.242861 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21619cbe-cb1b-4054-87b7-536a45a121f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:44.243530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21619cbe-cb1b-4054-87b7-536a45a121f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:44.245131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21619cbe-cb1b-4054-87b7-536a45a121f6 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:44.255116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1171/2303] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:03:44.260017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7d89f-c1c8-4e90-9f46-7948452ac472 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:44.270458 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7d89f-c1c8-4e90-9f46-7948452ac472 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:44.275761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb503ab-ccc2-4898-91b2-d7ba3578048f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:44.279119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb503ab-ccc2-4898-91b2-d7ba3578048f admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:44.279119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb503ab-ccc2-4898-91b2-d7ba3578048f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:44.279119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb503ab-ccc2-4898-91b2-d7ba3578048f admin admin] PATH_INFO: `/v3/projects/d9024383b53c4464be812f7f45f4ea7d/users/0ac9f13099e9407caacfdb35b66796d6/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:44.279119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb503ab-ccc2-4898-91b2-d7ba3578048f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9024383b53c4464be812f7f45f4ea7d, user_id=0ac9f13099e9407caacfdb35b66796d6, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:44.281464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb503ab-ccc2-4898-91b2-d7ba3578048f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:44.291988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1133/2304] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:03:44 2022] PUT /identity/v3/projects/d9024383b53c4464be812f7f45f4ea7d/users/0ac9f13099e9407caacfdb35b66796d6/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:03:44.303628 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b17e4-49d5-4c1f-904d-bf22526b7515 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:44.303917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b17e4-49d5-4c1f-904d-bf22526b7515 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:44.304218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b17e4-49d5-4c1f-904d-bf22526b7515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:44.335564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-6e4b17e4-49d5-4c1f-904d-bf22526b7515 None None] MFA Rules not processed for user `0ac9f13099e9407caacfdb35b66796d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:44.338066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-6e4b17e4-49d5-4c1f-904d-bf22526b7515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:44.362963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:44.411706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1172/2305] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:03:44.424720 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb503ab-ccc2-4898-91b2-d7ba3578048f admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:44.426887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-fcb503ab-ccc2-4898-91b2-d7ba3578048f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:44.487141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb503ab-ccc2-4898-91b2-d7ba3578048f admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:44.491048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ffd02-873c-4302-96db-af0c7d810ec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:44.491731 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ffd02-873c-4302-96db-af0c7d810ec5 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:44.492085 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ffd02-873c-4302-96db-af0c7d810ec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:44.492532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ffd02-873c-4302-96db-af0c7d810ec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:44.502742 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ffd02-873c-4302-96db-af0c7d810ec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:44.505160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ffd02-873c-4302-96db-af0c7d810ec5 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:44.517615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1134/2306] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:03:44.653758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b17e4-49d5-4c1f-904d-bf22526b7515 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:44.656025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-6e4b17e4-49d5-4c1f-904d-bf22526b7515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:44.679386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b17e4-49d5-4c1f-904d-bf22526b7515 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:44.679386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ca67e-f83d-4c9c-8dc6-aa44412978ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:44.679386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ca67e-f83d-4c9c-8dc6-aa44412978ce service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:44.679386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ca67e-f83d-4c9c-8dc6-aa44412978ce service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:44.680627 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ca67e-f83d-4c9c-8dc6-aa44412978ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:44.739652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ca67e-f83d-4c9c-8dc6-aa44412978ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:44.741154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ca67e-f83d-4c9c-8dc6-aa44412978ce service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:44.752293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1173/2307] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:03:49.698121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ffd02-873c-4302-96db-af0c7d810ec5 service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:49.761514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ffd02-873c-4302-96db-af0c7d810ec5 service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:49.766428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c35284-c067-4da7-b07f-c1c75cea4258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:49.766974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c35284-c067-4da7-b07f-c1c75cea4258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:49.767343 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c35284-c067-4da7-b07f-c1c75cea4258 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:49.767512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c35284-c067-4da7-b07f-c1c75cea4258 admin admin] PATH_INFO: `/v3/users/e88053934dc446f98601c365be56c5de` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:49.768684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c35284-c067-4da7-b07f-c1c75cea4258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88053934dc446f98601c365be56c5de)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:49.770669 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c35284-c067-4da7-b07f-c1c75cea4258 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:49.953483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-03c35284-c067-4da7-b07f-c1c75cea4258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88053934dc446f98601c365be56c5de'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:49.954060 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-03c35284-c067-4da7-b07f-c1c75cea4258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88053934dc446f98601c365be56c5de'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:49.954667 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-03c35284-c067-4da7-b07f-c1c75cea4258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88053934dc446f98601c365be56c5de'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:49.963551 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:49.968077 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-03c35284-c067-4da7-b07f-c1c75cea4258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88053934dc446f98601c365be56c5de'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:49.975095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-03c35284-c067-4da7-b07f-c1c75cea4258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88053934dc446f98601c365be56c5de'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:50.071174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1135/2308] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:03:49 2022] DELETE /identity/v3/users/e88053934dc446f98601c365be56c5de => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:03:50.076249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2ec30-bbbd-4a5f-986c-f6ebd6782afd None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:50.076765 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2ec30-bbbd-4a5f-986c-f6ebd6782afd None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:50.076873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2ec30-bbbd-4a5f-986c-f6ebd6782afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:50.096335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-efe2ec30-bbbd-4a5f-986c-f6ebd6782afd None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:50.097549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-efe2ec30-bbbd-4a5f-986c-f6ebd6782afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:50.156838 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1174/2309] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:03:50.166877 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c35284-c067-4da7-b07f-c1c75cea4258 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:50.168346 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-03c35284-c067-4da7-b07f-c1c75cea4258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:50.227753 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c35284-c067-4da7-b07f-c1c75cea4258 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:50.231540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c563d3-b5b1-44bd-bc88-5689cc16bf21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:50.232158 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c563d3-b5b1-44bd-bc88-5689cc16bf21 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:50.232467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c563d3-b5b1-44bd-bc88-5689cc16bf21 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:50.232736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c563d3-b5b1-44bd-bc88-5689cc16bf21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:50.241905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c563d3-b5b1-44bd-bc88-5689cc16bf21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:50.243322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c563d3-b5b1-44bd-bc88-5689cc16bf21 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:50.252733 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1136/2310] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:03:50.668627 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2ec30-bbbd-4a5f-986c-f6ebd6782afd None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:50.670078 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-efe2ec30-bbbd-4a5f-986c-f6ebd6782afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:50.682337 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2ec30-bbbd-4a5f-986c-f6ebd6782afd None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:50.689212 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:50.689872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:50.690152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:50.690426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c admin admin] PATH_INFO: `/v3/projects/cc75ebf8fd934e6fbf22a57c31a39a9c` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:50.691700 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc75ebf8fd934e6fbf22a57c31a39a9c)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:50.693976 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:50.827035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc75ebf8fd934e6fbf22a57c31a39a9c', 'request_id': 'req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:50.833752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc75ebf8fd934e6fbf22a57c31a39a9c', 'request_id': 'req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:50.834966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:50.840464 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc75ebf8fd934e6fbf22a57c31a39a9c', 'request_id': 'req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:50.962184 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c admin admin] The token cache is being invalidate because project cc75ebf8fd934e6fbf22a57c31a39a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:03:50.962477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:50.963174 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:50.965312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1175/2311] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:03:50 2022] DELETE /identity/v3/projects/cc75ebf8fd934e6fbf22a57c31a39a9c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:03:50.969437 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c563d3-b5b1-44bd-bc88-5689cc16bf21 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:50.979129 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c563d3-b5b1-44bd-bc88-5689cc16bf21 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:51.035322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ebb3b-f295-436d-b546-c2f169f92bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:51.035945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ebb3b-f295-436d-b546-c2f169f92bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:51.036249 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ebb3b-f295-436d-b546-c2f169f92bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:51.036526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ebb3b-f295-436d-b546-c2f169f92bbd admin admin] PATH_INFO: `/v3/users/0ac9f13099e9407caacfdb35b66796d6` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:51.037639 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ebb3b-f295-436d-b546-c2f169f92bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac9f13099e9407caacfdb35b66796d6)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:51.039535 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ebb3b-f295-436d-b546-c2f169f92bbd admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:51.251909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6c1ebb3b-f295-436d-b546-c2f169f92bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac9f13099e9407caacfdb35b66796d6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:51.252732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6c1ebb3b-f295-436d-b546-c2f169f92bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac9f13099e9407caacfdb35b66796d6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:51.253365 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6c1ebb3b-f295-436d-b546-c2f169f92bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac9f13099e9407caacfdb35b66796d6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:51.267345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6c1ebb3b-f295-436d-b546-c2f169f92bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac9f13099e9407caacfdb35b66796d6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:51.274431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6c1ebb3b-f295-436d-b546-c2f169f92bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac9f13099e9407caacfdb35b66796d6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:51.346689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:51.351985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1137/2312] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:03:50 2022] DELETE /identity/v3/users/0ac9f13099e9407caacfdb35b66796d6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:03:51.749751 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:51.751585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:51.766721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763213c-0e50-4aa2-aeb3-ac5e81ee241c admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:51.847657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f02a6-453b-46fe-b33d-8c5a57570e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:51.848362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f02a6-453b-46fe-b33d-8c5a57570e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:51.848636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f02a6-453b-46fe-b33d-8c5a57570e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:51.848970 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f02a6-453b-46fe-b33d-8c5a57570e6c admin admin] PATH_INFO: `/v3/projects/d9024383b53c4464be812f7f45f4ea7d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:51.850604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f02a6-453b-46fe-b33d-8c5a57570e6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9024383b53c4464be812f7f45f4ea7d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:51.852725 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f02a6-453b-46fe-b33d-8c5a57570e6c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:51.960484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-949f02a6-453b-46fe-b33d-8c5a57570e6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9024383b53c4464be812f7f45f4ea7d', 'request_id': 'req-949f02a6-453b-46fe-b33d-8c5a57570e6c'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:51.967521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-949f02a6-453b-46fe-b33d-8c5a57570e6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9024383b53c4464be812f7f45f4ea7d', 'request_id': 'req-949f02a6-453b-46fe-b33d-8c5a57570e6c'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:51.974162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-949f02a6-453b-46fe-b33d-8c5a57570e6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9024383b53c4464be812f7f45f4ea7d', 'request_id': 'req-949f02a6-453b-46fe-b33d-8c5a57570e6c'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:52.076779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-949f02a6-453b-46fe-b33d-8c5a57570e6c admin admin] The token cache is being invalidate because project d9024383b53c4464be812f7f45f4ea7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:03:52.077017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-949f02a6-453b-46fe-b33d-8c5a57570e6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:52.077633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-949f02a6-453b-46fe-b33d-8c5a57570e6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:52.079133 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1176/2313] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:03:51 2022] DELETE /identity/v3/projects/d9024383b53c4464be812f7f45f4ea7d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:03:52.084076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1018a1-ee47-476c-8d43-3aaca100aef4 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:52.084607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1018a1-ee47-476c-8d43-3aaca100aef4 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:52.084712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1018a1-ee47-476c-8d43-3aaca100aef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:52.106256 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-ae1018a1-ee47-476c-8d43-3aaca100aef4 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:52.107746 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-ae1018a1-ee47-476c-8d43-3aaca100aef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:52.165872 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1138/2314] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:03:52.174385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd270-1415-44df-b5e4-ba53a92abf73 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:52.174700 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd270-1415-44df-b5e4-ba53a92abf73 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:52.175001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd270-1415-44df-b5e4-ba53a92abf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:52.195595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-de1cd270-1415-44df-b5e4-ba53a92abf73 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:52.196823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-de1cd270-1415-44df-b5e4-ba53a92abf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:52.206208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1177/2315] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:03:52.210545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1018a1-ee47-476c-8d43-3aaca100aef4 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:52.220733 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1018a1-ee47-476c-8d43-3aaca100aef4 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:52.225370 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cfd4d-7536-4949-ae14-352a60b89b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:52.225972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cfd4d-7536-4949-ae14-352a60b89b57 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:52.226255 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cfd4d-7536-4949-ae14-352a60b89b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:52.226531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cfd4d-7536-4949-ae14-352a60b89b57 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:52.227185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cfd4d-7536-4949-ae14-352a60b89b57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:03:52.227498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cfd4d-7536-4949-ae14-352a60b89b57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:52.229126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cfd4d-7536-4949-ae14-352a60b89b57 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:52.241320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1139/2316] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:03:52.245630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cd270-1415-44df-b5e4-ba53a92abf73 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:52.255406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cd270-1415-44df-b5e4-ba53a92abf73 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:52.260070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bd3b0-89a7-4c5b-bebe-d34950c8ca54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:52.260702 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bd3b0-89a7-4c5b-bebe-d34950c8ca54 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:52.260980 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bd3b0-89a7-4c5b-bebe-d34950c8ca54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:52.261248 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bd3b0-89a7-4c5b-bebe-d34950c8ca54 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:52.262047 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bd3b0-89a7-4c5b-bebe-d34950c8ca54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:52.263869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bd3b0-89a7-4c5b-bebe-d34950c8ca54 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:52.370082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1178/2317] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:03:52 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:03:52.375294 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cfd4d-7536-4949-ae14-352a60b89b57 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:52.390228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cfd4d-7536-4949-ae14-352a60b89b57 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:52.456726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53b8b7-c3e3-4516-9d9e-3934bdea3b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:52.457302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53b8b7-c3e3-4516-9d9e-3934bdea3b90 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:52.457584 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53b8b7-c3e3-4516-9d9e-3934bdea3b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:52.457859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53b8b7-c3e3-4516-9d9e-3934bdea3b90 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:52.458499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53b8b7-c3e3-4516-9d9e-3934bdea3b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:52.460460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53b8b7-c3e3-4516-9d9e-3934bdea3b90 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:52.585715 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1140/2318] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:03:52 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:03:52.590604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bd3b0-89a7-4c5b-bebe-d34950c8ca54 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:52.601391 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bd3b0-89a7-4c5b-bebe-d34950c8ca54 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:52.607271 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5570544-bdb8-4e33-8dee-7f3c79dade17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:52.607922 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5570544-bdb8-4e33-8dee-7f3c79dade17 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:52.608230 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5570544-bdb8-4e33-8dee-7f3c79dade17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:52.608507 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5570544-bdb8-4e33-8dee-7f3c79dade17 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:52.609161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5570544-bdb8-4e33-8dee-7f3c79dade17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:52.610759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5570544-bdb8-4e33-8dee-7f3c79dade17 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:52.624554 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1179/2319] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:03:52.625613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53b8b7-c3e3-4516-9d9e-3934bdea3b90 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:52.635799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53b8b7-c3e3-4516-9d9e-3934bdea3b90 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:52.640894 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265673d-0cc9-4b8f-aa50-b3b0be65b30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:52.641500 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265673d-0cc9-4b8f-aa50-b3b0be65b30f admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:52.641781 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265673d-0cc9-4b8f-aa50-b3b0be65b30f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:52.642056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265673d-0cc9-4b8f-aa50-b3b0be65b30f admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:52.642698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265673d-0cc9-4b8f-aa50-b3b0be65b30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:52.644347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265673d-0cc9-4b8f-aa50-b3b0be65b30f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:52.655847 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1141/2320] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:03:52.660234 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5570544-bdb8-4e33-8dee-7f3c79dade17 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:52.671021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5570544-bdb8-4e33-8dee-7f3c79dade17 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:52.675596 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6746ace-1547-4460-a285-1d71b1e1c284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:52.676268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6746ace-1547-4460-a285-1d71b1e1c284 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:52.676551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6746ace-1547-4460-a285-1d71b1e1c284 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:52.676822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6746ace-1547-4460-a285-1d71b1e1c284 admin admin] PATH_INFO: `/v3/projects/1c1d0f7d2dd74c65909f1d7a42b30d3d/users/da48f7ad7380406ab5954d022fe2559d/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:52.691795 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6746ace-1547-4460-a285-1d71b1e1c284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1d0f7d2dd74c65909f1d7a42b30d3d, user_id=da48f7ad7380406ab5954d022fe2559d, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:52.694626 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6746ace-1547-4460-a285-1d71b1e1c284 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:52.763254 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1180/2321] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:03:52 2022] PUT /identity/v3/projects/1c1d0f7d2dd74c65909f1d7a42b30d3d/users/da48f7ad7380406ab5954d022fe2559d/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:03:52.775161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb7fe3-3478-4796-992c-a0b46a4d647f None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:52.775449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb7fe3-3478-4796-992c-a0b46a4d647f None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:52.775744 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb7fe3-3478-4796-992c-a0b46a4d647f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:52.805204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-9dbb7fe3-3478-4796-992c-a0b46a4d647f None None] MFA Rules not processed for user `da48f7ad7380406ab5954d022fe2559d`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:52.806428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9dbb7fe3-3478-4796-992c-a0b46a4d647f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:52.862357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:52.872442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1142/2322] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:03:52.877313 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6746ace-1547-4460-a285-1d71b1e1c284 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:52.887166 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:52.945692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6746ace-1547-4460-a285-1d71b1e1c284 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:52.951233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a1f58-c73a-4ca9-9fb1-f66bca611a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:52.951877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a1f58-c73a-4ca9-9fb1-f66bca611a41 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:52.952161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a1f58-c73a-4ca9-9fb1-f66bca611a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:52.952468 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a1f58-c73a-4ca9-9fb1-f66bca611a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:52.953117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a1f58-c73a-4ca9-9fb1-f66bca611a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:52.955117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a1f58-c73a-4ca9-9fb1-f66bca611a41 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:53.039100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1181/2323] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:03:52 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:03:53.044738 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb7fe3-3478-4796-992c-a0b46a4d647f None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:53.063156 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb7fe3-3478-4796-992c-a0b46a4d647f None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:53.134839 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0a38b-f199-4b8c-8ce0-a91a503e32ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:53.135515 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0a38b-f199-4b8c-8ce0-a91a503e32ee admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:53.135638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0a38b-f199-4b8c-8ce0-a91a503e32ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:53.135876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0a38b-f199-4b8c-8ce0-a91a503e32ee admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:53.137138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0a38b-f199-4b8c-8ce0-a91a503e32ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:53.139063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0a38b-f199-4b8c-8ce0-a91a503e32ee admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:53.238434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1143/2324] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:03:53 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:03:53.242279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a1f58-c73a-4ca9-9fb1-f66bca611a41 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:53.253313 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a1f58-c73a-4ca9-9fb1-f66bca611a41 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:53.257969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe134ab-806f-4447-ba49-cad2a1e09fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:53.258613 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe134ab-806f-4447-ba49-cad2a1e09fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:53.258895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe134ab-806f-4447-ba49-cad2a1e09fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:53.259171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe134ab-806f-4447-ba49-cad2a1e09fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:53.259814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe134ab-806f-4447-ba49-cad2a1e09fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:53.261482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe134ab-806f-4447-ba49-cad2a1e09fe5 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:53.272012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1182/2325] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:03:53.276148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0a38b-f199-4b8c-8ce0-a91a503e32ee admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:53.286104 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0a38b-f199-4b8c-8ce0-a91a503e32ee admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:53.290661 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f109f7-512f-4a26-9054-f7f7b5192b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:53.291307 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f109f7-512f-4a26-9054-f7f7b5192b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:53.291587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f109f7-512f-4a26-9054-f7f7b5192b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:53.291860 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f109f7-512f-4a26-9054-f7f7b5192b1d admin admin] PATH_INFO: `/v3/projects/d23afeeded504291b829d078f5ea1f0f/users/d031811eb1634cbf8f848c40df9fb1c3/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:53.307583 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f109f7-512f-4a26-9054-f7f7b5192b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23afeeded504291b829d078f5ea1f0f, user_id=d031811eb1634cbf8f848c40df9fb1c3, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:53.311168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f109f7-512f-4a26-9054-f7f7b5192b1d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:53.380750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1144/2326] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:03:53 2022] PUT /identity/v3/projects/d23afeeded504291b829d078f5ea1f0f/users/d031811eb1634cbf8f848c40df9fb1c3/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:03:53.384773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe134ab-806f-4447-ba49-cad2a1e09fe5 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:53.395229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe134ab-806f-4447-ba49-cad2a1e09fe5 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:53.452644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c1c3e-4df7-4077-ba24-3e0914730de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:53.453257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c1c3e-4df7-4077-ba24-3e0914730de6 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:53.453537 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c1c3e-4df7-4077-ba24-3e0914730de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:53.453820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c1c3e-4df7-4077-ba24-3e0914730de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:53.454465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c1c3e-4df7-4077-ba24-3e0914730de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:53.456061 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c1c3e-4df7-4077-ba24-3e0914730de6 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:53.466271 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1183/2327] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:03:53.470513 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f109f7-512f-4a26-9054-f7f7b5192b1d admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:53.482364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f109f7-512f-4a26-9054-f7f7b5192b1d admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:53.487198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09f69f-928a-4896-88a4-8133becc5047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:53.487860 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09f69f-928a-4896-88a4-8133becc5047 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:53.488155 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09f69f-928a-4896-88a4-8133becc5047 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:53.488462 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09f69f-928a-4896-88a4-8133becc5047 admin admin] PATH_INFO: `/v3/projects/d23afeeded504291b829d078f5ea1f0f/users/d031811eb1634cbf8f848c40df9fb1c3/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:53.490394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09f69f-928a-4896-88a4-8133becc5047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23afeeded504291b829d078f5ea1f0f, user_id=d031811eb1634cbf8f848c40df9fb1c3, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:53.493061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09f69f-928a-4896-88a4-8133becc5047 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:53.505428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1145/2328] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:03:53 2022] PUT /identity/v3/projects/d23afeeded504291b829d078f5ea1f0f/users/d031811eb1634cbf8f848c40df9fb1c3/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:03:53.517141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db9aa9-22a0-460a-a89e-eabf753d9d2a None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:53.517437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db9aa9-22a0-460a-a89e-eabf753d9d2a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:53.517718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db9aa9-22a0-460a-a89e-eabf753d9d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:53.547269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-c0db9aa9-22a0-460a-a89e-eabf753d9d2a None None] MFA Rules not processed for user `d031811eb1634cbf8f848c40df9fb1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:53.548533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c0db9aa9-22a0-460a-a89e-eabf753d9d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:53.616385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1184/2329] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:03:53.628289 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09f69f-928a-4896-88a4-8133becc5047 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:53.629993 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9b09f69f-928a-4896-88a4-8133becc5047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:53.689852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09f69f-928a-4896-88a4-8133becc5047 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:53.693641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b0aa-9711-43b4-89da-7fc9235b4a94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:53.694246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b0aa-9711-43b4-89da-7fc9235b4a94 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:53.694522 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b0aa-9711-43b4-89da-7fc9235b4a94 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:53.694790 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b0aa-9711-43b4-89da-7fc9235b4a94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:53.704456 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428b0aa-9711-43b4-89da-7fc9235b4a94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:53.705837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428b0aa-9711-43b4-89da-7fc9235b4a94 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:53.715212 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1146/2330] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:03:53.782352 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db9aa9-22a0-460a-a89e-eabf753d9d2a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:53.787805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:53.847006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db9aa9-22a0-460a-a89e-eabf753d9d2a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:53.851609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecdb7d-8a07-44ea-be45-92ec890a0e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:53.852273 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecdb7d-8a07-44ea-be45-92ec890a0e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:53.852558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecdb7d-8a07-44ea-be45-92ec890a0e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:53.852829 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecdb7d-8a07-44ea-be45-92ec890a0e4a admin admin] PATH_INFO: `/v3/users/da48f7ad7380406ab5954d022fe2559d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:53.853959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecdb7d-8a07-44ea-be45-92ec890a0e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da48f7ad7380406ab5954d022fe2559d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:53.856322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecdb7d-8a07-44ea-be45-92ec890a0e4a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:54.056402 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-23ecdb7d-8a07-44ea-be45-92ec890a0e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da48f7ad7380406ab5954d022fe2559d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:54.064154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-23ecdb7d-8a07-44ea-be45-92ec890a0e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da48f7ad7380406ab5954d022fe2559d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:54.128097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-23ecdb7d-8a07-44ea-be45-92ec890a0e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da48f7ad7380406ab5954d022fe2559d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:54.128749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-23ecdb7d-8a07-44ea-be45-92ec890a0e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da48f7ad7380406ab5954d022fe2559d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:54.141831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-23ecdb7d-8a07-44ea-be45-92ec890a0e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da48f7ad7380406ab5954d022fe2559d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:54.148095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1185/2331] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:03:53 2022] DELETE /identity/v3/users/da48f7ad7380406ab5954d022fe2559d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:03:54.153523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec2eb0-d180-424e-a0b1-66c756b711ce None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:54.154047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec2eb0-d180-424e-a0b1-66c756b711ce None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:54.154047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec2eb0-d180-424e-a0b1-66c756b711ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:54.175168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-37ec2eb0-d180-424e-a0b1-66c756b711ce None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:54.176506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-37ec2eb0-d180-424e-a0b1-66c756b711ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:54.227163 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:54.250233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1147/2332] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:03:54.262458 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecdb7d-8a07-44ea-be45-92ec890a0e4a admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:54.264775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-23ecdb7d-8a07-44ea-be45-92ec890a0e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:54.338349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecdb7d-8a07-44ea-be45-92ec890a0e4a admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:54.342817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee899c6-d5bd-46c4-b6ca-156c83eee029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:54.343439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee899c6-d5bd-46c4-b6ca-156c83eee029 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:54.343714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee899c6-d5bd-46c4-b6ca-156c83eee029 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:54.343994 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee899c6-d5bd-46c4-b6ca-156c83eee029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:54.353715 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee899c6-d5bd-46c4-b6ca-156c83eee029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:54.356249 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee899c6-d5bd-46c4-b6ca-156c83eee029 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:54.366405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1186/2333] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:03:54.803198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec2eb0-d180-424e-a0b1-66c756b711ce None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:54.804690 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-37ec2eb0-d180-424e-a0b1-66c756b711ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:54.820577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec2eb0-d180-424e-a0b1-66c756b711ce None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:54.828095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f9527-6a37-451a-a795-ce914d1ac3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:54.828869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f9527-6a37-451a-a795-ce914d1ac3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:54.829059 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f9527-6a37-451a-a795-ce914d1ac3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:54.829325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f9527-6a37-451a-a795-ce914d1ac3a1 admin admin] PATH_INFO: `/v3/projects/1c1d0f7d2dd74c65909f1d7a42b30d3d` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:54.830896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f9527-6a37-451a-a795-ce914d1ac3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1d0f7d2dd74c65909f1d7a42b30d3d)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:54.832481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f9527-6a37-451a-a795-ce914d1ac3a1 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:54.945540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0d9f9527-6a37-451a-a795-ce914d1ac3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1d0f7d2dd74c65909f1d7a42b30d3d', 'request_id': 'req-0d9f9527-6a37-451a-a795-ce914d1ac3a1'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:55.006520 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0d9f9527-6a37-451a-a795-ce914d1ac3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1d0f7d2dd74c65909f1d7a42b30d3d', 'request_id': 'req-0d9f9527-6a37-451a-a795-ce914d1ac3a1'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:55.014054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0d9f9527-6a37-451a-a795-ce914d1ac3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1d0f7d2dd74c65909f1d7a42b30d3d', 'request_id': 'req-0d9f9527-6a37-451a-a795-ce914d1ac3a1'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:55.024815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0d9f9527-6a37-451a-a795-ce914d1ac3a1 admin admin] The token cache is being invalidate because project 1c1d0f7d2dd74c65909f1d7a42b30d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:03:55.025103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0d9f9527-6a37-451a-a795-ce914d1ac3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:55.025737 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0d9f9527-6a37-451a-a795-ce914d1ac3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:55.027921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1148/2334] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:03:54 2022] DELETE /identity/v3/projects/1c1d0f7d2dd74c65909f1d7a42b30d3d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:03:55.031979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee899c6-d5bd-46c4-b6ca-156c83eee029 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:55.041806 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee899c6-d5bd-46c4-b6ca-156c83eee029 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:55.068490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:55.101216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685c6a3-5315-4cfc-a17f-914cb03da43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:55.101781 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685c6a3-5315-4cfc-a17f-914cb03da43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:55.102064 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685c6a3-5315-4cfc-a17f-914cb03da43b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:55.102359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685c6a3-5315-4cfc-a17f-914cb03da43b admin admin] PATH_INFO: `/v3/users/d031811eb1634cbf8f848c40df9fb1c3` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:55.103472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685c6a3-5315-4cfc-a17f-914cb03da43b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d031811eb1634cbf8f848c40df9fb1c3)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:55.105459 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685c6a3-5315-4cfc-a17f-914cb03da43b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:55.278517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-3685c6a3-5315-4cfc-a17f-914cb03da43b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd031811eb1634cbf8f848c40df9fb1c3'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:55.285706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-3685c6a3-5315-4cfc-a17f-914cb03da43b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd031811eb1634cbf8f848c40df9fb1c3'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:55.340801 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-3685c6a3-5315-4cfc-a17f-914cb03da43b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd031811eb1634cbf8f848c40df9fb1c3'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:55.341591 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-3685c6a3-5315-4cfc-a17f-914cb03da43b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd031811eb1634cbf8f848c40df9fb1c3'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:55.359768 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-3685c6a3-5315-4cfc-a17f-914cb03da43b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd031811eb1634cbf8f848c40df9fb1c3'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:55.365534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1187/2335] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:03:55 2022] DELETE /identity/v3/users/d031811eb1634cbf8f848c40df9fb1c3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:03:55.799399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f9527-6a37-451a-a795-ce914d1ac3a1 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:55.800987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0d9f9527-6a37-451a-a795-ce914d1ac3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:55.815577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f9527-6a37-451a-a795-ce914d1ac3a1 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:55.874862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757f83e-b8d9-490d-baf0-1c1360c78f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:55.875492 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757f83e-b8d9-490d-baf0-1c1360c78f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:55.875749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757f83e-b8d9-490d-baf0-1c1360c78f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:55.876031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757f83e-b8d9-490d-baf0-1c1360c78f5b admin admin] PATH_INFO: `/v3/projects/d23afeeded504291b829d078f5ea1f0f` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:55.877241 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757f83e-b8d9-490d-baf0-1c1360c78f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d23afeeded504291b829d078f5ea1f0f)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:55.879159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757f83e-b8d9-490d-baf0-1c1360c78f5b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:55.992342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0757f83e-b8d9-490d-baf0-1c1360c78f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd23afeeded504291b829d078f5ea1f0f', 'request_id': 'req-0757f83e-b8d9-490d-baf0-1c1360c78f5b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:56.088565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0757f83e-b8d9-490d-baf0-1c1360c78f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd23afeeded504291b829d078f5ea1f0f', 'request_id': 'req-0757f83e-b8d9-490d-baf0-1c1360c78f5b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:56.095999 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0757f83e-b8d9-490d-baf0-1c1360c78f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd23afeeded504291b829d078f5ea1f0f', 'request_id': 'req-0757f83e-b8d9-490d-baf0-1c1360c78f5b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:56.107073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0757f83e-b8d9-490d-baf0-1c1360c78f5b admin admin] The token cache is being invalidate because project d23afeeded504291b829d078f5ea1f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:03:56.107369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0757f83e-b8d9-490d-baf0-1c1360c78f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:56.108027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0757f83e-b8d9-490d-baf0-1c1360c78f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:03:56.109570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1149/2336] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:03:55 2022] DELETE /identity/v3/projects/d23afeeded504291b829d078f5ea1f0f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:03:56.114466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a33a3f-471c-4575-8e10-9fb3b43d6e42 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:56.114951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a33a3f-471c-4575-8e10-9fb3b43d6e42 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:56.115069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a33a3f-471c-4575-8e10-9fb3b43d6e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:56.135607 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-d7a33a3f-471c-4575-8e10-9fb3b43d6e42 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:56.136901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d7a33a3f-471c-4575-8e10-9fb3b43d6e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:56.196044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1188/2337] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:03:56.204445 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42126385-1d44-4f91-935b-8ad15326f7dc None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:56.204735 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42126385-1d44-4f91-935b-8ad15326f7dc None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:56.205031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42126385-1d44-4f91-935b-8ad15326f7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:56.212766 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:56.225940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-42126385-1d44-4f91-935b-8ad15326f7dc None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:56.227141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-42126385-1d44-4f91-935b-8ad15326f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:56.235360 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1150/2338] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:03:56.240440 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a33a3f-471c-4575-8e10-9fb3b43d6e42 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:56.250629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a33a3f-471c-4575-8e10-9fb3b43d6e42 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:56.255171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b193841-68f3-4e27-925a-0d27877ca55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:56.255768 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b193841-68f3-4e27-925a-0d27877ca55c admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:56.256042 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b193841-68f3-4e27-925a-0d27877ca55c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:56.256355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b193841-68f3-4e27-925a-0d27877ca55c admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:56.256999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b193841-68f3-4e27-925a-0d27877ca55c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:03:56.257299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b193841-68f3-4e27-925a-0d27877ca55c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:56.258883 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b193841-68f3-4e27-925a-0d27877ca55c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:56.271211 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1189/2339] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:03:56.275609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42126385-1d44-4f91-935b-8ad15326f7dc None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:56.285997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42126385-1d44-4f91-935b-8ad15326f7dc None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:56.291869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01200361-cec1-4290-b3cf-916f89317c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:56.292550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200361-cec1-4290-b3cf-916f89317c46 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:56.293045 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200361-cec1-4290-b3cf-916f89317c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:56.293228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200361-cec1-4290-b3cf-916f89317c46 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:56.293888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01200361-cec1-4290-b3cf-916f89317c46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:56.295757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01200361-cec1-4290-b3cf-916f89317c46 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:56.375617 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1151/2340] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:03:56 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:03:56.380123 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b193841-68f3-4e27-925a-0d27877ca55c admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:56.391349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b193841-68f3-4e27-925a-0d27877ca55c admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:56.421159 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:56.447254 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03509c75-f51a-4d67-a968-d2552b924acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:56.447858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03509c75-f51a-4d67-a968-d2552b924acf admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:56.448132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03509c75-f51a-4d67-a968-d2552b924acf admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:56.448446 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03509c75-f51a-4d67-a968-d2552b924acf admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:56.449665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03509c75-f51a-4d67-a968-d2552b924acf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:56.451566 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03509c75-f51a-4d67-a968-d2552b924acf admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:56.559547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1190/2341] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:03:56 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:03:56.564770 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01200361-cec1-4290-b3cf-916f89317c46 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:56.576224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01200361-cec1-4290-b3cf-916f89317c46 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:56.581228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec911dc-a174-4983-9787-5082a8504d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:56.581851 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec911dc-a174-4983-9787-5082a8504d0a admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:56.582137 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec911dc-a174-4983-9787-5082a8504d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:56.582414 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec911dc-a174-4983-9787-5082a8504d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:56.583073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec911dc-a174-4983-9787-5082a8504d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:56.584786 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec911dc-a174-4983-9787-5082a8504d0a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:56.596604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1152/2342] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:03:56.600588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03509c75-f51a-4d67-a968-d2552b924acf admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:56.610700 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03509c75-f51a-4d67-a968-d2552b924acf admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:56.615859 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4039da-53ed-44c9-826b-d26427f611b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:56.616524 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4039da-53ed-44c9-826b-d26427f611b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:56.617286 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4039da-53ed-44c9-826b-d26427f611b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:56.617286 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4039da-53ed-44c9-826b-d26427f611b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:56.617704 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4039da-53ed-44c9-826b-d26427f611b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:56.619321 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4039da-53ed-44c9-826b-d26427f611b4 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:56.631432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1191/2343] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:03:56.635727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec911dc-a174-4983-9787-5082a8504d0a admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:56.646933 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec911dc-a174-4983-9787-5082a8504d0a admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:56.651673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb4abd-18ac-49f8-a0d3-1a174952974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:56.652569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb4abd-18ac-49f8-a0d3-1a174952974f admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:56.652866 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb4abd-18ac-49f8-a0d3-1a174952974f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:56.653140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb4abd-18ac-49f8-a0d3-1a174952974f admin admin] PATH_INFO: `/v3/projects/e221eff087044951b253f0f7374b810a/users/b1d22ad479fb4afb994d13255ab34ade/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:56.679635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb4abd-18ac-49f8-a0d3-1a174952974f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e221eff087044951b253f0f7374b810a, user_id=b1d22ad479fb4afb994d13255ab34ade, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:56.682379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb4abd-18ac-49f8-a0d3-1a174952974f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:56.777631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1153/2344] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:03:56 2022] PUT /identity/v3/projects/e221eff087044951b253f0f7374b810a/users/b1d22ad479fb4afb994d13255ab34ade/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:03:56.789918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe88583-41b3-4f66-90a5-c90759316ac7 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:56.790439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe88583-41b3-4f66-90a5-c90759316ac7 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:56.790929 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe88583-41b3-4f66-90a5-c90759316ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:56.825270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-ebe88583-41b3-4f66-90a5-c90759316ac7 None None] MFA Rules not processed for user `b1d22ad479fb4afb994d13255ab34ade`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:56.826401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ebe88583-41b3-4f66-90a5-c90759316ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:56.892797 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1192/2345] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:03:56.897537 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb4abd-18ac-49f8-a0d3-1a174952974f admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:56.961843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb4abd-18ac-49f8-a0d3-1a174952974f admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:56.967298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5bfc9-b2e5-47a8-91aa-a06cbf00ee43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:56.967904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5bfc9-b2e5-47a8-91aa-a06cbf00ee43 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:56.968195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5bfc9-b2e5-47a8-91aa-a06cbf00ee43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:56.968499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5bfc9-b2e5-47a8-91aa-a06cbf00ee43 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:56.969152 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5bfc9-b2e5-47a8-91aa-a06cbf00ee43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:56.971044 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5bfc9-b2e5-47a8-91aa-a06cbf00ee43 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:57.044416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1154/2346] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:03:56 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:03:57.048637 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe88583-41b3-4f66-90a5-c90759316ac7 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:57.059830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe88583-41b3-4f66-90a5-c90759316ac7 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:57.115810 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a3afc-cdb7-4edc-9d45-9ed74de532cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:57.116592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a3afc-cdb7-4edc-9d45-9ed74de532cf admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:57.116707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a3afc-cdb7-4edc-9d45-9ed74de532cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:57.116882 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a3afc-cdb7-4edc-9d45-9ed74de532cf admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:57.117568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a3afc-cdb7-4edc-9d45-9ed74de532cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:57.119479 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a3afc-cdb7-4edc-9d45-9ed74de532cf admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:57.196400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1193/2347] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:03:57 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:03:57.201291 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5bfc9-b2e5-47a8-91aa-a06cbf00ee43 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:57.211891 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5bfc9-b2e5-47a8-91aa-a06cbf00ee43 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:57.219013 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb4fce-36da-4f80-b8fe-82e6724db722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:57.219615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb4fce-36da-4f80-b8fe-82e6724db722 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:57.219894 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb4fce-36da-4f80-b8fe-82e6724db722 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:57.220167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb4fce-36da-4f80-b8fe-82e6724db722 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:57.220840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb4fce-36da-4f80-b8fe-82e6724db722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:57.222432 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb4fce-36da-4f80-b8fe-82e6724db722 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:57.233694 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1155/2348] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:03:57.238271 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a3afc-cdb7-4edc-9d45-9ed74de532cf admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:57.249006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a3afc-cdb7-4edc-9d45-9ed74de532cf admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:57.253698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25167fd-85cd-4b38-921a-0f47882733df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:57.254349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25167fd-85cd-4b38-921a-0f47882733df admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:57.254627 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25167fd-85cd-4b38-921a-0f47882733df admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:57.254901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25167fd-85cd-4b38-921a-0f47882733df admin admin] PATH_INFO: `/v3/projects/e1695ef601da4669a8b2a9716b4e027c/users/779abd9c783846d59d1eb39e745bc1b8/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:57.270221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25167fd-85cd-4b38-921a-0f47882733df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1695ef601da4669a8b2a9716b4e027c, user_id=779abd9c783846d59d1eb39e745bc1b8, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:57.272893 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25167fd-85cd-4b38-921a-0f47882733df admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:57.369269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1194/2349] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:03:57 2022] PUT /identity/v3/projects/e1695ef601da4669a8b2a9716b4e027c/users/779abd9c783846d59d1eb39e745bc1b8/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:03:57.374044 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb4fce-36da-4f80-b8fe-82e6724db722 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:57.384459 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb4fce-36da-4f80-b8fe-82e6724db722 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:57.447028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d02e8b-9006-4867-827f-6a554d6b1c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:57.447636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d02e8b-9006-4867-827f-6a554d6b1c68 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:57.447916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d02e8b-9006-4867-827f-6a554d6b1c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:57.448203 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d02e8b-9006-4867-827f-6a554d6b1c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:57.448855 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d02e8b-9006-4867-827f-6a554d6b1c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:57.451418 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d02e8b-9006-4867-827f-6a554d6b1c68 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:57.461345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1156/2350] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:03:57.465817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25167fd-85cd-4b38-921a-0f47882733df admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:57.476208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25167fd-85cd-4b38-921a-0f47882733df admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:57.481654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41108f0-5aef-4f0c-9127-70722d533980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:57.482318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41108f0-5aef-4f0c-9127-70722d533980 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:57.482627 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41108f0-5aef-4f0c-9127-70722d533980 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:57.482901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41108f0-5aef-4f0c-9127-70722d533980 admin admin] PATH_INFO: `/v3/projects/e1695ef601da4669a8b2a9716b4e027c/users/779abd9c783846d59d1eb39e745bc1b8/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:57.484918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41108f0-5aef-4f0c-9127-70722d533980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1695ef601da4669a8b2a9716b4e027c, user_id=779abd9c783846d59d1eb39e745bc1b8, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:57.487552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41108f0-5aef-4f0c-9127-70722d533980 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:57.489864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:57.499750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1195/2351] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:03:57 2022] PUT /identity/v3/projects/e1695ef601da4669a8b2a9716b4e027c/users/779abd9c783846d59d1eb39e745bc1b8/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:03:57.514039 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd04f5c-a78b-410a-a3a8-327b34a23330 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:57.514325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd04f5c-a78b-410a-a3a8-327b34a23330 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:57.514602 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd04f5c-a78b-410a-a3a8-327b34a23330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:57.534959 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:57.543952 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-4fd04f5c-a78b-410a-a3a8-327b34a23330 None None] MFA Rules not processed for user `779abd9c783846d59d1eb39e745bc1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:03:57.545213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4fd04f5c-a78b-410a-a3a8-327b34a23330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:57.615059 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1157/2352] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:03:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:03:57.627128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41108f0-5aef-4f0c-9127-70722d533980 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:57.628911 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d41108f0-5aef-4f0c-9127-70722d533980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:57.686848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41108f0-5aef-4f0c-9127-70722d533980 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:57.690479 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf59275-b979-43c2-b0f1-4413903c586a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:57.691083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf59275-b979-43c2-b0f1-4413903c586a service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:57.691360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf59275-b979-43c2-b0f1-4413903c586a service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:57.691628 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf59275-b979-43c2-b0f1-4413903c586a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:57.701291 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf59275-b979-43c2-b0f1-4413903c586a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:57.702781 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf59275-b979-43c2-b0f1-4413903c586a service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:57.712789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1196/2353] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:03:58.001599 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd04f5c-a78b-410a-a3a8-327b34a23330 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:58.012157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd04f5c-a78b-410a-a3a8-327b34a23330 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:58.016031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11137c5a-bb59-4beb-8ce5-a221b72ee8ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:58.020113 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11137c5a-bb59-4beb-8ce5-a221b72ee8ea service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:58.020113 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11137c5a-bb59-4beb-8ce5-a221b72ee8ea service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:58.020113 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11137c5a-bb59-4beb-8ce5-a221b72ee8ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:58.075268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11137c5a-bb59-4beb-8ce5-a221b72ee8ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:58.076756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11137c5a-bb59-4beb-8ce5-a221b72ee8ea service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:58.085558 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1158/2354] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:04.499172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf59275-b979-43c2-b0f1-4413903c586a service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:04.561368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf59275-b979-43c2-b0f1-4413903c586a service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:04.565994 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8b44c-b572-4319-864d-a1a16fe64b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:04.566620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8b44c-b572-4319-864d-a1a16fe64b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:04.566910 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8b44c-b572-4319-864d-a1a16fe64b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:04.567180 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8b44c-b572-4319-864d-a1a16fe64b0a admin admin] PATH_INFO: `/v3/users/b1d22ad479fb4afb994d13255ab34ade` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:04.568320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8b44c-b572-4319-864d-a1a16fe64b0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d22ad479fb4afb994d13255ab34ade)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:04.570234 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8b44c-b572-4319-864d-a1a16fe64b0a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:04.728699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9ad8b44c-b572-4319-864d-a1a16fe64b0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d22ad479fb4afb994d13255ab34ade'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:04.735999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9ad8b44c-b572-4319-864d-a1a16fe64b0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d22ad479fb4afb994d13255ab34ade'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:04.820040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9ad8b44c-b572-4319-864d-a1a16fe64b0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d22ad479fb4afb994d13255ab34ade'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:04.820743 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9ad8b44c-b572-4319-864d-a1a16fe64b0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d22ad479fb4afb994d13255ab34ade'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:04.834644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9ad8b44c-b572-4319-864d-a1a16fe64b0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d22ad479fb4afb994d13255ab34ade'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:04.841569 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1197/2355] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:04:04 2022] DELETE /identity/v3/users/b1d22ad479fb4afb994d13255ab34ade => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:04.846248 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932334ee-4212-46cb-b17d-83e67847b6c0 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:04.846708 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932334ee-4212-46cb-b17d-83e67847b6c0 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:04.846824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932334ee-4212-46cb-b17d-83e67847b6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:04.867325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-932334ee-4212-46cb-b17d-83e67847b6c0 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:04.868590 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-932334ee-4212-46cb-b17d-83e67847b6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:04.952587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1159/2356] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:04:04.976458 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8b44c-b572-4319-864d-a1a16fe64b0a admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:04.978331 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-9ad8b44c-b572-4319-864d-a1a16fe64b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:05.001528 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:05.051792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8b44c-b572-4319-864d-a1a16fe64b0a admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:05.056030 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278575e-3870-4131-821a-4a5e07e59384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:05.056713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278575e-3870-4131-821a-4a5e07e59384 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:05.056986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278575e-3870-4131-821a-4a5e07e59384 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:05.057239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278575e-3870-4131-821a-4a5e07e59384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:05.071232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278575e-3870-4131-821a-4a5e07e59384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:05.072718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278575e-3870-4131-821a-4a5e07e59384 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:05.084227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1198/2357] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:05.536561 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932334ee-4212-46cb-b17d-83e67847b6c0 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:05.538198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-932334ee-4212-46cb-b17d-83e67847b6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:05.552035 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932334ee-4212-46cb-b17d-83e67847b6c0 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:05.556741 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffafc62-dbdb-466b-9aae-efdf15389a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:05.557374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffafc62-dbdb-466b-9aae-efdf15389a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:05.557689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffafc62-dbdb-466b-9aae-efdf15389a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:05.558843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffafc62-dbdb-466b-9aae-efdf15389a1a admin admin] PATH_INFO: `/v3/projects/e221eff087044951b253f0f7374b810a` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:05.560768 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffafc62-dbdb-466b-9aae-efdf15389a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e221eff087044951b253f0f7374b810a)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:05.562719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffafc62-dbdb-466b-9aae-efdf15389a1a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:05.649018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:05.664150 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-9ffafc62-dbdb-466b-9aae-efdf15389a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e221eff087044951b253f0f7374b810a', 'request_id': 'req-9ffafc62-dbdb-466b-9aae-efdf15389a1a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:05.761073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-9ffafc62-dbdb-466b-9aae-efdf15389a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e221eff087044951b253f0f7374b810a', 'request_id': 'req-9ffafc62-dbdb-466b-9aae-efdf15389a1a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:05.768741 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-9ffafc62-dbdb-466b-9aae-efdf15389a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e221eff087044951b253f0f7374b810a', 'request_id': 'req-9ffafc62-dbdb-466b-9aae-efdf15389a1a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:05.780878 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-9ffafc62-dbdb-466b-9aae-efdf15389a1a admin admin] The token cache is being invalidate because project e221eff087044951b253f0f7374b810a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:04:05.781105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-9ffafc62-dbdb-466b-9aae-efdf15389a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:05.781755 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-9ffafc62-dbdb-466b-9aae-efdf15389a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:05.783270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1160/2358] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:04:05 2022] DELETE /identity/v3/projects/e221eff087044951b253f0f7374b810a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:05.787425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278575e-3870-4131-821a-4a5e07e59384 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:05.797434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278575e-3870-4131-821a-4a5e07e59384 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:05.855463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b3833-acf8-4b0f-b123-60f7644c7c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:05.856084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b3833-acf8-4b0f-b123-60f7644c7c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:05.856453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b3833-acf8-4b0f-b123-60f7644c7c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:05.856730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b3833-acf8-4b0f-b123-60f7644c7c3b admin admin] PATH_INFO: `/v3/users/779abd9c783846d59d1eb39e745bc1b8` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:05.858037 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b3833-acf8-4b0f-b123-60f7644c7c3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=779abd9c783846d59d1eb39e745bc1b8)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:05.859983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b3833-acf8-4b0f-b123-60f7644c7c3b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:05.994101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-840b3833-acf8-4b0f-b123-60f7644c7c3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '779abd9c783846d59d1eb39e745bc1b8'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:06.001815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-840b3833-acf8-4b0f-b123-60f7644c7c3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '779abd9c783846d59d1eb39e745bc1b8'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:06.061254 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-840b3833-acf8-4b0f-b123-60f7644c7c3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '779abd9c783846d59d1eb39e745bc1b8'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:06.061858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-840b3833-acf8-4b0f-b123-60f7644c7c3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '779abd9c783846d59d1eb39e745bc1b8'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:06.080294 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-840b3833-acf8-4b0f-b123-60f7644c7c3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '779abd9c783846d59d1eb39e745bc1b8'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:06.087277 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1199/2359] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:04:05 2022] DELETE /identity/v3/users/779abd9c783846d59d1eb39e745bc1b8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:06.667032 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffafc62-dbdb-466b-9aae-efdf15389a1a admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:06.668561 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9ffafc62-dbdb-466b-9aae-efdf15389a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:06.684129 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffafc62-dbdb-466b-9aae-efdf15389a1a admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:06.746927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9a5a4-6c88-4af4-a7d8-6dafe29b3c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:06.747628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9a5a4-6c88-4af4-a7d8-6dafe29b3c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:06.747998 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9a5a4-6c88-4af4-a7d8-6dafe29b3c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:06.748151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9a5a4-6c88-4af4-a7d8-6dafe29b3c1e admin admin] PATH_INFO: `/v3/projects/e1695ef601da4669a8b2a9716b4e027c` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:06.749599 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9a5a4-6c88-4af4-a7d8-6dafe29b3c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1695ef601da4669a8b2a9716b4e027c)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:06.751516 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9a5a4-6c88-4af4-a7d8-6dafe29b3c1e admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:06.860422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c2b9a5a4-6c88-4af4-a7d8-6dafe29b3c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1695ef601da4669a8b2a9716b4e027c', 'request_id': 'req-c2b9a5a4-6c88-4af4-a7d8-6dafe29b3c1e'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:06.917888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c2b9a5a4-6c88-4af4-a7d8-6dafe29b3c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1695ef601da4669a8b2a9716b4e027c', 'request_id': 'req-c2b9a5a4-6c88-4af4-a7d8-6dafe29b3c1e'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:06.926544 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c2b9a5a4-6c88-4af4-a7d8-6dafe29b3c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1695ef601da4669a8b2a9716b4e027c', 'request_id': 'req-c2b9a5a4-6c88-4af4-a7d8-6dafe29b3c1e'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:06.938892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c2b9a5a4-6c88-4af4-a7d8-6dafe29b3c1e admin admin] The token cache is being invalidate because project e1695ef601da4669a8b2a9716b4e027c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:04:06.939202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c2b9a5a4-6c88-4af4-a7d8-6dafe29b3c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:06.940312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c2b9a5a4-6c88-4af4-a7d8-6dafe29b3c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:06.941404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1161/2360] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:04:06 2022] DELETE /identity/v3/projects/e1695ef601da4669a8b2a9716b4e027c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:06.946588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6f7e9-dc91-437e-ac18-b646c0a013e7 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:06.947106 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6f7e9-dc91-437e-ac18-b646c0a013e7 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:06.947286 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6f7e9-dc91-437e-ac18-b646c0a013e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:06.970426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-aae6f7e9-dc91-437e-ac18-b646c0a013e7 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:06.972000 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-aae6f7e9-dc91-437e-ac18-b646c0a013e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:07.013007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:07.042469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1200/2361] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:07.050835 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90f90a-870c-4bb3-aec1-58a95728fc8a None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:07.051112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90f90a-870c-4bb3-aec1-58a95728fc8a None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:07.051386 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90f90a-870c-4bb3-aec1-58a95728fc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:07.079616 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-ea90f90a-870c-4bb3-aec1-58a95728fc8a None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:07.080904 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-ea90f90a-870c-4bb3-aec1-58a95728fc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:07.090315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1162/2362] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:07.097838 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6f7e9-dc91-437e-ac18-b646c0a013e7 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:07.110870 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6f7e9-dc91-437e-ac18-b646c0a013e7 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:07.119472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ed0b5-c434-46b2-8459-4363749bc4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:07.120512 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ed0b5-c434-46b2-8459-4363749bc4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:07.121048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ed0b5-c434-46b2-8459-4363749bc4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:07.121515 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ed0b5-c434-46b2-8459-4363749bc4f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:07.123282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ed0b5-c434-46b2-8459-4363749bc4f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:04:07.123708 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ed0b5-c434-46b2-8459-4363749bc4f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:07.126783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ed0b5-c434-46b2-8459-4363749bc4f9 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:07.146051 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1201/2363] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:04:07.150030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90f90a-870c-4bb3-aec1-58a95728fc8a None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:07.160179 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90f90a-870c-4bb3-aec1-58a95728fc8a None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:07.165366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3057b0-c1e5-4cb6-b21a-247b268f00fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:07.165988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3057b0-c1e5-4cb6-b21a-247b268f00fd admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:07.166267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3057b0-c1e5-4cb6-b21a-247b268f00fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:07.166537 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3057b0-c1e5-4cb6-b21a-247b268f00fd admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:07.169314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3057b0-c1e5-4cb6-b21a-247b268f00fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:07.169314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3057b0-c1e5-4cb6-b21a-247b268f00fd admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:07.285418 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1163/2364] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:04:07 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:04:07.289644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ed0b5-c434-46b2-8459-4363749bc4f9 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:07.300248 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ed0b5-c434-46b2-8459-4363749bc4f9 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:07.374526 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2bec2-1f38-45ec-a32e-7e0e14056488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:07.375247 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2bec2-1f38-45ec-a32e-7e0e14056488 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:07.375459 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2bec2-1f38-45ec-a32e-7e0e14056488 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:07.375706 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2bec2-1f38-45ec-a32e-7e0e14056488 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:07.376396 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2bec2-1f38-45ec-a32e-7e0e14056488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:07.378375 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2bec2-1f38-45ec-a32e-7e0e14056488 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:07.459517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1202/2365] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:04:07 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:04:07.463501 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3057b0-c1e5-4cb6-b21a-247b268f00fd admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:07.475312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3057b0-c1e5-4cb6-b21a-247b268f00fd admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:07.481784 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a6ecb-2deb-43d1-bb6e-a3d40836cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:07.483003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a6ecb-2deb-43d1-bb6e-a3d40836cfce admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:07.483573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a6ecb-2deb-43d1-bb6e-a3d40836cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:07.484162 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a6ecb-2deb-43d1-bb6e-a3d40836cfce admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:07.485457 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a6ecb-2deb-43d1-bb6e-a3d40836cfce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:07.488907 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a6ecb-2deb-43d1-bb6e-a3d40836cfce admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:07.506023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1164/2366] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:04:07.507379 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2bec2-1f38-45ec-a32e-7e0e14056488 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:07.521239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2bec2-1f38-45ec-a32e-7e0e14056488 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:07.526529 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d242f8-0639-460c-867c-a25a4acc1970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:07.527306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d242f8-0639-460c-867c-a25a4acc1970 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:07.527591 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d242f8-0639-460c-867c-a25a4acc1970 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:07.527868 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d242f8-0639-460c-867c-a25a4acc1970 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:07.528663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d242f8-0639-460c-867c-a25a4acc1970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:07.530630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d242f8-0639-460c-867c-a25a4acc1970 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:07.547800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1203/2367] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:04:07.552130 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a6ecb-2deb-43d1-bb6e-a3d40836cfce admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:07.567982 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a6ecb-2deb-43d1-bb6e-a3d40836cfce admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:07.573620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c8be-9293-426d-88e1-803f908278e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:07.574304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c8be-9293-426d-88e1-803f908278e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:07.574583 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c8be-9293-426d-88e1-803f908278e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:07.574857 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c8be-9293-426d-88e1-803f908278e0 admin admin] PATH_INFO: `/v3/projects/578bdd0fe54b4deb8fc40949fb8ca435/users/da1416e86db040c4aa287a504b209847/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:07.577612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:07.593379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828c8be-9293-426d-88e1-803f908278e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578bdd0fe54b4deb8fc40949fb8ca435, user_id=da1416e86db040c4aa287a504b209847, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:07.596254 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828c8be-9293-426d-88e1-803f908278e0 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:07.660786 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1165/2368] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:04:07 2022] PUT /identity/v3/projects/578bdd0fe54b4deb8fc40949fb8ca435/users/da1416e86db040c4aa287a504b209847/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:07.671439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9203e-56a1-49d0-bb9d-39043c8085c3 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:07.671751 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9203e-56a1-49d0-bb9d-39043c8085c3 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:07.672027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9203e-56a1-49d0-bb9d-39043c8085c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:07.701636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-49e9203e-56a1-49d0-bb9d-39043c8085c3 None None] MFA Rules not processed for user `da1416e86db040c4aa287a504b209847`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:07.702848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-49e9203e-56a1-49d0-bb9d-39043c8085c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:07.768284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1204/2369] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:04:07.773180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c8be-9293-426d-88e1-803f908278e0 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:07.842444 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c8be-9293-426d-88e1-803f908278e0 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:07.847239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bc674-762e-4f64-b67a-e1379b6bce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:07.847851 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bc674-762e-4f64-b67a-e1379b6bce5b admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:07.848140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bc674-762e-4f64-b67a-e1379b6bce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:07.848450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bc674-762e-4f64-b67a-e1379b6bce5b admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:07.849090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bc674-762e-4f64-b67a-e1379b6bce5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:07.851403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bc674-762e-4f64-b67a-e1379b6bce5b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:07.953936 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1166/2370] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:04:07 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:04:07.957303 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9203e-56a1-49d0-bb9d-39043c8085c3 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:07.968813 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9203e-56a1-49d0-bb9d-39043c8085c3 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:08.000858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:08.027953 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9baa6-71e1-4803-92d3-d7501d38bf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:08.029741 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9baa6-71e1-4803-92d3-d7501d38bf43 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:08.031093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9baa6-71e1-4803-92d3-d7501d38bf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:08.031093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9baa6-71e1-4803-92d3-d7501d38bf43 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:08.031093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9baa6-71e1-4803-92d3-d7501d38bf43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:08.032878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9baa6-71e1-4803-92d3-d7501d38bf43 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:08.129577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1205/2371] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:04:07 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:04:08.133670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bc674-762e-4f64-b67a-e1379b6bce5b admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:08.144620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bc674-762e-4f64-b67a-e1379b6bce5b admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:08.149288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf6fe3-337b-40b8-b44b-5c641506ebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:08.149883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf6fe3-337b-40b8-b44b-5c641506ebfd admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:08.150160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf6fe3-337b-40b8-b44b-5c641506ebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:08.150431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf6fe3-337b-40b8-b44b-5c641506ebfd admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:08.151104 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf6fe3-337b-40b8-b44b-5c641506ebfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:08.152709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf6fe3-337b-40b8-b44b-5c641506ebfd admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:08.164065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1167/2372] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:08.168379 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9baa6-71e1-4803-92d3-d7501d38bf43 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:08.179160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9baa6-71e1-4803-92d3-d7501d38bf43 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:08.184477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cbb51-3a5a-4286-8302-9a842bd85d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:08.185146 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cbb51-3a5a-4286-8302-9a842bd85d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:08.185424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cbb51-3a5a-4286-8302-9a842bd85d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:08.185694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cbb51-3a5a-4286-8302-9a842bd85d85 admin admin] PATH_INFO: `/v3/projects/e564bbd7724d438ab4b2af2bac0e212e/users/3c448d57fee84fa6839b6d449ac9d0b7/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:08.201307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cbb51-3a5a-4286-8302-9a842bd85d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e564bbd7724d438ab4b2af2bac0e212e, user_id=3c448d57fee84fa6839b6d449ac9d0b7, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:08.204447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cbb51-3a5a-4286-8302-9a842bd85d85 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:08.275867 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1206/2373] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:04:08 2022] PUT /identity/v3/projects/e564bbd7724d438ab4b2af2bac0e212e/users/3c448d57fee84fa6839b6d449ac9d0b7/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:08.282494 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf6fe3-337b-40b8-b44b-5c641506ebfd admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:08.300244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf6fe3-337b-40b8-b44b-5c641506ebfd admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:08.360347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2f4bb-8aa0-4981-8d20-d283394da1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:08.360953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2f4bb-8aa0-4981-8d20-d283394da1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:08.361234 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2f4bb-8aa0-4981-8d20-d283394da1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:08.361508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2f4bb-8aa0-4981-8d20-d283394da1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:08.362162 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2f4bb-8aa0-4981-8d20-d283394da1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:08.363758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2f4bb-8aa0-4981-8d20-d283394da1a9 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:08.373820 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1168/2374] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:08.378018 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cbb51-3a5a-4286-8302-9a842bd85d85 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:08.388977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cbb51-3a5a-4286-8302-9a842bd85d85 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:08.394084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9ee84-15ed-44ee-b6f2-001fec540dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:08.394742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9ee84-15ed-44ee-b6f2-001fec540dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:08.395019 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9ee84-15ed-44ee-b6f2-001fec540dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:08.395292 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9ee84-15ed-44ee-b6f2-001fec540dc0 admin admin] PATH_INFO: `/v3/projects/e564bbd7724d438ab4b2af2bac0e212e/users/3c448d57fee84fa6839b6d449ac9d0b7/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:08.397273 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9ee84-15ed-44ee-b6f2-001fec540dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e564bbd7724d438ab4b2af2bac0e212e, user_id=3c448d57fee84fa6839b6d449ac9d0b7, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:08.399934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9ee84-15ed-44ee-b6f2-001fec540dc0 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:08.411310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1207/2375] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:04:08 2022] PUT /identity/v3/projects/e564bbd7724d438ab4b2af2bac0e212e/users/3c448d57fee84fa6839b6d449ac9d0b7/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:08.421940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af069a-ef37-40e3-81fa-d5902b632d0d None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:08.422224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af069a-ef37-40e3-81fa-d5902b632d0d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:08.422500 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af069a-ef37-40e3-81fa-d5902b632d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:08.451532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-71af069a-ef37-40e3-81fa-d5902b632d0d None None] MFA Rules not processed for user `3c448d57fee84fa6839b6d449ac9d0b7`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:08.452787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-71af069a-ef37-40e3-81fa-d5902b632d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:08.497842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:08.525974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1169/2376] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:04:08.537096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9ee84-15ed-44ee-b6f2-001fec540dc0 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:08.538847 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ccc9ee84-15ed-44ee-b6f2-001fec540dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:08.604104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9ee84-15ed-44ee-b6f2-001fec540dc0 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:08.609371 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba181d-6da8-4324-a284-0e1a50bc24e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:08.610256 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba181d-6da8-4324-a284-0e1a50bc24e3 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:08.610699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba181d-6da8-4324-a284-0e1a50bc24e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:08.611300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba181d-6da8-4324-a284-0e1a50bc24e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:08.625495 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba181d-6da8-4324-a284-0e1a50bc24e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:08.627349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba181d-6da8-4324-a284-0e1a50bc24e3 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:08.640277 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1208/2377] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:09.130136 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af069a-ef37-40e3-81fa-d5902b632d0d None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:09.131183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-71af069a-ef37-40e3-81fa-d5902b632d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:09.186451 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016891ac-f36c-4ae6-a370-14af05fff9aa None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:09.187025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016891ac-f36c-4ae6-a370-14af05fff9aa None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:09.187025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016891ac-f36c-4ae6-a370-14af05fff9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:09.206853 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-016891ac-f36c-4ae6-a370-14af05fff9aa None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:09.208124 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-016891ac-f36c-4ae6-a370-14af05fff9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:09.208864 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af069a-ef37-40e3-81fa-d5902b632d0d None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:09.214828 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac46c14-e5ee-478f-87f8-409c9321effa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:09.215452 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac46c14-e5ee-478f-87f8-409c9321effa service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:09.216339 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac46c14-e5ee-478f-87f8-409c9321effa service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:09.216840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac46c14-e5ee-478f-87f8-409c9321effa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:09.218846 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8ac46c14-e5ee-478f-87f8-409c9321effa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:09.231937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac46c14-e5ee-478f-87f8-409c9321effa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:09.233985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac46c14-e5ee-478f-87f8-409c9321effa service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:09.246081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1170/2378] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:09.257319 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac46c14-e5ee-478f-87f8-409c9321effa service nova] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:09.280723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1209/2379] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Aug 29 23:04:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:04:09.336005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac46c14-e5ee-478f-87f8-409c9321effa service nova] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:09.340623 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c08e8-2d2e-4367-ac8b-7b7b4da599fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:09.341263 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c08e8-2d2e-4367-ac8b-7b7b4da599fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:09.341543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c08e8-2d2e-4367-ac8b-7b7b4da599fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:09.341819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c08e8-2d2e-4367-ac8b-7b7b4da599fa admin admin] PATH_INFO: `/v3/users/da1416e86db040c4aa287a504b209847` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:09.342956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c08e8-2d2e-4367-ac8b-7b7b4da599fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=da1416e86db040c4aa287a504b209847)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:09.344919 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c08e8-2d2e-4367-ac8b-7b7b4da599fa admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:09.426896 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016891ac-f36c-4ae6-a370-14af05fff9aa None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:09.428678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-016891ac-f36c-4ae6-a370-14af05fff9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:09.466878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:09.501755 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016891ac-f36c-4ae6-a370-14af05fff9aa None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:09.507067 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3efa50-e5df-402a-ba21-74d5c467a7d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:09.507623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3efa50-e5df-402a-ba21-74d5c467a7d9 service swift] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:09.507963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3efa50-e5df-402a-ba21-74d5c467a7d9 service swift] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:09.508278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3efa50-e5df-402a-ba21-74d5c467a7d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:09.518120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3efa50-e5df-402a-ba21-74d5c467a7d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:09.519713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3efa50-e5df-402a-ba21-74d5c467a7d9 service swift] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:09.527672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1210/2380] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 23:04:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 23:04:09.538547 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-509c08e8-2d2e-4367-ac8b-7b7b4da599fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da1416e86db040c4aa287a504b209847'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:09.539263 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-509c08e8-2d2e-4367-ac8b-7b7b4da599fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da1416e86db040c4aa287a504b209847'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:09.540001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-509c08e8-2d2e-4367-ac8b-7b7b4da599fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da1416e86db040c4aa287a504b209847'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:09.561675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-509c08e8-2d2e-4367-ac8b-7b7b4da599fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da1416e86db040c4aa287a504b209847'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:09.565335 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:09.574498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-509c08e8-2d2e-4367-ac8b-7b7b4da599fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da1416e86db040c4aa287a504b209847'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:09.680062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1171/2381] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:04:09 2022] DELETE /identity/v3/users/da1416e86db040c4aa287a504b209847 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:09.685900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ec619-3f80-4fb3-b38a-c8c4420267bb None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:09.688396 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ec619-3f80-4fb3-b38a-c8c4420267bb None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:09.688396 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ec619-3f80-4fb3-b38a-c8c4420267bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:09.712631 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-721ec619-3f80-4fb3-b38a-c8c4420267bb None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:09.714393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-721ec619-3f80-4fb3-b38a-c8c4420267bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:09.798235 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1211/2382] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:09.812081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c08e8-2d2e-4367-ac8b-7b7b4da599fa admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:09.813775 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-509c08e8-2d2e-4367-ac8b-7b7b4da599fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:09.891125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c08e8-2d2e-4367-ac8b-7b7b4da599fa admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:09.895312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb60f8-4b44-4c12-a7ac-2132d4ec8a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:09.896091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb60f8-4b44-4c12-a7ac-2132d4ec8a48 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:09.896406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb60f8-4b44-4c12-a7ac-2132d4ec8a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:09.896679 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb60f8-4b44-4c12-a7ac-2132d4ec8a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:09.912210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb60f8-4b44-4c12-a7ac-2132d4ec8a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:09.914180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb60f8-4b44-4c12-a7ac-2132d4ec8a48 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:09.926680 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1172/2383] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:10.498784 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ec619-3f80-4fb3-b38a-c8c4420267bb None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:10.501291 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-721ec619-3f80-4fb3-b38a-c8c4420267bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:10.520358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ec619-3f80-4fb3-b38a-c8c4420267bb None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:10.533401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9f853-51b6-4215-8907-a52daca7c236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:10.534342 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9f853-51b6-4215-8907-a52daca7c236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:10.534852 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9f853-51b6-4215-8907-a52daca7c236 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:10.535507 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9f853-51b6-4215-8907-a52daca7c236 admin admin] PATH_INFO: `/v3/projects/578bdd0fe54b4deb8fc40949fb8ca435` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:10.537121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9f853-51b6-4215-8907-a52daca7c236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=578bdd0fe54b4deb8fc40949fb8ca435)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:10.539304 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9f853-51b6-4215-8907-a52daca7c236 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:10.656353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b5e9f853-51b6-4215-8907-a52daca7c236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578bdd0fe54b4deb8fc40949fb8ca435', 'request_id': 'req-b5e9f853-51b6-4215-8907-a52daca7c236'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:10.666436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b5e9f853-51b6-4215-8907-a52daca7c236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578bdd0fe54b4deb8fc40949fb8ca435', 'request_id': 'req-b5e9f853-51b6-4215-8907-a52daca7c236'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:10.673979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b5e9f853-51b6-4215-8907-a52daca7c236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578bdd0fe54b4deb8fc40949fb8ca435', 'request_id': 'req-b5e9f853-51b6-4215-8907-a52daca7c236'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:10.768683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b5e9f853-51b6-4215-8907-a52daca7c236 admin admin] The token cache is being invalidate because project 578bdd0fe54b4deb8fc40949fb8ca435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:04:10.769017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b5e9f853-51b6-4215-8907-a52daca7c236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:10.769955 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b5e9f853-51b6-4215-8907-a52daca7c236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:10.771642 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1212/2384] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:04:10 2022] DELETE /identity/v3/projects/578bdd0fe54b4deb8fc40949fb8ca435 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:10.775923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb60f8-4b44-4c12-a7ac-2132d4ec8a48 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:10.787724 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb60f8-4b44-4c12-a7ac-2132d4ec8a48 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:10.862512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ddb8b-9d4a-442b-88aa-f3bb06606682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:10.863505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ddb8b-9d4a-442b-88aa-f3bb06606682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:10.863782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ddb8b-9d4a-442b-88aa-f3bb06606682 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:10.864054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ddb8b-9d4a-442b-88aa-f3bb06606682 admin admin] PATH_INFO: `/v3/users/3c448d57fee84fa6839b6d449ac9d0b7` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:10.865306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ddb8b-9d4a-442b-88aa-f3bb06606682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c448d57fee84fa6839b6d449ac9d0b7)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:10.867228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ddb8b-9d4a-442b-88aa-f3bb06606682 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:11.031944 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2a4ddb8b-9d4a-442b-88aa-f3bb06606682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c448d57fee84fa6839b6d449ac9d0b7'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:11.032816 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2a4ddb8b-9d4a-442b-88aa-f3bb06606682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c448d57fee84fa6839b6d449ac9d0b7'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:11.033607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2a4ddb8b-9d4a-442b-88aa-f3bb06606682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c448d57fee84fa6839b6d449ac9d0b7'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:11.051312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2a4ddb8b-9d4a-442b-88aa-f3bb06606682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c448d57fee84fa6839b6d449ac9d0b7'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:11.063499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2a4ddb8b-9d4a-442b-88aa-f3bb06606682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c448d57fee84fa6839b6d449ac9d0b7'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:11.134299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1173/2385] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:04:10 2022] DELETE /identity/v3/users/3c448d57fee84fa6839b6d449ac9d0b7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:11.603715 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9f853-51b6-4215-8907-a52daca7c236 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:11.605571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b5e9f853-51b6-4215-8907-a52daca7c236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:11.634321 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9f853-51b6-4215-8907-a52daca7c236 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:11.692092 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:11.710012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079473dc-dc68-46bb-84f6-75b940efe790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:11.710761 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079473dc-dc68-46bb-84f6-75b940efe790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:11.711043 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079473dc-dc68-46bb-84f6-75b940efe790 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:11.711318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079473dc-dc68-46bb-84f6-75b940efe790 admin admin] PATH_INFO: `/v3/projects/e564bbd7724d438ab4b2af2bac0e212e` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:11.712575 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079473dc-dc68-46bb-84f6-75b940efe790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e564bbd7724d438ab4b2af2bac0e212e)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:11.714532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079473dc-dc68-46bb-84f6-75b940efe790 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:11.867012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-079473dc-dc68-46bb-84f6-75b940efe790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e564bbd7724d438ab4b2af2bac0e212e', 'request_id': 'req-079473dc-dc68-46bb-84f6-75b940efe790'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:11.875116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-079473dc-dc68-46bb-84f6-75b940efe790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e564bbd7724d438ab4b2af2bac0e212e', 'request_id': 'req-079473dc-dc68-46bb-84f6-75b940efe790'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:11.882678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-079473dc-dc68-46bb-84f6-75b940efe790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e564bbd7724d438ab4b2af2bac0e212e', 'request_id': 'req-079473dc-dc68-46bb-84f6-75b940efe790'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:11.958810 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-079473dc-dc68-46bb-84f6-75b940efe790 admin admin] The token cache is being invalidate because project e564bbd7724d438ab4b2af2bac0e212e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:04:11.959362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-079473dc-dc68-46bb-84f6-75b940efe790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:11.960078 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-079473dc-dc68-46bb-84f6-75b940efe790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:11.961955 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1213/2386] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:04:11 2022] DELETE /identity/v3/projects/e564bbd7724d438ab4b2af2bac0e212e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:11.967781 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d96bd-8cd7-4108-bf5e-4a2f9a166b45 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:11.968310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d96bd-8cd7-4108-bf5e-4a2f9a166b45 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:11.968395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d96bd-8cd7-4108-bf5e-4a2f9a166b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:11.977934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:11.990529 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-037d96bd-8cd7-4108-bf5e-4a2f9a166b45 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:11.991893 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-037d96bd-8cd7-4108-bf5e-4a2f9a166b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:12.081376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1174/2387] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:12.094855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230c6b1-50ec-4937-8315-9986727a46ef None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:12.095175 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230c6b1-50ec-4937-8315-9986727a46ef None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:12.095454 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230c6b1-50ec-4937-8315-9986727a46ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:12.117843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-b230c6b1-50ec-4937-8315-9986727a46ef None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:12.119229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b230c6b1-50ec-4937-8315-9986727a46ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:12.129032 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1214/2388] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:12.133768 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d96bd-8cd7-4108-bf5e-4a2f9a166b45 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:12.146298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d96bd-8cd7-4108-bf5e-4a2f9a166b45 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:12.152561 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301f63a-69b2-49b5-b68e-ec1a0838db41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:12.156231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301f63a-69b2-49b5-b68e-ec1a0838db41 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:12.156231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301f63a-69b2-49b5-b68e-ec1a0838db41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:12.156231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301f63a-69b2-49b5-b68e-ec1a0838db41 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:12.156231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301f63a-69b2-49b5-b68e-ec1a0838db41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:04:12.156231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301f63a-69b2-49b5-b68e-ec1a0838db41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:12.157160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301f63a-69b2-49b5-b68e-ec1a0838db41 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:12.170672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1175/2389] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:04:12.177929 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230c6b1-50ec-4937-8315-9986727a46ef None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:12.188051 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230c6b1-50ec-4937-8315-9986727a46ef None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:12.196601 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3729445-73e2-4b8f-bf9f-2d4dd82f78a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:12.197357 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3729445-73e2-4b8f-bf9f-2d4dd82f78a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:12.200814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3729445-73e2-4b8f-bf9f-2d4dd82f78a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:12.200814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3729445-73e2-4b8f-bf9f-2d4dd82f78a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:12.200814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3729445-73e2-4b8f-bf9f-2d4dd82f78a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:12.202608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3729445-73e2-4b8f-bf9f-2d4dd82f78a1 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:12.560006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1215/2390] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:04:12 2022] POST /identity/v3/projects => generated 377 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:04:12.567160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301f63a-69b2-49b5-b68e-ec1a0838db41 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:12.587147 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301f63a-69b2-49b5-b68e-ec1a0838db41 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:12.723296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620df1d-ce0f-4608-8c55-6f1cd9a0dd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:12.723922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620df1d-ce0f-4608-8c55-6f1cd9a0dd19 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:12.724283 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620df1d-ce0f-4608-8c55-6f1cd9a0dd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:12.724613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620df1d-ce0f-4608-8c55-6f1cd9a0dd19 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:12.725401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620df1d-ce0f-4608-8c55-6f1cd9a0dd19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:12.727452 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620df1d-ce0f-4608-8c55-6f1cd9a0dd19 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:12.833796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1176/2391] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:04:12 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:04:12.838483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3729445-73e2-4b8f-bf9f-2d4dd82f78a1 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:12.851257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3729445-73e2-4b8f-bf9f-2d4dd82f78a1 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:12.857961 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ae89e-f901-4028-a758-8112326564c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:12.858763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ae89e-f901-4028-a758-8112326564c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:12.859047 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ae89e-f901-4028-a758-8112326564c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:12.859325 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ae89e-f901-4028-a758-8112326564c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:12.859988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ae89e-f901-4028-a758-8112326564c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:12.861778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ae89e-f901-4028-a758-8112326564c1 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:12.873720 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1216/2392] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:12.877451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620df1d-ce0f-4608-8c55-6f1cd9a0dd19 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:12.891123 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620df1d-ce0f-4608-8c55-6f1cd9a0dd19 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:12.895553 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215245a3-8762-4d1e-83de-59c33f86cd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:12.896302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215245a3-8762-4d1e-83de-59c33f86cd85 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:12.896654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215245a3-8762-4d1e-83de-59c33f86cd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:12.897006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215245a3-8762-4d1e-83de-59c33f86cd85 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:12.897810 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215245a3-8762-4d1e-83de-59c33f86cd85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:12.899750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215245a3-8762-4d1e-83de-59c33f86cd85 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:12.921149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1177/2393] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:12.924699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ae89e-f901-4028-a758-8112326564c1 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:12.937678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ae89e-f901-4028-a758-8112326564c1 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:12.947251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c423e-b2bb-4250-a26f-e81feeaec063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:12.949746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c423e-b2bb-4250-a26f-e81feeaec063 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:12.949746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c423e-b2bb-4250-a26f-e81feeaec063 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:12.949746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c423e-b2bb-4250-a26f-e81feeaec063 admin admin] PATH_INFO: `/v3/projects/6b6504ec747f4d9f8a75731021a8c919/users/1762eef4a636467bba9966c8d7a1ab79/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:12.968837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c423e-b2bb-4250-a26f-e81feeaec063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b6504ec747f4d9f8a75731021a8c919, user_id=1762eef4a636467bba9966c8d7a1ab79, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:12.972667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c423e-b2bb-4250-a26f-e81feeaec063 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:13.065973 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1217/2394] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:04:12 2022] PUT /identity/v3/projects/6b6504ec747f4d9f8a75731021a8c919/users/1762eef4a636467bba9966c8d7a1ab79/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:13.077136 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e3c29-62bc-4bad-b76f-42c46fb41070 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:13.077677 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e3c29-62bc-4bad-b76f-42c46fb41070 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:13.077778 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e3c29-62bc-4bad-b76f-42c46fb41070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:13.113830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-b46e3c29-62bc-4bad-b76f-42c46fb41070 None None] MFA Rules not processed for user `1762eef4a636467bba9966c8d7a1ab79`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:13.115128 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b46e3c29-62bc-4bad-b76f-42c46fb41070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:13.198443 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:13.203464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1178/2395] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:13.216650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c423e-b2bb-4250-a26f-e81feeaec063 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:13.219110 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a72c423e-b2bb-4250-a26f-e81feeaec063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:13.297345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c423e-b2bb-4250-a26f-e81feeaec063 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:13.301668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b05b38-0a6d-46bd-b1f6-6e964bd63701 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e72cc048a0418cac062d68b8df402f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:13.302067 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b05b38-0a6d-46bd-b1f6-6e964bd63701 service glance] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:13.302355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b05b38-0a6d-46bd-b1f6-6e964bd63701 service glance] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:13.302633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b05b38-0a6d-46bd-b1f6-6e964bd63701 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:13.313387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b05b38-0a6d-46bd-b1f6-6e964bd63701 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:13.315206 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b05b38-0a6d-46bd-b1f6-6e964bd63701 service glance] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:13.335102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1218/2396] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:14.772494 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e3c29-62bc-4bad-b76f-42c46fb41070 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:14.775210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b46e3c29-62bc-4bad-b76f-42c46fb41070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:14.919285 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e3c29-62bc-4bad-b76f-42c46fb41070 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:14.924104 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b52bb-a501-44cf-b368-4aa381429f5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:14.924833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b52bb-a501-44cf-b368-4aa381429f5d service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:14.925046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b52bb-a501-44cf-b368-4aa381429f5d service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:14.926369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b52bb-a501-44cf-b368-4aa381429f5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:14.928899 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-709b52bb-a501-44cf-b368-4aa381429f5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:15.048613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b52bb-a501-44cf-b368-4aa381429f5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:15.050462 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b52bb-a501-44cf-b368-4aa381429f5d service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:15.065545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1179/2397] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:23.324422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:25.060570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=48 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:29.781856 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b05b38-0a6d-46bd-b1f6-6e964bd63701 service glance] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:29.789354 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-11b05b38-0a6d-46bd-b1f6-6e964bd63701 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:29.846437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b05b38-0a6d-46bd-b1f6-6e964bd63701 service glance] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:29.850259 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a0af-677d-4e34-a0b7-8dda0a4e73a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:29.850861 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a0af-677d-4e34-a0b7-8dda0a4e73a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:29.851141 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a0af-677d-4e34-a0b7-8dda0a4e73a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:29.851414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a0af-677d-4e34-a0b7-8dda0a4e73a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:29.853157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-3510a0af-677d-4e34-a0b7-8dda0a4e73a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:29.864173 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510a0af-677d-4e34-a0b7-8dda0a4e73a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:29.865616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510a0af-677d-4e34-a0b7-8dda0a4e73a9 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:29.875455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1219/2398] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:32.206299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b52bb-a501-44cf-b368-4aa381429f5d service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:32.277375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b52bb-a501-44cf-b368-4aa381429f5d service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:32.282301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a8c2d-9293-420e-bf48-3f9ea1308127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:32.282948 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a8c2d-9293-420e-bf48-3f9ea1308127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:32.283216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a8c2d-9293-420e-bf48-3f9ea1308127 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:32.283662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a8c2d-9293-420e-bf48-3f9ea1308127 admin admin] PATH_INFO: `/v3/users/1762eef4a636467bba9966c8d7a1ab79` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:32.285026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a8c2d-9293-420e-bf48-3f9ea1308127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1762eef4a636467bba9966c8d7a1ab79)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:32.287126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a8c2d-9293-420e-bf48-3f9ea1308127 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:32.476384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5b2a8c2d-9293-420e-bf48-3f9ea1308127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1762eef4a636467bba9966c8d7a1ab79'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:32.477220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5b2a8c2d-9293-420e-bf48-3f9ea1308127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1762eef4a636467bba9966c8d7a1ab79'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:32.477964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5b2a8c2d-9293-420e-bf48-3f9ea1308127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1762eef4a636467bba9966c8d7a1ab79'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:32.493691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5b2a8c2d-9293-420e-bf48-3f9ea1308127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1762eef4a636467bba9966c8d7a1ab79'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:32.501750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5b2a8c2d-9293-420e-bf48-3f9ea1308127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1762eef4a636467bba9966c8d7a1ab79'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:32.596302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1180/2399] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:04:32 2022] DELETE /identity/v3/users/1762eef4a636467bba9966c8d7a1ab79 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:32.600770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96932e3e-205f-441d-8fe1-097e92f70ada None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:32.601283 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96932e3e-205f-441d-8fe1-097e92f70ada None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:32.601283 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96932e3e-205f-441d-8fe1-097e92f70ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:32.629265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-96932e3e-205f-441d-8fe1-097e92f70ada None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:32.631374 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-96932e3e-205f-441d-8fe1-097e92f70ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:32.725600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1220/2400] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:32.739712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a8c2d-9293-420e-bf48-3f9ea1308127 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:32.741244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5b2a8c2d-9293-420e-bf48-3f9ea1308127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:32.816233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a8c2d-9293-420e-bf48-3f9ea1308127 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:32.820857 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618d139-4a6d-47cd-b6cf-0f127bb4bd35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:32.821549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618d139-4a6d-47cd-b6cf-0f127bb4bd35 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:32.821838 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618d139-4a6d-47cd-b6cf-0f127bb4bd35 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:32.822118 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618d139-4a6d-47cd-b6cf-0f127bb4bd35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:32.833804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618d139-4a6d-47cd-b6cf-0f127bb4bd35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:32.835325 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618d139-4a6d-47cd-b6cf-0f127bb4bd35 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:32.849932 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1181/2401] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:33.531888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96932e3e-205f-441d-8fe1-097e92f70ada None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:33.533310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-96932e3e-205f-441d-8fe1-097e92f70ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:33.557049 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96932e3e-205f-441d-8fe1-097e92f70ada None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:33.564014 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d472a-6aa7-4270-8d5b-24de5352cf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:33.564790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d472a-6aa7-4270-8d5b-24de5352cf7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:33.565619 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d472a-6aa7-4270-8d5b-24de5352cf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:33.565986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d472a-6aa7-4270-8d5b-24de5352cf7a admin admin] PATH_INFO: `/v3/projects/6b6504ec747f4d9f8a75731021a8c919` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:33.567340 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d472a-6aa7-4270-8d5b-24de5352cf7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b6504ec747f4d9f8a75731021a8c919)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:33.569380 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d472a-6aa7-4270-8d5b-24de5352cf7a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:33.691604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-aa9d472a-6aa7-4270-8d5b-24de5352cf7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b6504ec747f4d9f8a75731021a8c919', 'request_id': 'req-aa9d472a-6aa7-4270-8d5b-24de5352cf7a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:33.699268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-aa9d472a-6aa7-4270-8d5b-24de5352cf7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b6504ec747f4d9f8a75731021a8c919', 'request_id': 'req-aa9d472a-6aa7-4270-8d5b-24de5352cf7a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:33.706382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-aa9d472a-6aa7-4270-8d5b-24de5352cf7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b6504ec747f4d9f8a75731021a8c919', 'request_id': 'req-aa9d472a-6aa7-4270-8d5b-24de5352cf7a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:33.773683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-aa9d472a-6aa7-4270-8d5b-24de5352cf7a admin admin] The token cache is being invalidate because project 6b6504ec747f4d9f8a75731021a8c919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:04:33.773977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-aa9d472a-6aa7-4270-8d5b-24de5352cf7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:33.774607 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-aa9d472a-6aa7-4270-8d5b-24de5352cf7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:33.776093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1221/2402] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:04:33 2022] DELETE /identity/v3/projects/6b6504ec747f4d9f8a75731021a8c919 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:33.781473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137e3f4-05f3-40d8-9fdf-f6e1699fd8c7 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:33.781928 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137e3f4-05f3-40d8-9fdf-f6e1699fd8c7 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:33.782210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137e3f4-05f3-40d8-9fdf-f6e1699fd8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:33.803665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-8137e3f4-05f3-40d8-9fdf-f6e1699fd8c7 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:33.805174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8137e3f4-05f3-40d8-9fdf-f6e1699fd8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:33.826518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:33.872774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1182/2403] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:33.881915 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f527d08-6ddb-469b-b5a6-aa7a9ac5caa3 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:33.882202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f527d08-6ddb-469b-b5a6-aa7a9ac5caa3 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:33.882479 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f527d08-6ddb-469b-b5a6-aa7a9ac5caa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:33.904739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-7f527d08-6ddb-469b-b5a6-aa7a9ac5caa3 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:33.905975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-7f527d08-6ddb-469b-b5a6-aa7a9ac5caa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:33.914132 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1222/2404] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:33.923205 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137e3f4-05f3-40d8-9fdf-f6e1699fd8c7 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:33.934609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137e3f4-05f3-40d8-9fdf-f6e1699fd8c7 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:33.939705 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03285d5-f010-4d2c-9087-27e5cf012ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:33.940523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03285d5-f010-4d2c-9087-27e5cf012ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:33.940792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03285d5-f010-4d2c-9087-27e5cf012ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:33.941106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03285d5-f010-4d2c-9087-27e5cf012ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:33.941763 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03285d5-f010-4d2c-9087-27e5cf012ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:04:33.942064 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03285d5-f010-4d2c-9087-27e5cf012ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:33.943761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03285d5-f010-4d2c-9087-27e5cf012ad6 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:33.957399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1183/2405] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:04:33.962459 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f527d08-6ddb-469b-b5a6-aa7a9ac5caa3 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:33.975175 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f527d08-6ddb-469b-b5a6-aa7a9ac5caa3 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:33.986667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f273ebe-1ac2-4def-915b-07d8232abe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:33.987301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f273ebe-1ac2-4def-915b-07d8232abe8e admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:33.987576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f273ebe-1ac2-4def-915b-07d8232abe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:33.987877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f273ebe-1ac2-4def-915b-07d8232abe8e admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:33.988591 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f273ebe-1ac2-4def-915b-07d8232abe8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:33.990622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f273ebe-1ac2-4def-915b-07d8232abe8e admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:34.091693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:34.106823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1223/2406] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:04:33 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:04:34.111366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03285d5-f010-4d2c-9087-27e5cf012ad6 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:34.123384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03285d5-f010-4d2c-9087-27e5cf012ad6 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:34.186359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a44a30-a643-4e38-8d99-90a4143be1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:34.186713 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a44a30-a643-4e38-8d99-90a4143be1ce admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:34.187011 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a44a30-a643-4e38-8d99-90a4143be1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:34.187278 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a44a30-a643-4e38-8d99-90a4143be1ce admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:34.187936 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a44a30-a643-4e38-8d99-90a4143be1ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:34.189933 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a44a30-a643-4e38-8d99-90a4143be1ce admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:34.295152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f273ebe-1ac2-4def-915b-07d8232abe8e admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:34.301052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1184/2407] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:04:34 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:04:34.306665 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3fee3-c0dd-4a58-9760-9eac33b9d33d None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:34.307161 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3fee3-c0dd-4a58-9760-9eac33b9d33d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:34.307297 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f273ebe-1ac2-4def-915b-07d8232abe8e admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:34.307730 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3fee3-c0dd-4a58-9760-9eac33b9d33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:34.313870 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb32c0-2c3f-49b4-92a3-00f1cc9b4004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:34.314751 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb32c0-2c3f-49b4-92a3-00f1cc9b4004 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:34.315389 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb32c0-2c3f-49b4-92a3-00f1cc9b4004 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:34.316082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb32c0-2c3f-49b4-92a3-00f1cc9b4004 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:34.316975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb32c0-2c3f-49b4-92a3-00f1cc9b4004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:34.318884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb32c0-2c3f-49b4-92a3-00f1cc9b4004 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:34.340749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-72b3fee3-c0dd-4a58-9760-9eac33b9d33d None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:34.340749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-72b3fee3-c0dd-4a58-9760-9eac33b9d33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:34.350822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1224/2408] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:34.364617 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb32c0-2c3f-49b4-92a3-00f1cc9b4004 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:34.377850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb32c0-2c3f-49b4-92a3-00f1cc9b4004 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:34.388516 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbb014-0f5c-4425-9de8-165e004b2ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:34.388516 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbb014-0f5c-4425-9de8-165e004b2ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:34.388516 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbb014-0f5c-4425-9de8-165e004b2ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:34.392529 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbb014-0f5c-4425-9de8-165e004b2ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:34.394206 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbb014-0f5c-4425-9de8-165e004b2ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:34.396099 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbb014-0f5c-4425-9de8-165e004b2ef3 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:34.408581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1185/2409] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Aug 29 23:04:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:04:34.408915 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1225/2410] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:34.412861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3fee3-c0dd-4a58-9760-9eac33b9d33d None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:34.422273 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbb014-0f5c-4425-9de8-165e004b2ef3 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:34.424379 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d3cbb014-0f5c-4425-9de8-165e004b2ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:34.437407 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3fee3-c0dd-4a58-9760-9eac33b9d33d None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:34.443923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966f506-1044-457a-9465-7544eda79b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:34.444727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966f506-1044-457a-9465-7544eda79b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:34.445076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966f506-1044-457a-9465-7544eda79b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:34.445423 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966f506-1044-457a-9465-7544eda79b84 admin admin] PATH_INFO: `/v3/projects/8641283447a6447eaf205a52e26fde91/users/1399319633024d4eab3f4d2b664719df/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:34.463735 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966f506-1044-457a-9465-7544eda79b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8641283447a6447eaf205a52e26fde91, user_id=1399319633024d4eab3f4d2b664719df, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:34.467633 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966f506-1044-457a-9465-7544eda79b84 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:34.500770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbb014-0f5c-4425-9de8-165e004b2ef3 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:34.505983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dc094-7fc7-4dc2-988c-f7296e533354 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:34.506594 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dc094-7fc7-4dc2-988c-f7296e533354 service swift] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:34.506878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dc094-7fc7-4dc2-988c-f7296e533354 service swift] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:34.507151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dc094-7fc7-4dc2-988c-f7296e533354 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:34.516208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dc094-7fc7-4dc2-988c-f7296e533354 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:34.526711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dc094-7fc7-4dc2-988c-f7296e533354 service swift] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:34.526711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1226/2411] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 23:04:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:04:34.553582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1186/2412] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:04:34 2022] PUT /identity/v3/projects/8641283447a6447eaf205a52e26fde91/users/1399319633024d4eab3f4d2b664719df/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:04:34.627002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d5366-3e90-49f2-af45-3fba34a63763 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:34.627280 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d5366-3e90-49f2-af45-3fba34a63763 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:34.627555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d5366-3e90-49f2-af45-3fba34a63763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:34.659497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-7b0d5366-3e90-49f2-af45-3fba34a63763 None None] MFA Rules not processed for user `1399319633024d4eab3f4d2b664719df`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:34.660791 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-7b0d5366-3e90-49f2-af45-3fba34a63763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:34.702770 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3281e-7437-44de-b3ed-bce1cd897a32 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:34.703061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3281e-7437-44de-b3ed-bce1cd897a32 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:34.703339 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3281e-7437-44de-b3ed-bce1cd897a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:34.745425 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-c6d3281e-7437-44de-b3ed-bce1cd897a32 None None] MFA Rules not processed for user `fbdd4001b2ea4c6cbd6e012f497275cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:34.747483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c6d3281e-7437-44de-b3ed-bce1cd897a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:34.806406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:34.873709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1227/2413] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:34.879693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d5366-3e90-49f2-af45-3fba34a63763 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:34.911605 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1187/2414] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:04:34.999084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:35.015347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d5366-3e90-49f2-af45-3fba34a63763 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:35.026223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae8c81-38b6-425f-aabe-5d3ab4dc9be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:35.027027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae8c81-38b6-425f-aabe-5d3ab4dc9be1 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:35.027744 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae8c81-38b6-425f-aabe-5d3ab4dc9be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:35.028376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae8c81-38b6-425f-aabe-5d3ab4dc9be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:35.030188 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae8c81-38b6-425f-aabe-5d3ab4dc9be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:35.034071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae8c81-38b6-425f-aabe-5d3ab4dc9be1 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:35.174859 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1228/2415] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:04:34 2022] POST /identity/v3/projects => generated 383 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:04:35.176125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3281e-7437-44de-b3ed-bce1cd897a32 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:35.200225 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3281e-7437-44de-b3ed-bce1cd897a32 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:35.346861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832b967-d5c9-4483-ae4d-a5f807d802b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:35.347544 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832b967-d5c9-4483-ae4d-a5f807d802b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:35.347826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832b967-d5c9-4483-ae4d-a5f807d802b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:35.348100 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832b967-d5c9-4483-ae4d-a5f807d802b1 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:35.349421 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832b967-d5c9-4483-ae4d-a5f807d802b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:35.351224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832b967-d5c9-4483-ae4d-a5f807d802b1 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:35.498335 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1188/2416] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:04:35 2022] POST /identity/v3/users => generated 292 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:04:35.499960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae8c81-38b6-425f-aabe-5d3ab4dc9be1 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:35.518166 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae8c81-38b6-425f-aabe-5d3ab4dc9be1 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:35.525320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388eb3ba-e44b-4ed7-9377-485f5eb8f6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:35.525992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388eb3ba-e44b-4ed7-9377-485f5eb8f6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:35.526275 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388eb3ba-e44b-4ed7-9377-485f5eb8f6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:35.527217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388eb3ba-e44b-4ed7-9377-485f5eb8f6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:35.527363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388eb3ba-e44b-4ed7-9377-485f5eb8f6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:35.534911 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388eb3ba-e44b-4ed7-9377-485f5eb8f6d0 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:35.571482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1229/2417] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:35.575927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832b967-d5c9-4483-ae4d-a5f807d802b1 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:35.593295 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832b967-d5c9-4483-ae4d-a5f807d802b1 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:35.599480 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5f7fa-bfb2-4db3-a21b-c72aa5ab5917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:35.600250 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5f7fa-bfb2-4db3-a21b-c72aa5ab5917 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:35.600725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5f7fa-bfb2-4db3-a21b-c72aa5ab5917 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:35.601137 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5f7fa-bfb2-4db3-a21b-c72aa5ab5917 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:35.605364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5f7fa-bfb2-4db3-a21b-c72aa5ab5917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:35.609372 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5f7fa-bfb2-4db3-a21b-c72aa5ab5917 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:35.634111 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1189/2418] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:35.635012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388eb3ba-e44b-4ed7-9377-485f5eb8f6d0 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:35.650594 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388eb3ba-e44b-4ed7-9377-485f5eb8f6d0 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:35.659502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07466045-ed6d-41d4-95ed-caf22ba0b319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:35.661438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07466045-ed6d-41d4-95ed-caf22ba0b319 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:35.662287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07466045-ed6d-41d4-95ed-caf22ba0b319 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:35.662937 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07466045-ed6d-41d4-95ed-caf22ba0b319 admin admin] PATH_INFO: `/v3/projects/b0c0ab25480b460385c3f761be75ad89/users/f33b032a18f645f99c286b31b4183601/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:35.712929 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07466045-ed6d-41d4-95ed-caf22ba0b319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c0ab25480b460385c3f761be75ad89, user_id=f33b032a18f645f99c286b31b4183601, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:35.717312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07466045-ed6d-41d4-95ed-caf22ba0b319 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:35.786399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1230/2419] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:04:35 2022] PUT /identity/v3/projects/b0c0ab25480b460385c3f761be75ad89/users/f33b032a18f645f99c286b31b4183601/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:04:35.802563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa28cdc-6493-46f9-a75b-4d01403e281d None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:35.803084 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa28cdc-6493-46f9-a75b-4d01403e281d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:35.803715 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa28cdc-6493-46f9-a75b-4d01403e281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:35.837731 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-7fa28cdc-6493-46f9-a75b-4d01403e281d None None] MFA Rules not processed for user `f33b032a18f645f99c286b31b4183601`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:35.839705 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7fa28cdc-6493-46f9-a75b-4d01403e281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:35.957952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07466045-ed6d-41d4-95ed-caf22ba0b319 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:35.958451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1190/2420] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:36.067917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07466045-ed6d-41d4-95ed-caf22ba0b319 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:36.073607 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d3093-5ccf-4c47-8e36-a9a6f1e5d46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:36.075127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d3093-5ccf-4c47-8e36-a9a6f1e5d46b admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:36.075699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d3093-5ccf-4c47-8e36-a9a6f1e5d46b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:36.075699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d3093-5ccf-4c47-8e36-a9a6f1e5d46b admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:36.076457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d3093-5ccf-4c47-8e36-a9a6f1e5d46b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:36.078433 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d3093-5ccf-4c47-8e36-a9a6f1e5d46b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:36.188118 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1231/2421] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:04:35 2022] POST /identity/v3/projects => generated 385 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:04:36.192264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa28cdc-6493-46f9-a75b-4d01403e281d None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:36.205062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa28cdc-6493-46f9-a75b-4d01403e281d None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:36.243580 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:36.281570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32018615-8b72-4320-b86a-50f5afd96d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:36.282542 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32018615-8b72-4320-b86a-50f5afd96d9c admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:36.282898 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32018615-8b72-4320-b86a-50f5afd96d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:36.283250 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32018615-8b72-4320-b86a-50f5afd96d9c admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:36.284924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32018615-8b72-4320-b86a-50f5afd96d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:36.287174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32018615-8b72-4320-b86a-50f5afd96d9c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:36.363947 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1191/2422] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:04:36 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:04:36.368130 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d3093-5ccf-4c47-8e36-a9a6f1e5d46b admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:36.380037 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d3093-5ccf-4c47-8e36-a9a6f1e5d46b admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:36.385320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de2386-46a4-483a-a6b7-0f73cbeee0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:36.385979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de2386-46a4-483a-a6b7-0f73cbeee0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:36.386277 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de2386-46a4-483a-a6b7-0f73cbeee0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:36.386554 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de2386-46a4-483a-a6b7-0f73cbeee0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:36.387890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de2386-46a4-483a-a6b7-0f73cbeee0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:36.390030 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de2386-46a4-483a-a6b7-0f73cbeee0c6 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:36.402333 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1232/2423] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:36.407220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32018615-8b72-4320-b86a-50f5afd96d9c admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:36.421783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32018615-8b72-4320-b86a-50f5afd96d9c admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:36.433602 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb2705-9fce-449c-8dbf-63ac8a521d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:36.435691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb2705-9fce-449c-8dbf-63ac8a521d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:36.435973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb2705-9fce-449c-8dbf-63ac8a521d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:36.436292 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb2705-9fce-449c-8dbf-63ac8a521d70 admin admin] PATH_INFO: `/v3/projects/22c960d1490e4cc3b8f3339fa7f3aaab/users/5f1d18d42df64230877758de64eefe8f/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:36.462416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb2705-9fce-449c-8dbf-63ac8a521d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c960d1490e4cc3b8f3339fa7f3aaab, user_id=5f1d18d42df64230877758de64eefe8f, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:36.469089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb2705-9fce-449c-8dbf-63ac8a521d70 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:36.550822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1192/2424] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:04:36 2022] PUT /identity/v3/projects/22c960d1490e4cc3b8f3339fa7f3aaab/users/5f1d18d42df64230877758de64eefe8f/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:36.555029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de2386-46a4-483a-a6b7-0f73cbeee0c6 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:36.569149 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de2386-46a4-483a-a6b7-0f73cbeee0c6 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:36.629630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbabb6-987c-4132-8cad-470f236f58d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:36.630239 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbabb6-987c-4132-8cad-470f236f58d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:36.630515 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbabb6-987c-4132-8cad-470f236f58d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:36.630780 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbabb6-987c-4132-8cad-470f236f58d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:36.631412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbabb6-987c-4132-8cad-470f236f58d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:36.633034 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbabb6-987c-4132-8cad-470f236f58d9 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:36.643593 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1233/2425] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:36.647821 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb2705-9fce-449c-8dbf-63ac8a521d70 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:36.659075 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb2705-9fce-449c-8dbf-63ac8a521d70 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:36.663856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6b7d7-0d42-4392-b2cb-39f6ab22e23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:36.664556 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6b7d7-0d42-4392-b2cb-39f6ab22e23e admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:36.664837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6b7d7-0d42-4392-b2cb-39f6ab22e23e admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:36.665209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6b7d7-0d42-4392-b2cb-39f6ab22e23e admin admin] PATH_INFO: `/v3/projects/22c960d1490e4cc3b8f3339fa7f3aaab/users/5f1d18d42df64230877758de64eefe8f/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:36.667211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6b7d7-0d42-4392-b2cb-39f6ab22e23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c960d1490e4cc3b8f3339fa7f3aaab, user_id=5f1d18d42df64230877758de64eefe8f, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:36.670675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6b7d7-0d42-4392-b2cb-39f6ab22e23e admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:36.681960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1193/2426] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:04:36 2022] PUT /identity/v3/projects/22c960d1490e4cc3b8f3339fa7f3aaab/users/5f1d18d42df64230877758de64eefe8f/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:36.694791 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8a45f-3248-4f27-9b2b-614c8eb3c60f None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:36.695159 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8a45f-3248-4f27-9b2b-614c8eb3c60f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:36.695505 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8a45f-3248-4f27-9b2b-614c8eb3c60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:36.726095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-49f8a45f-3248-4f27-9b2b-614c8eb3c60f None None] MFA Rules not processed for user `5f1d18d42df64230877758de64eefe8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:36.727351 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-49f8a45f-3248-4f27-9b2b-614c8eb3c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:36.731603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:36.799009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1234/2427] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:36.810765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6b7d7-0d42-4392-b2cb-39f6ab22e23e admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:36.812548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-29f6b7d7-0d42-4392-b2cb-39f6ab22e23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:36.886716 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6b7d7-0d42-4392-b2cb-39f6ab22e23e admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:36.891371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944151b-5b37-4fca-a631-95c627fbfa27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:36.892012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944151b-5b37-4fca-a631-95c627fbfa27 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:36.892439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944151b-5b37-4fca-a631-95c627fbfa27 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:36.892697 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944151b-5b37-4fca-a631-95c627fbfa27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:36.952313 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944151b-5b37-4fca-a631-95c627fbfa27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:36.953781 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944151b-5b37-4fca-a631-95c627fbfa27 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:36.962857 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1194/2428] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:38.954036 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8a45f-3248-4f27-9b2b-614c8eb3c60f None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:38.956336 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-49f8a45f-3248-4f27-9b2b-614c8eb3c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:38.972286 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8a45f-3248-4f27-9b2b-614c8eb3c60f None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:38.976517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939b701-cd89-48cc-b8c1-b375c493e707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:38.977170 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939b701-cd89-48cc-b8c1-b375c493e707 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:38.977487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939b701-cd89-48cc-b8c1-b375c493e707 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:38.977924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939b701-cd89-48cc-b8c1-b375c493e707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:39.048142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939b701-cd89-48cc-b8c1-b375c493e707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:39.049636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939b701-cd89-48cc-b8c1-b375c493e707 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:39.061579 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1235/2429] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:40.651449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944151b-5b37-4fca-a631-95c627fbfa27 service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:40.661370 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944151b-5b37-4fca-a631-95c627fbfa27 service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:40.666004 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3955b76-0a82-44d0-ac87-d2196ce7b4c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:40.666849 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3955b76-0a82-44d0-ac87-d2196ce7b4c8 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:40.666849 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3955b76-0a82-44d0-ac87-d2196ce7b4c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:40.667131 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3955b76-0a82-44d0-ac87-d2196ce7b4c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:40.677449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3955b76-0a82-44d0-ac87-d2196ce7b4c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:40.678299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3955b76-0a82-44d0-ac87-d2196ce7b4c8 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:40.688636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1195/2430] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:46.858019 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939b701-cd89-48cc-b8c1-b375c493e707 service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:46.930972 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939b701-cd89-48cc-b8c1-b375c493e707 service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:46.944356 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93043b0-37de-4310-86fb-cda6f802cab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:46.948873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93043b0-37de-4310-86fb-cda6f802cab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:46.949547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93043b0-37de-4310-86fb-cda6f802cab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:46.950216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93043b0-37de-4310-86fb-cda6f802cab8 admin admin] PATH_INFO: `/v3/users/1399319633024d4eab3f4d2b664719df` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:46.951795 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93043b0-37de-4310-86fb-cda6f802cab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1399319633024d4eab3f4d2b664719df)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:46.954361 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93043b0-37de-4310-86fb-cda6f802cab8 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:47.298209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:47.305173 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c93043b0-37de-4310-86fb-cda6f802cab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1399319633024d4eab3f4d2b664719df'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:47.314534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c93043b0-37de-4310-86fb-cda6f802cab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1399319633024d4eab3f4d2b664719df'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:47.403078 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c93043b0-37de-4310-86fb-cda6f802cab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1399319633024d4eab3f4d2b664719df'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:47.404064 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c93043b0-37de-4310-86fb-cda6f802cab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1399319633024d4eab3f4d2b664719df'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:47.442458 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c93043b0-37de-4310-86fb-cda6f802cab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1399319633024d4eab3f4d2b664719df'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:47.449601 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1236/2431] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:04:46 2022] DELETE /identity/v3/users/1399319633024d4eab3f4d2b664719df => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:47.455256 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fd202-6f13-4353-b43a-ec80a5baf191 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:47.455767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fd202-6f13-4353-b43a-ec80a5baf191 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:47.455889 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fd202-6f13-4353-b43a-ec80a5baf191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:47.494772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-2a3fd202-6f13-4353-b43a-ec80a5baf191 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:47.500437 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2a3fd202-6f13-4353-b43a-ec80a5baf191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:47.536607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:47.581130 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1196/2432] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:47.592845 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93043b0-37de-4310-86fb-cda6f802cab8 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:47.596171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c93043b0-37de-4310-86fb-cda6f802cab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:47.707206 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93043b0-37de-4310-86fb-cda6f802cab8 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:47.719782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348176b4-8101-4dab-9d48-035633ed5de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:47.720562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348176b4-8101-4dab-9d48-035633ed5de1 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:47.720910 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348176b4-8101-4dab-9d48-035633ed5de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:47.722559 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348176b4-8101-4dab-9d48-035633ed5de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:47.742564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348176b4-8101-4dab-9d48-035633ed5de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:47.749002 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348176b4-8101-4dab-9d48-035633ed5de1 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:47.754873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1237/2433] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:48.366495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fd202-6f13-4353-b43a-ec80a5baf191 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:48.368371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2a3fd202-6f13-4353-b43a-ec80a5baf191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:48.386109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fd202-6f13-4353-b43a-ec80a5baf191 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:48.393740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187a998-b6d3-4c60-9ac7-7beaf320736b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:48.394820 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187a998-b6d3-4c60-9ac7-7beaf320736b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:48.395314 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187a998-b6d3-4c60-9ac7-7beaf320736b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:48.395797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187a998-b6d3-4c60-9ac7-7beaf320736b admin admin] PATH_INFO: `/v3/projects/8641283447a6447eaf205a52e26fde91` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:48.401764 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187a998-b6d3-4c60-9ac7-7beaf320736b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8641283447a6447eaf205a52e26fde91)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:48.404283 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187a998-b6d3-4c60-9ac7-7beaf320736b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:48.550216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a187a998-b6d3-4c60-9ac7-7beaf320736b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8641283447a6447eaf205a52e26fde91', 'request_id': 'req-a187a998-b6d3-4c60-9ac7-7beaf320736b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:48.671635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a187a998-b6d3-4c60-9ac7-7beaf320736b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8641283447a6447eaf205a52e26fde91', 'request_id': 'req-a187a998-b6d3-4c60-9ac7-7beaf320736b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:48.683363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a187a998-b6d3-4c60-9ac7-7beaf320736b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8641283447a6447eaf205a52e26fde91', 'request_id': 'req-a187a998-b6d3-4c60-9ac7-7beaf320736b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:48.698501 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a187a998-b6d3-4c60-9ac7-7beaf320736b admin admin] The token cache is being invalidate because project 8641283447a6447eaf205a52e26fde91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:04:48.698706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a187a998-b6d3-4c60-9ac7-7beaf320736b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:48.700457 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a187a998-b6d3-4c60-9ac7-7beaf320736b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:48.702158 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1197/2434] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:04:48 2022] DELETE /identity/v3/projects/8641283447a6447eaf205a52e26fde91 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:48.706242 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348176b4-8101-4dab-9d48-035633ed5de1 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:48.717316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348176b4-8101-4dab-9d48-035633ed5de1 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:48.779555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236d551-3a15-47e0-b6b4-384816ade409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:48.780208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236d551-3a15-47e0-b6b4-384816ade409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:48.780498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236d551-3a15-47e0-b6b4-384816ade409 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:48.780775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236d551-3a15-47e0-b6b4-384816ade409 admin admin] PATH_INFO: `/v3/users/f33b032a18f645f99c286b31b4183601` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:48.781913 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236d551-3a15-47e0-b6b4-384816ade409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f33b032a18f645f99c286b31b4183601)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:48.783844 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236d551-3a15-47e0-b6b4-384816ade409 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:49.197607 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9236d551-3a15-47e0-b6b4-384816ade409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f33b032a18f645f99c286b31b4183601'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:49.217367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9236d551-3a15-47e0-b6b4-384816ade409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f33b032a18f645f99c286b31b4183601'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:49.340965 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9236d551-3a15-47e0-b6b4-384816ade409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f33b032a18f645f99c286b31b4183601'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:49.341693 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9236d551-3a15-47e0-b6b4-384816ade409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f33b032a18f645f99c286b31b4183601'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:49.343342 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:49.450461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9236d551-3a15-47e0-b6b4-384816ade409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f33b032a18f645f99c286b31b4183601'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:49.450461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1238/2435] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:04:48 2022] DELETE /identity/v3/users/f33b032a18f645f99c286b31b4183601 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:50.873395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187a998-b6d3-4c60-9ac7-7beaf320736b admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:50.875133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-a187a998-b6d3-4c60-9ac7-7beaf320736b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:50.895735 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187a998-b6d3-4c60-9ac7-7beaf320736b admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:50.971847 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fdf16-badb-416d-ac6b-9ee899b1b105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:50.972525 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fdf16-badb-416d-ac6b-9ee899b1b105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:50.972809 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fdf16-badb-416d-ac6b-9ee899b1b105 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:50.973085 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fdf16-badb-416d-ac6b-9ee899b1b105 admin admin] PATH_INFO: `/v3/projects/b0c0ab25480b460385c3f761be75ad89` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:50.974226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fdf16-badb-416d-ac6b-9ee899b1b105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c0ab25480b460385c3f761be75ad89)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:50.976159 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fdf16-badb-416d-ac6b-9ee899b1b105 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:51.112469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-137fdf16-badb-416d-ac6b-9ee899b1b105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c0ab25480b460385c3f761be75ad89', 'request_id': 'req-137fdf16-badb-416d-ac6b-9ee899b1b105'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:51.114982 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:51.257703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-137fdf16-badb-416d-ac6b-9ee899b1b105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c0ab25480b460385c3f761be75ad89', 'request_id': 'req-137fdf16-badb-416d-ac6b-9ee899b1b105'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:51.265879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-137fdf16-badb-416d-ac6b-9ee899b1b105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c0ab25480b460385c3f761be75ad89', 'request_id': 'req-137fdf16-badb-416d-ac6b-9ee899b1b105'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:51.276896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-137fdf16-badb-416d-ac6b-9ee899b1b105 admin admin] The token cache is being invalidate because project b0c0ab25480b460385c3f761be75ad89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:04:51.295951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-137fdf16-badb-416d-ac6b-9ee899b1b105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:51.295951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-137fdf16-badb-416d-ac6b-9ee899b1b105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:51.295951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1198/2436] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:04:50 2022] DELETE /identity/v3/projects/b0c0ab25480b460385c3f761be75ad89 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:51.296379 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236d551-3a15-47e0-b6b4-384816ade409 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:51.296379 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-9236d551-3a15-47e0-b6b4-384816ade409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:51.298948 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236d551-3a15-47e0-b6b4-384816ade409 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:51.358143 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad34851-53cd-428a-a285-4190b7aa658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:51.358782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad34851-53cd-428a-a285-4190b7aa658a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:51.359087 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad34851-53cd-428a-a285-4190b7aa658a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:51.359362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad34851-53cd-428a-a285-4190b7aa658a admin admin] PATH_INFO: `/v3/users/5f1d18d42df64230877758de64eefe8f` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:51.360518 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad34851-53cd-428a-a285-4190b7aa658a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f1d18d42df64230877758de64eefe8f)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:51.362453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad34851-53cd-428a-a285-4190b7aa658a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:51.643192 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-bad34851-53cd-428a-a285-4190b7aa658a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f1d18d42df64230877758de64eefe8f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:51.650297 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-bad34851-53cd-428a-a285-4190b7aa658a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f1d18d42df64230877758de64eefe8f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:51.809585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-bad34851-53cd-428a-a285-4190b7aa658a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f1d18d42df64230877758de64eefe8f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:51.809585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-bad34851-53cd-428a-a285-4190b7aa658a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f1d18d42df64230877758de64eefe8f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:51.820985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-bad34851-53cd-428a-a285-4190b7aa658a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f1d18d42df64230877758de64eefe8f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:51.828258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1239/2437] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:04:51 2022] DELETE /identity/v3/users/5f1d18d42df64230877758de64eefe8f => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:52.507735 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fdf16-badb-416d-ac6b-9ee899b1b105 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:52.509282 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-137fdf16-badb-416d-ac6b-9ee899b1b105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:52.526597 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fdf16-badb-416d-ac6b-9ee899b1b105 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:52.598250 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf64471-970c-4685-9454-7a3d6bcf3c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:52.598250 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf64471-970c-4685-9454-7a3d6bcf3c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:52.598250 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf64471-970c-4685-9454-7a3d6bcf3c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:52.598250 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf64471-970c-4685-9454-7a3d6bcf3c63 admin admin] PATH_INFO: `/v3/projects/22c960d1490e4cc3b8f3339fa7f3aaab` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:52.598959 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf64471-970c-4685-9454-7a3d6bcf3c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c960d1490e4cc3b8f3339fa7f3aaab)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:52.599236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf64471-970c-4685-9454-7a3d6bcf3c63 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:52.716673 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5b8cd-e333-4a94-b794-c3c77d6d0c01 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:52.717176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5b8cd-e333-4a94-b794-c3c77d6d0c01 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:52.717296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5b8cd-e333-4a94-b794-c3c77d6d0c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:52.737206 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-09d5b8cd-e333-4a94-b794-c3c77d6d0c01 None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:52.738346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-09d5b8cd-e333-4a94-b794-c3c77d6d0c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:52.742388 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3cf64471-970c-4685-9454-7a3d6bcf3c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c960d1490e4cc3b8f3339fa7f3aaab', 'request_id': 'req-3cf64471-970c-4685-9454-7a3d6bcf3c63'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:52.800708 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1240/2438] 10.222.0.72 () {58 vars in 967 bytes} [Mon Aug 29 23:04:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:04:52.814252 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5b8cd-e333-4a94-b794-c3c77d6d0c01 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:52.815657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-09d5b8cd-e333-4a94-b794-c3c77d6d0c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:52.822418 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:52.890092 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5b8cd-e333-4a94-b794-c3c77d6d0c01 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:52.895066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bec1f5-81c8-4782-ac44-e06edb131c37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:52.895678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bec1f5-81c8-4782-ac44-e06edb131c37 service swift] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:52.895959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bec1f5-81c8-4782-ac44-e06edb131c37 service swift] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:52.896265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bec1f5-81c8-4782-ac44-e06edb131c37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:52.905513 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bec1f5-81c8-4782-ac44-e06edb131c37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:52.905738 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3cf64471-970c-4685-9454-7a3d6bcf3c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c960d1490e4cc3b8f3339fa7f3aaab', 'request_id': 'req-3cf64471-970c-4685-9454-7a3d6bcf3c63'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:52.907482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bec1f5-81c8-4782-ac44-e06edb131c37 service swift] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:52.913692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3cf64471-970c-4685-9454-7a3d6bcf3c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c960d1490e4cc3b8f3339fa7f3aaab', 'request_id': 'req-3cf64471-970c-4685-9454-7a3d6bcf3c63'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:52.921078 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1241/2439] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 23:04:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 23:04:52.940454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3cf64471-970c-4685-9454-7a3d6bcf3c63 admin admin] The token cache is being invalidate because project 22c960d1490e4cc3b8f3339fa7f3aaab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:04:52.940454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3cf64471-970c-4685-9454-7a3d6bcf3c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:52.940454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3cf64471-970c-4685-9454-7a3d6bcf3c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:52.940454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1199/2440] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:04:52 2022] DELETE /identity/v3/projects/22c960d1490e4cc3b8f3339fa7f3aaab => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:52.943156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd6ad-b31d-4a2c-a047-60e8b098eee9 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:52.943502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd6ad-b31d-4a2c-a047-60e8b098eee9 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:52.944276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd6ad-b31d-4a2c-a047-60e8b098eee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:52.971745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-689cd6ad-b31d-4a2c-a047-60e8b098eee9 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:52.973265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-689cd6ad-b31d-4a2c-a047-60e8b098eee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:53.045692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1242/2441] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:53.053633 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2747fe-877b-435b-9c5f-05052614d99c None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:53.054027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2747fe-877b-435b-9c5f-05052614d99c None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:53.054368 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2747fe-877b-435b-9c5f-05052614d99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:53.076710 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-fc2747fe-877b-435b-9c5f-05052614d99c None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:53.077926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-fc2747fe-877b-435b-9c5f-05052614d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:53.086626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1200/2442] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:04:53.091869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd6ad-b31d-4a2c-a047-60e8b098eee9 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:53.102413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd6ad-b31d-4a2c-a047-60e8b098eee9 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:53.107855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590df1ef-f1cd-4e70-92b7-0e317a9c6e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:53.108455 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590df1ef-f1cd-4e70-92b7-0e317a9c6e3c admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:53.109644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590df1ef-f1cd-4e70-92b7-0e317a9c6e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:53.109927 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590df1ef-f1cd-4e70-92b7-0e317a9c6e3c admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:53.110594 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590df1ef-f1cd-4e70-92b7-0e317a9c6e3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:04:53.110901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590df1ef-f1cd-4e70-92b7-0e317a9c6e3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:53.112557 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590df1ef-f1cd-4e70-92b7-0e317a9c6e3c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:53.131851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1243/2443] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:04:53.135012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2747fe-877b-435b-9c5f-05052614d99c None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:53.145227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2747fe-877b-435b-9c5f-05052614d99c None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:53.158167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf34a5b-aeb3-42f0-b83c-d070445236a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:53.158801 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf34a5b-aeb3-42f0-b83c-d070445236a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:53.159133 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf34a5b-aeb3-42f0-b83c-d070445236a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:53.161812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf34a5b-aeb3-42f0-b83c-d070445236a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:53.161812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf34a5b-aeb3-42f0-b83c-d070445236a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:53.163407 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf34a5b-aeb3-42f0-b83c-d070445236a3 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:53.334335 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1201/2444] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:04:53 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:04:53.335604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590df1ef-f1cd-4e70-92b7-0e317a9c6e3c admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:53.346223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590df1ef-f1cd-4e70-92b7-0e317a9c6e3c admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:53.410082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65039e05-a757-4064-a1e9-c5016b39a07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:53.412833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65039e05-a757-4064-a1e9-c5016b39a07a admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:53.413223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65039e05-a757-4064-a1e9-c5016b39a07a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:53.413520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65039e05-a757-4064-a1e9-c5016b39a07a admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:53.414208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65039e05-a757-4064-a1e9-c5016b39a07a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:53.416258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65039e05-a757-4064-a1e9-c5016b39a07a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:53.504415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1244/2445] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:04:53 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:04:53.508594 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf34a5b-aeb3-42f0-b83c-d070445236a3 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:53.520494 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf34a5b-aeb3-42f0-b83c-d070445236a3 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:53.525227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ba9b8-6d53-4346-a6e4-283c8d113082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:53.525837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ba9b8-6d53-4346-a6e4-283c8d113082 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:53.526121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ba9b8-6d53-4346-a6e4-283c8d113082 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:53.526398 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ba9b8-6d53-4346-a6e4-283c8d113082 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:53.527043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ba9b8-6d53-4346-a6e4-283c8d113082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:53.528696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ba9b8-6d53-4346-a6e4-283c8d113082 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:53.538798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1202/2446] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:53.543124 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65039e05-a757-4064-a1e9-c5016b39a07a admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:53.553232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65039e05-a757-4064-a1e9-c5016b39a07a admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:53.558250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c0f1-9756-4ff8-8045-92871a787bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:53.559347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c0f1-9756-4ff8-8045-92871a787bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:53.559626 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c0f1-9756-4ff8-8045-92871a787bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:53.559943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c0f1-9756-4ff8-8045-92871a787bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:53.560615 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5c0f1-9756-4ff8-8045-92871a787bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:53.562207 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5c0f1-9756-4ff8-8045-92871a787bf2 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:53.573098 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1245/2447] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:53.578109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ba9b8-6d53-4346-a6e4-283c8d113082 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:53.588466 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ba9b8-6d53-4346-a6e4-283c8d113082 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:53.593263 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bf120-d3b8-4223-ada3-27d67fc2b35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:53.593922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bf120-d3b8-4223-ada3-27d67fc2b35d admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:53.594201 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bf120-d3b8-4223-ada3-27d67fc2b35d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:53.596222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bf120-d3b8-4223-ada3-27d67fc2b35d admin admin] PATH_INFO: `/v3/projects/43b0358972724ccc964378b616be4ecc/users/73973a937eef410da17c9238f3433d84/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:53.614430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bf120-d3b8-4223-ada3-27d67fc2b35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b0358972724ccc964378b616be4ecc, user_id=73973a937eef410da17c9238f3433d84, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:53.617114 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bf120-d3b8-4223-ada3-27d67fc2b35d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:53.716901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1203/2448] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:04:53 2022] PUT /identity/v3/projects/43b0358972724ccc964378b616be4ecc/users/73973a937eef410da17c9238f3433d84/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:53.728547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c2915-8c58-4603-9d00-96b07086f498 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:53.729093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c2915-8c58-4603-9d00-96b07086f498 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:53.729196 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c2915-8c58-4603-9d00-96b07086f498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:53.759753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-761c2915-8c58-4603-9d00-96b07086f498 None None] MFA Rules not processed for user `73973a937eef410da17c9238f3433d84`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:53.761012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-761c2915-8c58-4603-9d00-96b07086f498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:53.797513 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:53.828558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1246/2449] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:53.833183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bf120-d3b8-4223-ada3-27d67fc2b35d admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:53.843322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:53.900182 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bf120-d3b8-4223-ada3-27d67fc2b35d admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:53.907862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df753c-1055-4402-8803-b0b723c7a7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:53.907862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df753c-1055-4402-8803-b0b723c7a7ee admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:53.907862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df753c-1055-4402-8803-b0b723c7a7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:53.907862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df753c-1055-4402-8803-b0b723c7a7ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:53.908520 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df753c-1055-4402-8803-b0b723c7a7ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:53.909738 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df753c-1055-4402-8803-b0b723c7a7ee admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:54.040434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1204/2450] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:04:53 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:04:54.052856 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c2915-8c58-4603-9d00-96b07086f498 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:54.064675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c2915-8c58-4603-9d00-96b07086f498 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:54.119748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf45316-6e26-4381-9f0e-8bff37d3a80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:54.120387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf45316-6e26-4381-9f0e-8bff37d3a80d admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:54.120667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf45316-6e26-4381-9f0e-8bff37d3a80d admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:54.121027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf45316-6e26-4381-9f0e-8bff37d3a80d admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:54.121670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf45316-6e26-4381-9f0e-8bff37d3a80d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:54.123567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf45316-6e26-4381-9f0e-8bff37d3a80d admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:54.200714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1247/2451] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:04:54 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:04:54.204875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df753c-1055-4402-8803-b0b723c7a7ee admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:54.216327 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df753c-1055-4402-8803-b0b723c7a7ee admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:54.221251 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e5754-440e-4ddd-a3d6-12a4e72ad213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:54.221886 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e5754-440e-4ddd-a3d6-12a4e72ad213 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:54.222520 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e5754-440e-4ddd-a3d6-12a4e72ad213 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:54.222794 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e5754-440e-4ddd-a3d6-12a4e72ad213 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:54.223445 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e5754-440e-4ddd-a3d6-12a4e72ad213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:54.225076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e5754-440e-4ddd-a3d6-12a4e72ad213 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:54.237007 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1205/2452] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:54.241092 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf45316-6e26-4381-9f0e-8bff37d3a80d admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:54.251567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf45316-6e26-4381-9f0e-8bff37d3a80d admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:54.256902 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdedf2-28e0-40b6-9339-dcf1ae6d8c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:54.257580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdedf2-28e0-40b6-9339-dcf1ae6d8c8c admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:54.257901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdedf2-28e0-40b6-9339-dcf1ae6d8c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:54.258227 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdedf2-28e0-40b6-9339-dcf1ae6d8c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:54.258895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdedf2-28e0-40b6-9339-dcf1ae6d8c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:54.260658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdedf2-28e0-40b6-9339-dcf1ae6d8c8c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:54.275007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1248/2453] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:54.276475 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e5754-440e-4ddd-a3d6-12a4e72ad213 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:54.287034 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e5754-440e-4ddd-a3d6-12a4e72ad213 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:54.291652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc4563-1d30-47c1-8b6c-732434a0e064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:54.292341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4563-1d30-47c1-8b6c-732434a0e064 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:54.292707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4563-1d30-47c1-8b6c-732434a0e064 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:54.293577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4563-1d30-47c1-8b6c-732434a0e064 admin admin] PATH_INFO: `/v3/projects/02e9c4ce297a43b1a96f37090ac28dc6/users/5e963c516c894288a0604533a18e53f8/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:54.313996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc4563-1d30-47c1-8b6c-732434a0e064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e9c4ce297a43b1a96f37090ac28dc6, user_id=5e963c516c894288a0604533a18e53f8, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:54.316695 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc4563-1d30-47c1-8b6c-732434a0e064 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:54.401363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1206/2454] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:04:54 2022] PUT /identity/v3/projects/02e9c4ce297a43b1a96f37090ac28dc6/users/5e963c516c894288a0604533a18e53f8/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:04:54.412400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21558bc-4f9e-4192-88f0-d0df759ee3e7 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:54.412668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21558bc-4f9e-4192-88f0-d0df759ee3e7 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:54.412785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21558bc-4f9e-4192-88f0-d0df759ee3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:54.456086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-d21558bc-4f9e-4192-88f0-d0df759ee3e7 None None] MFA Rules not processed for user `5e963c516c894288a0604533a18e53f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:54.457438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d21558bc-4f9e-4192-88f0-d0df759ee3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:54.541658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:54.546205 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1249/2455] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:54.550649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc4563-1d30-47c1-8b6c-732434a0e064 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:54.586300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21558bc-4f9e-4192-88f0-d0df759ee3e7 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:54.587775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d21558bc-4f9e-4192-88f0-d0df759ee3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:54.626728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc4563-1d30-47c1-8b6c-732434a0e064 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:54.631462 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316d561-5ec0-4a96-99db-2794dc9faf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:54.632367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316d561-5ec0-4a96-99db-2794dc9faf4a admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:54.632650 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316d561-5ec0-4a96-99db-2794dc9faf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:54.632923 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316d561-5ec0-4a96-99db-2794dc9faf4a admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:54.633670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316d561-5ec0-4a96-99db-2794dc9faf4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:54.635567 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316d561-5ec0-4a96-99db-2794dc9faf4a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:54.647737 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21558bc-4f9e-4192-88f0-d0df759ee3e7 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:54.653758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2f604-bccb-4404-b08f-08c2eefe2f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:54.654378 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2f604-bccb-4404-b08f-08c2eefe2f7d service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:54.654690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2f604-bccb-4404-b08f-08c2eefe2f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:54.654966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2f604-bccb-4404-b08f-08c2eefe2f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:54.656802 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-edc2f604-bccb-4404-b08f-08c2eefe2f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:54.669456 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2f604-bccb-4404-b08f-08c2eefe2f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:54.670925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2f604-bccb-4404-b08f-08c2eefe2f7d service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:54.681044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1250/2456] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:54.725917 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1207/2457] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:04:54 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:04:54.730394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2f604-bccb-4404-b08f-08c2eefe2f7d service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:54.741789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2f604-bccb-4404-b08f-08c2eefe2f7d service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:54.805886 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e233eb0-0343-4677-a231-dae683c6e993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:54.808101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e233eb0-0343-4677-a231-dae683c6e993 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:54.808702 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e233eb0-0343-4677-a231-dae683c6e993 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:54.808923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e233eb0-0343-4677-a231-dae683c6e993 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:54.809579 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e233eb0-0343-4677-a231-dae683c6e993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:54.811539 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e233eb0-0343-4677-a231-dae683c6e993 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:54.932305 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1251/2458] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:04:54 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:04:54.934423 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316d561-5ec0-4a96-99db-2794dc9faf4a admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:54.945007 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316d561-5ec0-4a96-99db-2794dc9faf4a admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:54.949909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a403f-0171-4157-9c4f-c9b9a32666b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:54.950528 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a403f-0171-4157-9c4f-c9b9a32666b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:54.950811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a403f-0171-4157-9c4f-c9b9a32666b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:54.951090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a403f-0171-4157-9c4f-c9b9a32666b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:54.951737 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a403f-0171-4157-9c4f-c9b9a32666b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:54.953378 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a403f-0171-4157-9c4f-c9b9a32666b7 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:54.965119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1208/2459] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:54.969614 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e233eb0-0343-4677-a231-dae683c6e993 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:54.981541 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e233eb0-0343-4677-a231-dae683c6e993 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:54.986277 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8d4f6-bdda-4b30-a9c0-734cbe138d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:54.987079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8d4f6-bdda-4b30-a9c0-734cbe138d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:54.987364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8d4f6-bdda-4b30-a9c0-734cbe138d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:54.987645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8d4f6-bdda-4b30-a9c0-734cbe138d15 admin admin] PATH_INFO: `/v3/projects/85ada4156bcf4dc08819aae696bb38d2/users/91cc274926114fefb8663d7eca060fc2/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:55.003632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8d4f6-bdda-4b30-a9c0-734cbe138d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ada4156bcf4dc08819aae696bb38d2, user_id=91cc274926114fefb8663d7eca060fc2, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:55.006592 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8d4f6-bdda-4b30-a9c0-734cbe138d15 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:55.106907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1252/2460] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:04:54 2022] PUT /identity/v3/projects/85ada4156bcf4dc08819aae696bb38d2/users/91cc274926114fefb8663d7eca060fc2/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:55.110611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a403f-0171-4157-9c4f-c9b9a32666b7 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:55.121182 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a403f-0171-4157-9c4f-c9b9a32666b7 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:55.170342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:55.220779 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bc1d7-b854-47ad-b23a-4edaaadc0313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:55.221684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bc1d7-b854-47ad-b23a-4edaaadc0313 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:55.221969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bc1d7-b854-47ad-b23a-4edaaadc0313 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:55.222245 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bc1d7-b854-47ad-b23a-4edaaadc0313 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:55.223394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bc1d7-b854-47ad-b23a-4edaaadc0313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:55.229366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bc1d7-b854-47ad-b23a-4edaaadc0313 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:55.248358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1209/2461] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:04:55.248512 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8d4f6-bdda-4b30-a9c0-734cbe138d15 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:55.258006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8d4f6-bdda-4b30-a9c0-734cbe138d15 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:55.263755 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965e413-fc64-4ead-8c8c-0ac1544f954a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:55.264458 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965e413-fc64-4ead-8c8c-0ac1544f954a admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:55.264745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965e413-fc64-4ead-8c8c-0ac1544f954a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:55.265017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965e413-fc64-4ead-8c8c-0ac1544f954a admin admin] PATH_INFO: `/v3/projects/85ada4156bcf4dc08819aae696bb38d2/users/91cc274926114fefb8663d7eca060fc2/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:55.267295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965e413-fc64-4ead-8c8c-0ac1544f954a admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ada4156bcf4dc08819aae696bb38d2, user_id=91cc274926114fefb8663d7eca060fc2, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:55.269666 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965e413-fc64-4ead-8c8c-0ac1544f954a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:55.285946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1253/2462] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:04:55 2022] PUT /identity/v3/projects/85ada4156bcf4dc08819aae696bb38d2/users/91cc274926114fefb8663d7eca060fc2/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:55.302632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be1646-e70a-4e94-87ca-90a695ad5635 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:55.302924 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be1646-e70a-4e94-87ca-90a695ad5635 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:55.303216 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be1646-e70a-4e94-87ca-90a695ad5635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:55.335354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-48be1646-e70a-4e94-87ca-90a695ad5635 None None] MFA Rules not processed for user `91cc274926114fefb8663d7eca060fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:55.336874 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-48be1646-e70a-4e94-87ca-90a695ad5635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:55.421430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1210/2463] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:04:55.430994 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965e413-fc64-4ead-8c8c-0ac1544f954a admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:55.434649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4965e413-fc64-4ead-8c8c-0ac1544f954a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:55.523348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965e413-fc64-4ead-8c8c-0ac1544f954a admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:55.528084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca9a67-0cbd-435d-aa43-8bacca77ebe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:55.529232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca9a67-0cbd-435d-aa43-8bacca77ebe9 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:55.529232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca9a67-0cbd-435d-aa43-8bacca77ebe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:55.529539 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca9a67-0cbd-435d-aa43-8bacca77ebe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:55.536566 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:55.605521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca9a67-0cbd-435d-aa43-8bacca77ebe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:55.607449 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca9a67-0cbd-435d-aa43-8bacca77ebe9 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:55.622487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1254/2464] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:57.733458 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be1646-e70a-4e94-87ca-90a695ad5635 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:57.736287 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-48be1646-e70a-4e94-87ca-90a695ad5635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:57.750122 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be1646-e70a-4e94-87ca-90a695ad5635 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:57.753699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619071d-0028-4f0e-b1af-bd73034a4eac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:57.754331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619071d-0028-4f0e-b1af-bd73034a4eac service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:57.754612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619071d-0028-4f0e-b1af-bd73034a4eac service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:57.754890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619071d-0028-4f0e-b1af-bd73034a4eac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:57.822862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619071d-0028-4f0e-b1af-bd73034a4eac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:57.825114 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619071d-0028-4f0e-b1af-bd73034a4eac service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:57.836558 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1211/2465] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:58.626465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca9a67-0cbd-435d-aa43-8bacca77ebe9 service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:58.628059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-03ca9a67-0cbd-435d-aa43-8bacca77ebe9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:58.705242 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca9a67-0cbd-435d-aa43-8bacca77ebe9 service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:58.710186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d4924-1d1a-41dc-9981-8761e8b0ff56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5fb88d96640089eba545f4c8d3c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:58.710795 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d4924-1d1a-41dc-9981-8761e8b0ff56 service placement] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:58.711075 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d4924-1d1a-41dc-9981-8761e8b0ff56 service placement] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:58.711365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d4924-1d1a-41dc-9981-8761e8b0ff56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:58.713079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-454d4924-1d1a-41dc-9981-8761e8b0ff56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:58.725810 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d4924-1d1a-41dc-9981-8761e8b0ff56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:58.729835 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d4924-1d1a-41dc-9981-8761e8b0ff56 service placement] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:58.738729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1255/2466] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:58.803043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619071d-0028-4f0e-b1af-bd73034a4eac service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:58.804624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8619071d-0028-4f0e-b1af-bd73034a4eac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:58.867003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:58.884844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619071d-0028-4f0e-b1af-bd73034a4eac service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:58.890620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73402ea-f97f-440e-bbc6-6fb9576efef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:58.891338 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73402ea-f97f-440e-bbc6-6fb9576efef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:58.891679 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73402ea-f97f-440e-bbc6-6fb9576efef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:58.896580 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73402ea-f97f-440e-bbc6-6fb9576efef6 admin admin] PATH_INFO: `/v3/users/24dbd95c579d44cd8c95ca63669fca24` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:58.896580 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73402ea-f97f-440e-bbc6-6fb9576efef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24dbd95c579d44cd8c95ca63669fca24)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:58.896580 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73402ea-f97f-440e-bbc6-6fb9576efef6 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:59.140030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f73402ea-f97f-440e-bbc6-6fb9576efef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24dbd95c579d44cd8c95ca63669fca24'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:59.140720 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f73402ea-f97f-440e-bbc6-6fb9576efef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24dbd95c579d44cd8c95ca63669fca24'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:59.141490 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f73402ea-f97f-440e-bbc6-6fb9576efef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24dbd95c579d44cd8c95ca63669fca24'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:59.154124 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f73402ea-f97f-440e-bbc6-6fb9576efef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24dbd95c579d44cd8c95ca63669fca24'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:59.161483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-f73402ea-f97f-440e-bbc6-6fb9576efef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24dbd95c579d44cd8c95ca63669fca24'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:59.241177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1212/2467] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:04:58 2022] DELETE /identity/v3/users/24dbd95c579d44cd8c95ca63669fca24 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:04:59.439215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d4924-1d1a-41dc-9981-8761e8b0ff56 service placement] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:59.448987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d4924-1d1a-41dc-9981-8761e8b0ff56 service placement] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:59.499688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1026f2-9eb1-4729-9c61-4dcaf2d64f78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:59.500332 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1026f2-9eb1-4729-9c61-4dcaf2d64f78 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:59.500643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1026f2-9eb1-4729-9c61-4dcaf2d64f78 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:59.500917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1026f2-9eb1-4729-9c61-4dcaf2d64f78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:59.502740 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-3b1026f2-9eb1-4729-9c61-4dcaf2d64f78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:59.548058 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73402ea-f97f-440e-bbc6-6fb9576efef6 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:04:59.549608 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f73402ea-f97f-440e-bbc6-6fb9576efef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:04:59.554060 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:59.570997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1026f2-9eb1-4729-9c61-4dcaf2d64f78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:59.575031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1026f2-9eb1-4729-9c61-4dcaf2d64f78 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:59.586010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1256/2468] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:04:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:04:59.634291 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73402ea-f97f-440e-bbc6-6fb9576efef6 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:04:59.640142 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed94f4-2618-46d7-afc8-781b7f913892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:04:59.640826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed94f4-2618-46d7-afc8-781b7f913892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:59.641157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed94f4-2618-46d7-afc8-781b7f913892 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:59.641488 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed94f4-2618-46d7-afc8-781b7f913892 admin admin] PATH_INFO: `/v3/projects/94e828a5db8540e4b59bddaa6007e03d` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:59.642572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed94f4-2618-46d7-afc8-781b7f913892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e828a5db8540e4b59bddaa6007e03d)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:04:59.644523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed94f4-2618-46d7-afc8-781b7f913892 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:04:59.781154 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-94ed94f4-2618-46d7-afc8-781b7f913892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e828a5db8540e4b59bddaa6007e03d', 'request_id': 'req-94ed94f4-2618-46d7-afc8-781b7f913892'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:59.869530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-94ed94f4-2618-46d7-afc8-781b7f913892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e828a5db8540e4b59bddaa6007e03d', 'request_id': 'req-94ed94f4-2618-46d7-afc8-781b7f913892'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:59.877578 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-94ed94f4-2618-46d7-afc8-781b7f913892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e828a5db8540e4b59bddaa6007e03d', 'request_id': 'req-94ed94f4-2618-46d7-afc8-781b7f913892'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:59.885472 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:59.890727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-94ed94f4-2618-46d7-afc8-781b7f913892 admin admin] The token cache is being invalidate because project 94e828a5db8540e4b59bddaa6007e03d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:04:59.891016 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-94ed94f4-2618-46d7-afc8-781b7f913892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:59.891771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-94ed94f4-2618-46d7-afc8-781b7f913892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:04:59.893538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1213/2469] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:04:59 2022] DELETE /identity/v3/projects/94e828a5db8540e4b59bddaa6007e03d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:04:59.898214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86cf73-5a13-4bd3-aa67-45c0823977e0 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:04:59.898652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86cf73-5a13-4bd3-aa67-45c0823977e0 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:04:59.898765 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86cf73-5a13-4bd3-aa67-45c0823977e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:04:59.930512 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-ca86cf73-5a13-4bd3-aa67-45c0823977e0 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:04:59.936998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ca86cf73-5a13-4bd3-aa67-45c0823977e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:00.001210 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1257/2470] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:00.008969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96f77c-4eed-409a-8c30-2c1a37956c4b None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:00.009260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96f77c-4eed-409a-8c30-2c1a37956c4b None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:00.009538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96f77c-4eed-409a-8c30-2c1a37956c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:00.030783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-0a96f77c-4eed-409a-8c30-2c1a37956c4b None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:00.032038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0a96f77c-4eed-409a-8c30-2c1a37956c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:00.040167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1214/2471] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:00.044598 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86cf73-5a13-4bd3-aa67-45c0823977e0 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:00.055514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86cf73-5a13-4bd3-aa67-45c0823977e0 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:00.061493 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec01b-5c45-405e-87a5-a19cf8c19f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:00.062115 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec01b-5c45-405e-87a5-a19cf8c19f7e admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:00.062393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec01b-5c45-405e-87a5-a19cf8c19f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:00.062668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec01b-5c45-405e-87a5-a19cf8c19f7e admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:00.063326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ec01b-5c45-405e-87a5-a19cf8c19f7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:05:00.063628 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ec01b-5c45-405e-87a5-a19cf8c19f7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:00.065321 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ec01b-5c45-405e-87a5-a19cf8c19f7e admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:00.081420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1258/2472] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:05:00.089271 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96f77c-4eed-409a-8c30-2c1a37956c4b None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:00.098974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96f77c-4eed-409a-8c30-2c1a37956c4b None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:00.103664 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4d4c3-8510-4bde-ad5b-7adaf7f5e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:00.104523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4d4c3-8510-4bde-ad5b-7adaf7f5e56e admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:00.104802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4d4c3-8510-4bde-ad5b-7adaf7f5e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:00.105102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4d4c3-8510-4bde-ad5b-7adaf7f5e56e admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:00.105926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4d4c3-8510-4bde-ad5b-7adaf7f5e56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:00.107803 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4d4c3-8510-4bde-ad5b-7adaf7f5e56e admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:00.223168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1215/2473] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:05:00 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:05:00.224639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec01b-5c45-405e-87a5-a19cf8c19f7e admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:00.234965 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec01b-5c45-405e-87a5-a19cf8c19f7e admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:00.294310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467feda-812c-4ab5-9cad-17a33f28be0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:00.295193 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467feda-812c-4ab5-9cad-17a33f28be0a admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:00.295641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467feda-812c-4ab5-9cad-17a33f28be0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:00.301346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467feda-812c-4ab5-9cad-17a33f28be0a admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:00.301346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467feda-812c-4ab5-9cad-17a33f28be0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:00.301346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467feda-812c-4ab5-9cad-17a33f28be0a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:00.388562 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1259/2474] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:05:00 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:05:00.390869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4d4c3-8510-4bde-ad5b-7adaf7f5e56e admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:00.402282 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4d4c3-8510-4bde-ad5b-7adaf7f5e56e admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:00.409647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4418dc-f5cf-4fa5-9b40-aec67c9d36e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:00.410317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4418dc-f5cf-4fa5-9b40-aec67c9d36e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:00.410595 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4418dc-f5cf-4fa5-9b40-aec67c9d36e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:00.416474 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4418dc-f5cf-4fa5-9b40-aec67c9d36e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:00.416474 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4418dc-f5cf-4fa5-9b40-aec67c9d36e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:00.416474 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4418dc-f5cf-4fa5-9b40-aec67c9d36e5 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:00.425240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1216/2475] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:05:00.429082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467feda-812c-4ab5-9cad-17a33f28be0a admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:00.440948 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467feda-812c-4ab5-9cad-17a33f28be0a admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:00.446080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82994cf2-b085-4316-b060-15d20f7a5526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:00.446621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82994cf2-b085-4316-b060-15d20f7a5526 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:00.446907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82994cf2-b085-4316-b060-15d20f7a5526 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:00.447176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82994cf2-b085-4316-b060-15d20f7a5526 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:00.447971 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82994cf2-b085-4316-b060-15d20f7a5526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:00.449759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82994cf2-b085-4316-b060-15d20f7a5526 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:00.463715 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1260/2476] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:05:00.468467 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4418dc-f5cf-4fa5-9b40-aec67c9d36e5 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:00.479576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4418dc-f5cf-4fa5-9b40-aec67c9d36e5 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:00.485446 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5636c-01fa-4c4a-930c-6fd698a3ab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:00.486113 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5636c-01fa-4c4a-930c-6fd698a3ab54 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:00.486399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5636c-01fa-4c4a-930c-6fd698a3ab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:00.486686 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5636c-01fa-4c4a-930c-6fd698a3ab54 admin admin] PATH_INFO: `/v3/projects/5bc97a51f5ed445ca26b7686ab07cd95/users/0853f31706754c53bf41346268f4e12b/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:00.506846 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5636c-01fa-4c4a-930c-6fd698a3ab54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc97a51f5ed445ca26b7686ab07cd95, user_id=0853f31706754c53bf41346268f4e12b, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:00.510257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5636c-01fa-4c4a-930c-6fd698a3ab54 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:00.598033 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1217/2477] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:05:00 2022] PUT /identity/v3/projects/5bc97a51f5ed445ca26b7686ab07cd95/users/0853f31706754c53bf41346268f4e12b/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:00.610182 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e2874-2217-4e6f-bfdb-21407b10bd48 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:00.610471 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e2874-2217-4e6f-bfdb-21407b10bd48 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:00.610745 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e2874-2217-4e6f-bfdb-21407b10bd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:00.641199 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-8a0e2874-2217-4e6f-bfdb-21407b10bd48 None None] MFA Rules not processed for user `0853f31706754c53bf41346268f4e12b`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:00.642435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8a0e2874-2217-4e6f-bfdb-21407b10bd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:00.696916 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:00.720160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1261/2478] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:05:00.724906 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5636c-01fa-4c4a-930c-6fd698a3ab54 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:00.792048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5636c-01fa-4c4a-930c-6fd698a3ab54 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:00.797648 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619d7d6-aabe-4ae2-ba97-f5bc29443d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:00.798300 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619d7d6-aabe-4ae2-ba97-f5bc29443d83 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:00.798579 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619d7d6-aabe-4ae2-ba97-f5bc29443d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:00.798850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619d7d6-aabe-4ae2-ba97-f5bc29443d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:00.799483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619d7d6-aabe-4ae2-ba97-f5bc29443d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:00.801488 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619d7d6-aabe-4ae2-ba97-f5bc29443d83 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:00.926220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1218/2479] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:05:00 2022] POST /identity/v3/projects => generated 367 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:05:00.930796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e2874-2217-4e6f-bfdb-21407b10bd48 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:00.943308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e2874-2217-4e6f-bfdb-21407b10bd48 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:01.041807 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78ec1f-4107-4a88-9724-2049dbf98bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:01.043287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78ec1f-4107-4a88-9724-2049dbf98bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:01.043488 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78ec1f-4107-4a88-9724-2049dbf98bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:01.043931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78ec1f-4107-4a88-9724-2049dbf98bb2 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:01.044688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78ec1f-4107-4a88-9724-2049dbf98bb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:01.046767 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78ec1f-4107-4a88-9724-2049dbf98bb2 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:01.176330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1262/2480] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:05:00 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:05:01.180646 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619d7d6-aabe-4ae2-ba97-f5bc29443d83 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:01.193636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619d7d6-aabe-4ae2-ba97-f5bc29443d83 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:01.199756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0484693-f790-4f04-b551-d1b669e7c6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:01.200622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0484693-f790-4f04-b551-d1b669e7c6ad admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:01.200898 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0484693-f790-4f04-b551-d1b669e7c6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:01.201174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0484693-f790-4f04-b551-d1b669e7c6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:01.201966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0484693-f790-4f04-b551-d1b669e7c6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:01.203577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0484693-f790-4f04-b551-d1b669e7c6ad admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:01.217251 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1219/2481] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:05:01.221270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78ec1f-4107-4a88-9724-2049dbf98bb2 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:01.235044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78ec1f-4107-4a88-9724-2049dbf98bb2 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:01.246960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844fd47-3905-46bd-b6c9-d1be5a1153ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:01.249353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844fd47-3905-46bd-b6c9-d1be5a1153ce admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:01.249353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844fd47-3905-46bd-b6c9-d1be5a1153ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:01.249353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844fd47-3905-46bd-b6c9-d1be5a1153ce admin admin] PATH_INFO: `/v3/projects/f25ba3e5ef004852aba6c019f47620e9/users/e8d4baec6da54275a1389ef66f62171d/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:01.269409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844fd47-3905-46bd-b6c9-d1be5a1153ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25ba3e5ef004852aba6c019f47620e9, user_id=e8d4baec6da54275a1389ef66f62171d, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:01.272343 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844fd47-3905-46bd-b6c9-d1be5a1153ce admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:01.381621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1263/2482] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:05:01 2022] PUT /identity/v3/projects/f25ba3e5ef004852aba6c019f47620e9/users/e8d4baec6da54275a1389ef66f62171d/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:05:01.385782 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0484693-f790-4f04-b551-d1b669e7c6ad admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:01.399834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0484693-f790-4f04-b551-d1b669e7c6ad admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:01.472487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebbd53-31b4-4915-abee-1c79d574ce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:01.473056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebbd53-31b4-4915-abee-1c79d574ce91 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:01.473342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebbd53-31b4-4915-abee-1c79d574ce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:01.473619 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebbd53-31b4-4915-abee-1c79d574ce91 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:01.474299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebbd53-31b4-4915-abee-1c79d574ce91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:01.476101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebbd53-31b4-4915-abee-1c79d574ce91 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:01.496322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844fd47-3905-46bd-b6c9-d1be5a1153ce admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:01.496752 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1220/2483] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:05:01.510130 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844fd47-3905-46bd-b6c9-d1be5a1153ce admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:01.515781 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f724ee7-226c-49aa-abb3-dc585622f2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:01.516503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f724ee7-226c-49aa-abb3-dc585622f2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:01.516785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f724ee7-226c-49aa-abb3-dc585622f2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:01.517064 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f724ee7-226c-49aa-abb3-dc585622f2ae admin admin] PATH_INFO: `/v3/projects/f25ba3e5ef004852aba6c019f47620e9/users/e8d4baec6da54275a1389ef66f62171d/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:01.519358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f724ee7-226c-49aa-abb3-dc585622f2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25ba3e5ef004852aba6c019f47620e9, user_id=e8d4baec6da54275a1389ef66f62171d, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:01.522317 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f724ee7-226c-49aa-abb3-dc585622f2ae admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:01.540461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1264/2484] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:05:01 2022] PUT /identity/v3/projects/f25ba3e5ef004852aba6c019f47620e9/users/e8d4baec6da54275a1389ef66f62171d/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:05:01.552960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb545-2fda-4c01-b27b-1a86997979e4 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:01.553283 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb545-2fda-4c01-b27b-1a86997979e4 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:01.553569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb545-2fda-4c01-b27b-1a86997979e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:01.570631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:01.593813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-9e6cb545-2fda-4c01-b27b-1a86997979e4 None None] MFA Rules not processed for user `e8d4baec6da54275a1389ef66f62171d`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:01.597485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9e6cb545-2fda-4c01-b27b-1a86997979e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:01.723895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1221/2485] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:01.736313 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f724ee7-226c-49aa-abb3-dc585622f2ae admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:01.738651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4f724ee7-226c-49aa-abb3-dc585622f2ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:01.838203 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f724ee7-226c-49aa-abb3-dc585622f2ae admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:01.845891 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69933c1b-6e82-4399-ae6f-55ec1cda4563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:01.847162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69933c1b-6e82-4399-ae6f-55ec1cda4563 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:01.847748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69933c1b-6e82-4399-ae6f-55ec1cda4563 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:01.848361 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69933c1b-6e82-4399-ae6f-55ec1cda4563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:01.868663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69933c1b-6e82-4399-ae6f-55ec1cda4563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:01.871510 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69933c1b-6e82-4399-ae6f-55ec1cda4563 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:01.892366 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1265/2486] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:05:04.578896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cb545-2fda-4c01-b27b-1a86997979e4 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:04.580353 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9e6cb545-2fda-4c01-b27b-1a86997979e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:04.650088 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cb545-2fda-4c01-b27b-1a86997979e4 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:04.655300 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119f5f6-3238-43c2-8112-cbd74ec4605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:04.655966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119f5f6-3238-43c2-8112-cbd74ec4605e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:04.656272 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119f5f6-3238-43c2-8112-cbd74ec4605e admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:04.656549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119f5f6-3238-43c2-8112-cbd74ec4605e admin admin] PATH_INFO: `/v3/users/73973a937eef410da17c9238f3433d84` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:04.657678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119f5f6-3238-43c2-8112-cbd74ec4605e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73973a937eef410da17c9238f3433d84)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:04.659596 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119f5f6-3238-43c2-8112-cbd74ec4605e admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:04.821257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c119f5f6-3238-43c2-8112-cbd74ec4605e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73973a937eef410da17c9238f3433d84'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:04.822018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c119f5f6-3238-43c2-8112-cbd74ec4605e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73973a937eef410da17c9238f3433d84'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:04.822694 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c119f5f6-3238-43c2-8112-cbd74ec4605e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73973a937eef410da17c9238f3433d84'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:04.835639 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c119f5f6-3238-43c2-8112-cbd74ec4605e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73973a937eef410da17c9238f3433d84'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:04.843384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c119f5f6-3238-43c2-8112-cbd74ec4605e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73973a937eef410da17c9238f3433d84'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:04.938780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1222/2487] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:05:04 2022] DELETE /identity/v3/users/73973a937eef410da17c9238f3433d84 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:04.943220 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4d368-2da9-462a-b371-5b2abddc8045 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:04.943672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4d368-2da9-462a-b371-5b2abddc8045 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:04.943780 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4d368-2da9-462a-b371-5b2abddc8045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:04.954481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119f5f6-3238-43c2-8112-cbd74ec4605e admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:04.955959 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c119f5f6-3238-43c2-8112-cbd74ec4605e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:04.967587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-e4e4d368-2da9-462a-b371-5b2abddc8045 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:04.968851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e4e4d368-2da9-462a-b371-5b2abddc8045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:04.972073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:05.002817 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:05.031080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1266/2488] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:05:05.031578 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119f5f6-3238-43c2-8112-cbd74ec4605e admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:05.037517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b820d0-4c32-4e82-bf93-5f4b5673db5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:05.038219 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b820d0-4c32-4e82-bf93-5f4b5673db5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:05.038496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b820d0-4c32-4e82-bf93-5f4b5673db5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:05.038768 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b820d0-4c32-4e82-bf93-5f4b5673db5f admin admin] PATH_INFO: `/v3/users/0853f31706754c53bf41346268f4e12b` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:05.040013 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b820d0-4c32-4e82-bf93-5f4b5673db5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0853f31706754c53bf41346268f4e12b)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:05.041267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4d368-2da9-462a-b371-5b2abddc8045 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:05.042011 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b820d0-4c32-4e82-bf93-5f4b5673db5f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:05.043013 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e4e4d368-2da9-462a-b371-5b2abddc8045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:05.106071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4d368-2da9-462a-b371-5b2abddc8045 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:05.109748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fc1e0-92aa-4693-882c-cd407653be62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:05.110414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fc1e0-92aa-4693-882c-cd407653be62 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:05.110698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fc1e0-92aa-4693-882c-cd407653be62 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:05.110973 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fc1e0-92aa-4693-882c-cd407653be62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:05.120786 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fc1e0-92aa-4693-882c-cd407653be62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:05.122307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fc1e0-92aa-4693-882c-cd407653be62 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:05.132586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1267/2489] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:05:05.235174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-00b820d0-4c32-4e82-bf93-5f4b5673db5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0853f31706754c53bf41346268f4e12b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:05.235892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-00b820d0-4c32-4e82-bf93-5f4b5673db5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0853f31706754c53bf41346268f4e12b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:05.236523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-00b820d0-4c32-4e82-bf93-5f4b5673db5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0853f31706754c53bf41346268f4e12b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:05.250400 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-00b820d0-4c32-4e82-bf93-5f4b5673db5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0853f31706754c53bf41346268f4e12b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:05.258055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-00b820d0-4c32-4e82-bf93-5f4b5673db5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0853f31706754c53bf41346268f4e12b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:05.341360 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1223/2490] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:05:04 2022] DELETE /identity/v3/users/0853f31706754c53bf41346268f4e12b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:05:05.345958 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65720ec1-8513-4972-9b63-eecec1d51ee1 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:05.346253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65720ec1-8513-4972-9b63-eecec1d51ee1 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:05.346721 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65720ec1-8513-4972-9b63-eecec1d51ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:05.369063 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-65720ec1-8513-4972-9b63-eecec1d51ee1 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:05.370312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-65720ec1-8513-4972-9b63-eecec1d51ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:05.447696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1268/2491] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:05.458948 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b820d0-4c32-4e82-bf93-5f4b5673db5f admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:05.460487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-00b820d0-4c32-4e82-bf93-5f4b5673db5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:05.521625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b820d0-4c32-4e82-bf93-5f4b5673db5f admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:05.525525 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05497c58-681c-4ad7-9c42-9ad82309e0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:05.526128 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05497c58-681c-4ad7-9c42-9ad82309e0ad service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:05.526404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05497c58-681c-4ad7-9c42-9ad82309e0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:05.526673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05497c58-681c-4ad7-9c42-9ad82309e0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:05.536329 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05497c58-681c-4ad7-9c42-9ad82309e0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:05.537750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05497c58-681c-4ad7-9c42-9ad82309e0ad service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:05.547783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1224/2492] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:05:05.576051 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65720ec1-8513-4972-9b63-eecec1d51ee1 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:05.580910 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-65720ec1-8513-4972-9b63-eecec1d51ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:05.601266 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65720ec1-8513-4972-9b63-eecec1d51ee1 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:05.609938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:05.609938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:05.609938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:05.610193 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c admin admin] PATH_INFO: `/v3/projects/43b0358972724ccc964378b616be4ecc` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:05.611126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b0358972724ccc964378b616be4ecc)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:05.613088 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:05.736270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b0358972724ccc964378b616be4ecc', 'request_id': 'req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:05.742450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b0358972724ccc964378b616be4ecc', 'request_id': 'req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:05.749402 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b0358972724ccc964378b616be4ecc', 'request_id': 'req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:05.848467 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c admin admin] The token cache is being invalidate because project 43b0358972724ccc964378b616be4ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:05:05.848829 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:05.849499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:05.851698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1269/2493] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:05:05 2022] DELETE /identity/v3/projects/43b0358972724ccc964378b616be4ecc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:05.856449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05497c58-681c-4ad7-9c42-9ad82309e0ad service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:05.866443 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05497c58-681c-4ad7-9c42-9ad82309e0ad service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:05.898271 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:05.924972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc1dea-da29-4d4a-8618-558cc72ce7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:05.925618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1dea-da29-4d4a-8618-558cc72ce7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:05.925897 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1dea-da29-4d4a-8618-558cc72ce7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:05.926171 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1dea-da29-4d4a-8618-558cc72ce7e9 admin admin] PATH_INFO: `/v3/users/5e963c516c894288a0604533a18e53f8` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:05.927347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc1dea-da29-4d4a-8618-558cc72ce7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e963c516c894288a0604533a18e53f8)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:05.929296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc1dea-da29-4d4a-8618-558cc72ce7e9 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:05.958533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:05.960057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:05.970399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:05.974540 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0a870-17ed-4588-a3b8-ccb088eb0e9c admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:05.979635 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544e689-3971-4181-a317-f894139284ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:05.980843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544e689-3971-4181-a317-f894139284ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:05.981131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544e689-3971-4181-a317-f894139284ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:05.981411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544e689-3971-4181-a317-f894139284ce admin admin] PATH_INFO: `/v3/projects/5bc97a51f5ed445ca26b7686ab07cd95` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:05.982569 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544e689-3971-4181-a317-f894139284ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc97a51f5ed445ca26b7686ab07cd95)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:05.984711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544e689-3971-4181-a317-f894139284ce admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:06.139813 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-f544e689-3971-4181-a317-f894139284ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc97a51f5ed445ca26b7686ab07cd95', 'request_id': 'req-f544e689-3971-4181-a317-f894139284ce'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:06.140791 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d9dc1dea-da29-4d4a-8618-558cc72ce7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e963c516c894288a0604533a18e53f8'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:06.141794 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d9dc1dea-da29-4d4a-8618-558cc72ce7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e963c516c894288a0604533a18e53f8'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:06.142706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d9dc1dea-da29-4d4a-8618-558cc72ce7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e963c516c894288a0604533a18e53f8'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:06.151464 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-f544e689-3971-4181-a317-f894139284ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc97a51f5ed445ca26b7686ab07cd95', 'request_id': 'req-f544e689-3971-4181-a317-f894139284ce'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:06.162571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-f544e689-3971-4181-a317-f894139284ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc97a51f5ed445ca26b7686ab07cd95', 'request_id': 'req-f544e689-3971-4181-a317-f894139284ce'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:06.165935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d9dc1dea-da29-4d4a-8618-558cc72ce7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e963c516c894288a0604533a18e53f8'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:06.176734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d9dc1dea-da29-4d4a-8618-558cc72ce7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e963c516c894288a0604533a18e53f8'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:06.252473 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-f544e689-3971-4181-a317-f894139284ce admin admin] The token cache is being invalidate because project 5bc97a51f5ed445ca26b7686ab07cd95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:05:06.252770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-f544e689-3971-4181-a317-f894139284ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:06.253407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-f544e689-3971-4181-a317-f894139284ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:06.254945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1270/2494] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:05:05 2022] DELETE /identity/v3/projects/5bc97a51f5ed445ca26b7686ab07cd95 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:05:06.258733 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544e689-3971-4181-a317-f894139284ce admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:06.260041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f544e689-3971-4181-a317-f894139284ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:06.327097 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1225/2495] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:05:05 2022] DELETE /identity/v3/users/5e963c516c894288a0604533a18e53f8 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:06.328553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544e689-3971-4181-a317-f894139284ce admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:06.401688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0f838-6f14-4781-b184-bcc83e964157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:06.403387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0f838-6f14-4781-b184-bcc83e964157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:06.403848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0f838-6f14-4781-b184-bcc83e964157 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:06.404369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0f838-6f14-4781-b184-bcc83e964157 admin admin] PATH_INFO: `/v3/users/e8d4baec6da54275a1389ef66f62171d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:06.406420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0f838-6f14-4781-b184-bcc83e964157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d4baec6da54275a1389ef66f62171d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:06.410315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0f838-6f14-4781-b184-bcc83e964157 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:06.597453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:06.608588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8ea0f838-6f14-4781-b184-bcc83e964157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d4baec6da54275a1389ef66f62171d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:06.617518 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8ea0f838-6f14-4781-b184-bcc83e964157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d4baec6da54275a1389ef66f62171d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:06.700322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8ea0f838-6f14-4781-b184-bcc83e964157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d4baec6da54275a1389ef66f62171d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:06.701091 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8ea0f838-6f14-4781-b184-bcc83e964157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d4baec6da54275a1389ef66f62171d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:06.714113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8ea0f838-6f14-4781-b184-bcc83e964157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d4baec6da54275a1389ef66f62171d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:06.720472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1271/2496] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:05:06 2022] DELETE /identity/v3/users/e8d4baec6da54275a1389ef66f62171d => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:05:06.840464 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc1dea-da29-4d4a-8618-558cc72ce7e9 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:06.842007 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d9dc1dea-da29-4d4a-8618-558cc72ce7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:06.855041 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc1dea-da29-4d4a-8618-558cc72ce7e9 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:06.920289 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:06.921280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:06.921280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:06.921597 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d admin admin] PATH_INFO: `/v3/projects/02e9c4ce297a43b1a96f37090ac28dc6` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:06.922548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e9c4ce297a43b1a96f37090ac28dc6)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:06.924542 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:07.055890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e9c4ce297a43b1a96f37090ac28dc6', 'request_id': 'req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:07.060747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:07.133913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e9c4ce297a43b1a96f37090ac28dc6', 'request_id': 'req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:07.141076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e9c4ce297a43b1a96f37090ac28dc6', 'request_id': 'req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:07.153003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d admin admin] The token cache is being invalidate because project 02e9c4ce297a43b1a96f37090ac28dc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:05:07.153290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:07.153957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:07.155498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1226/2497] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:05:06 2022] DELETE /identity/v3/projects/02e9c4ce297a43b1a96f37090ac28dc6 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:07.159656 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0f838-6f14-4781-b184-bcc83e964157 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:07.161269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8ea0f838-6f14-4781-b184-bcc83e964157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:07.175316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0f838-6f14-4781-b184-bcc83e964157 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:07.235962 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e317382-68b6-4adf-9a37-7c22753228e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:07.236643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e317382-68b6-4adf-9a37-7c22753228e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:07.236928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e317382-68b6-4adf-9a37-7c22753228e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:07.237283 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e317382-68b6-4adf-9a37-7c22753228e1 admin admin] PATH_INFO: `/v3/users/91cc274926114fefb8663d7eca060fc2` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:07.238439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e317382-68b6-4adf-9a37-7c22753228e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91cc274926114fefb8663d7eca060fc2)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:07.240423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e317382-68b6-4adf-9a37-7c22753228e1 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:07.256977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:07.259857 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:07.277989 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f2fe9-f59e-4df9-a329-63f0a3d6e85d admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:07.289385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e21ff4-d2ae-4595-872d-3bcd5b72bac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:07.289385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e21ff4-d2ae-4595-872d-3bcd5b72bac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:07.289385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e21ff4-d2ae-4595-872d-3bcd5b72bac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:07.289385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e21ff4-d2ae-4595-872d-3bcd5b72bac8 admin admin] PATH_INFO: `/v3/projects/f25ba3e5ef004852aba6c019f47620e9` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:07.290329 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e21ff4-d2ae-4595-872d-3bcd5b72bac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f25ba3e5ef004852aba6c019f47620e9)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:07.290329 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e21ff4-d2ae-4595-872d-3bcd5b72bac8 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:07.488070 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-65e21ff4-d2ae-4595-872d-3bcd5b72bac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f25ba3e5ef004852aba6c019f47620e9', 'request_id': 'req-65e21ff4-d2ae-4595-872d-3bcd5b72bac8'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:07.488636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4e317382-68b6-4adf-9a37-7c22753228e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91cc274926114fefb8663d7eca060fc2'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:07.497334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4e317382-68b6-4adf-9a37-7c22753228e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91cc274926114fefb8663d7eca060fc2'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:07.574412 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-65e21ff4-d2ae-4595-872d-3bcd5b72bac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f25ba3e5ef004852aba6c019f47620e9', 'request_id': 'req-65e21ff4-d2ae-4595-872d-3bcd5b72bac8'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:07.582622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-65e21ff4-d2ae-4595-872d-3bcd5b72bac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f25ba3e5ef004852aba6c019f47620e9', 'request_id': 'req-65e21ff4-d2ae-4595-872d-3bcd5b72bac8'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:07.595521 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-65e21ff4-d2ae-4595-872d-3bcd5b72bac8 admin admin] The token cache is being invalidate because project f25ba3e5ef004852aba6c019f47620e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:05:07.595806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-65e21ff4-d2ae-4595-872d-3bcd5b72bac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:07.596530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-65e21ff4-d2ae-4595-872d-3bcd5b72bac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:07.598093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1227/2498] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:05:07 2022] DELETE /identity/v3/projects/f25ba3e5ef004852aba6c019f47620e9 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:07.602956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20fe8c-1f46-4838-a34c-b946cdc7b165 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:07.603234 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20fe8c-1f46-4838-a34c-b946cdc7b165 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:07.603508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20fe8c-1f46-4838-a34c-b946cdc7b165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:07.625473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-7c20fe8c-1f46-4838-a34c-b946cdc7b165 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:07.626905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7c20fe8c-1f46-4838-a34c-b946cdc7b165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:07.631511 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4e317382-68b6-4adf-9a37-7c22753228e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91cc274926114fefb8663d7eca060fc2'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:07.632479 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4e317382-68b6-4adf-9a37-7c22753228e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91cc274926114fefb8663d7eca060fc2'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:07.651345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4e317382-68b6-4adf-9a37-7c22753228e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91cc274926114fefb8663d7eca060fc2'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:07.659330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1272/2499] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:05:07 2022] DELETE /identity/v3/users/91cc274926114fefb8663d7eca060fc2 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:05:07.696070 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1228/2500] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:05:07.704167 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde845e9-af57-486d-b419-e28d1e2919ab None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:07.704481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde845e9-af57-486d-b419-e28d1e2919ab None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:07.704763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde845e9-af57-486d-b419-e28d1e2919ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:07.725787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-fde845e9-af57-486d-b419-e28d1e2919ab None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:07.727008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-fde845e9-af57-486d-b419-e28d1e2919ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:07.761443 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:07.798509 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1273/2501] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:07.802918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20fe8c-1f46-4838-a34c-b946cdc7b165 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:07.814112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20fe8c-1f46-4838-a34c-b946cdc7b165 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:07.820384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cee9e-77b6-4109-9e8b-be69c57936a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:07.820384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cee9e-77b6-4109-9e8b-be69c57936a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:07.820384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cee9e-77b6-4109-9e8b-be69c57936a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:07.820384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cee9e-77b6-4109-9e8b-be69c57936a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:07.820764 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cee9e-77b6-4109-9e8b-be69c57936a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:05:07.820934 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cee9e-77b6-4109-9e8b-be69c57936a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:07.822576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cee9e-77b6-4109-9e8b-be69c57936a5 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:07.835239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1229/2502] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:05:07.841157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde845e9-af57-486d-b419-e28d1e2919ab None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:07.852457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde845e9-af57-486d-b419-e28d1e2919ab None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:07.857549 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cc346-e7c1-442b-8f0e-658f8dc1c7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:07.858196 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cc346-e7c1-442b-8f0e-658f8dc1c7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:07.858478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cc346-e7c1-442b-8f0e-658f8dc1c7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:07.858755 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cc346-e7c1-442b-8f0e-658f8dc1c7e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:07.859409 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cc346-e7c1-442b-8f0e-658f8dc1c7e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:07.861388 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cc346-e7c1-442b-8f0e-658f8dc1c7e5 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:07.979184 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1274/2503] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:05:07 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:05:07.980357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cee9e-77b6-4109-9e8b-be69c57936a5 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:07.990528 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cee9e-77b6-4109-9e8b-be69c57936a5 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:08.039439 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:08.048545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651504f5-a695-4003-bc39-c7db0428a6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:08.049055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651504f5-a695-4003-bc39-c7db0428a6db admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.049334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651504f5-a695-4003-bc39-c7db0428a6db admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.049610 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651504f5-a695-4003-bc39-c7db0428a6db admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.050231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651504f5-a695-4003-bc39-c7db0428a6db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:08.052323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651504f5-a695-4003-bc39-c7db0428a6db admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:08.097161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cc346-e7c1-442b-8f0e-658f8dc1c7e5 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:08.098907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ad1cc346-e7c1-442b-8f0e-658f8dc1c7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:08.116777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cc346-e7c1-442b-8f0e-658f8dc1c7e5 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:08.125545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93d243-6753-4330-a290-88a56abad395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:08.126344 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93d243-6753-4330-a290-88a56abad395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.126627 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93d243-6753-4330-a290-88a56abad395 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.127119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93d243-6753-4330-a290-88a56abad395 admin admin] PATH_INFO: `/v3/projects/85ada4156bcf4dc08819aae696bb38d2` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.128378 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93d243-6753-4330-a290-88a56abad395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ada4156bcf4dc08819aae696bb38d2)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:08.131348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93d243-6753-4330-a290-88a56abad395 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:08.163496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1230/2504] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:05:07 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:05:08.166976 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651504f5-a695-4003-bc39-c7db0428a6db admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:08.177766 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651504f5-a695-4003-bc39-c7db0428a6db admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:08.183038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7964f95-e937-4e5d-9077-f355de865fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:08.184515 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7964f95-e937-4e5d-9077-f355de865fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.185207 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7964f95-e937-4e5d-9077-f355de865fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.185555 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7964f95-e937-4e5d-9077-f355de865fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.186309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7964f95-e937-4e5d-9077-f355de865fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:08.187869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7964f95-e937-4e5d-9077-f355de865fa2 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:08.201394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1231/2505] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:05:08.204636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7964f95-e937-4e5d-9077-f355de865fa2 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:08.214336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7964f95-e937-4e5d-9077-f355de865fa2 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:08.219226 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623dd28-835d-4d7c-9a58-1bd82b09c784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:08.219824 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623dd28-835d-4d7c-9a58-1bd82b09c784 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.220106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623dd28-835d-4d7c-9a58-1bd82b09c784 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.220412 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623dd28-835d-4d7c-9a58-1bd82b09c784 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.221177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623dd28-835d-4d7c-9a58-1bd82b09c784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:08.222661 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623dd28-835d-4d7c-9a58-1bd82b09c784 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:08.233575 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1232/2506] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:05:08.237483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623dd28-835d-4d7c-9a58-1bd82b09c784 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:08.238053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1c93d243-6753-4330-a290-88a56abad395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ada4156bcf4dc08819aae696bb38d2', 'request_id': 'req-1c93d243-6753-4330-a290-88a56abad395'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:08.244963 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1c93d243-6753-4330-a290-88a56abad395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ada4156bcf4dc08819aae696bb38d2', 'request_id': 'req-1c93d243-6753-4330-a290-88a56abad395'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:08.248343 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623dd28-835d-4d7c-9a58-1bd82b09c784 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:08.251517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1c93d243-6753-4330-a290-88a56abad395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ada4156bcf4dc08819aae696bb38d2', 'request_id': 'req-1c93d243-6753-4330-a290-88a56abad395'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:08.304452 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054063d-40cf-4479-83ec-f9df24fbf431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:08.305119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054063d-40cf-4479-83ec-f9df24fbf431 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.305398 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054063d-40cf-4479-83ec-f9df24fbf431 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.305673 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054063d-40cf-4479-83ec-f9df24fbf431 admin admin] PATH_INFO: `/v3/projects/375c9869b707443484bc168d4e66f0a1/users/43842a1672414a4384400de8f3869757/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.321742 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054063d-40cf-4479-83ec-f9df24fbf431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=375c9869b707443484bc168d4e66f0a1, user_id=43842a1672414a4384400de8f3869757, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:08.324556 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054063d-40cf-4479-83ec-f9df24fbf431 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:08.332459 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1c93d243-6753-4330-a290-88a56abad395 admin admin] The token cache is being invalidate because project 85ada4156bcf4dc08819aae696bb38d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:05:08.332926 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1c93d243-6753-4330-a290-88a56abad395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:08.333599 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1c93d243-6753-4330-a290-88a56abad395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:08.335122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1275/2507] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:05:08 2022] DELETE /identity/v3/projects/85ada4156bcf4dc08819aae696bb38d2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:05:08.340324 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0994f-1062-4e4c-bde9-773d7e1adeee None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.340879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0994f-1062-4e4c-bde9-773d7e1adeee None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.340879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0994f-1062-4e4c-bde9-773d7e1adeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.362011 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-59c0994f-1062-4e4c-bde9-773d7e1adeee None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:08.363279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-59c0994f-1062-4e4c-bde9-773d7e1adeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:08.373402 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1276/2508] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:05:08.382326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda07ab3-244e-46ac-8802-f76e805c24dc None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.382613 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda07ab3-244e-46ac-8802-f76e805c24dc None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.382886 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda07ab3-244e-46ac-8802-f76e805c24dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.403549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1233/2509] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:05:08 2022] PUT /identity/v3/projects/375c9869b707443484bc168d4e66f0a1/users/43842a1672414a4384400de8f3869757/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:05:08.404633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-fda07ab3-244e-46ac-8802-f76e805c24dc None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:08.405868 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-fda07ab3-244e-46ac-8802-f76e805c24dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:08.416143 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436821ce-2c9a-4848-8b51-ce1075265f52 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.428253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436821ce-2c9a-4848-8b51-ce1075265f52 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.428253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436821ce-2c9a-4848-8b51-ce1075265f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.450057 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-436821ce-2c9a-4848-8b51-ce1075265f52 None None] MFA Rules not processed for user `43842a1672414a4384400de8f3869757`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:08.451762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-436821ce-2c9a-4848-8b51-ce1075265f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:08.476035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1277/2510] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:05:08.480861 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda07ab3-244e-46ac-8802-f76e805c24dc None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:08.489532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda07ab3-244e-46ac-8802-f76e805c24dc None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:08.494365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8deebc-05bf-4903-9653-c33cbd9ead41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:08.495028 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8deebc-05bf-4903-9653-c33cbd9ead41 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.495317 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8deebc-05bf-4903-9653-c33cbd9ead41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.495590 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8deebc-05bf-4903-9653-c33cbd9ead41 admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.497131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8deebc-05bf-4903-9653-c33cbd9ead41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:05:08.497761 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8deebc-05bf-4903-9653-c33cbd9ead41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:08.498971 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8deebc-05bf-4903-9653-c33cbd9ead41 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:08.511668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1278/2511] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:05:08.517192 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8deebc-05bf-4903-9653-c33cbd9ead41 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:08.525444 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1234/2512] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:08.526357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436821ce-2c9a-4848-8b51-ce1075265f52 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:08.527517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8deebc-05bf-4903-9653-c33cbd9ead41 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:08.527676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-436821ce-2c9a-4848-8b51-ce1075265f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:08.532496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4d707-91d7-47ca-85c6-b010397fafec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:08.533136 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4d707-91d7-47ca-85c6-b010397fafec admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.533422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4d707-91d7-47ca-85c6-b010397fafec admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.533702 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4d707-91d7-47ca-85c6-b010397fafec admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.534356 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4d707-91d7-47ca-85c6-b010397fafec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:08.536341 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4d707-91d7-47ca-85c6-b010397fafec admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:08.541747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436821ce-2c9a-4848-8b51-ce1075265f52 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:08.547140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542afb7b-6e6e-4dde-a8c0-19f60b0fa704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:08.547771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542afb7b-6e6e-4dde-a8c0-19f60b0fa704 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.548049 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542afb7b-6e6e-4dde-a8c0-19f60b0fa704 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.548354 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542afb7b-6e6e-4dde-a8c0-19f60b0fa704 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.548998 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542afb7b-6e6e-4dde-a8c0-19f60b0fa704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:08.550958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542afb7b-6e6e-4dde-a8c0-19f60b0fa704 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:08.554289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:08.622842 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1279/2513] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:05:08 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:05:08.627452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4d707-91d7-47ca-85c6-b010397fafec admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:08.651220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1235/2514] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:05:08 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:05:08.661831 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542afb7b-6e6e-4dde-a8c0-19f60b0fa704 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:08.680730 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:08.710750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4d707-91d7-47ca-85c6-b010397fafec admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:08.741071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542afb7b-6e6e-4dde-a8c0-19f60b0fa704 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:08.750263 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e928d8-0379-4c03-8b39-85da6b1b9e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:08.751107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e928d8-0379-4c03-8b39-85da6b1b9e95 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.751515 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e928d8-0379-4c03-8b39-85da6b1b9e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.751899 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e928d8-0379-4c03-8b39-85da6b1b9e95 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.753581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e928d8-0379-4c03-8b39-85da6b1b9e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:08.757056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e928d8-0379-4c03-8b39-85da6b1b9e95 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:08.775497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de91f59-62fc-40fa-8dc6-a17b45d1403c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:08.776118 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de91f59-62fc-40fa-8dc6-a17b45d1403c admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.776454 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de91f59-62fc-40fa-8dc6-a17b45d1403c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.776732 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de91f59-62fc-40fa-8dc6-a17b45d1403c admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.777377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de91f59-62fc-40fa-8dc6-a17b45d1403c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:08.780344 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de91f59-62fc-40fa-8dc6-a17b45d1403c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:08.869257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1280/2515] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:05:08 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:05:08.869490 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1236/2516] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:05:08 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:05:08.870692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de91f59-62fc-40fa-8dc6-a17b45d1403c admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:08.871631 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e928d8-0379-4c03-8b39-85da6b1b9e95 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:08.882187 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e928d8-0379-4c03-8b39-85da6b1b9e95 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:08.882547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de91f59-62fc-40fa-8dc6-a17b45d1403c admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:08.887548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e6267-b679-4d76-9fec-561cca89b13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:08.888346 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6267-b679-4d76-9fec-561cca89b13e admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.888730 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6267-b679-4d76-9fec-561cca89b13e admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.888971 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca186a7-61f7-4094-b27c-ebf3ffcc3f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:08.889115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6267-b679-4d76-9fec-561cca89b13e admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.889584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca186a7-61f7-4094-b27c-ebf3ffcc3f36 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.889699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e6267-b679-4d76-9fec-561cca89b13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:08.889864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca186a7-61f7-4094-b27c-ebf3ffcc3f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.890137 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca186a7-61f7-4094-b27c-ebf3ffcc3f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.890793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca186a7-61f7-4094-b27c-ebf3ffcc3f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:08.891329 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e6267-b679-4d76-9fec-561cca89b13e admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:08.892444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca186a7-61f7-4094-b27c-ebf3ffcc3f36 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:08.904508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1281/2517] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:05:08.908688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca186a7-61f7-4094-b27c-ebf3ffcc3f36 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:08.909926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1237/2518] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:05:08.913815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e6267-b679-4d76-9fec-561cca89b13e admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:08.919840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca186a7-61f7-4094-b27c-ebf3ffcc3f36 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:08.925086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f7391-8721-401c-bca1-e64daf953f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:08.925705 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f7391-8721-401c-bca1-e64daf953f73 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.925982 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f7391-8721-401c-bca1-e64daf953f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.926254 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f7391-8721-401c-bca1-e64daf953f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.926901 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f7391-8721-401c-bca1-e64daf953f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:08.928664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f7391-8721-401c-bca1-e64daf953f73 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:08.933613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e6267-b679-4d76-9fec-561cca89b13e admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:08.941153 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1282/2519] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:05:08.943148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e4e52-7956-4e8c-861f-721d5afaef3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:08.943901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e4e52-7956-4e8c-861f-721d5afaef3d admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.944214 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e4e52-7956-4e8c-861f-721d5afaef3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.944498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e4e52-7956-4e8c-861f-721d5afaef3d admin admin] PATH_INFO: `/v3/projects/c97a9c0bbb144de7a36a1306536c8c19/users/d6604e2eed784df2aa337f41aac48ca1/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.945724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f7391-8721-401c-bca1-e64daf953f73 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:08.956906 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f7391-8721-401c-bca1-e64daf953f73 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:08.962080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c35d18-982c-44d4-b9f7-6d327399b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:08.962652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c35d18-982c-44d4-b9f7-6d327399b383 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:08.962935 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c35d18-982c-44d4-b9f7-6d327399b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:08.963201 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c35d18-982c-44d4-b9f7-6d327399b383 admin admin] PATH_INFO: `/v3/projects/ffc3b583ac4040038698d7112ac315d7/users/346fc5890acf419e9102b0501f3aa898/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:08.964102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e4e52-7956-4e8c-861f-721d5afaef3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97a9c0bbb144de7a36a1306536c8c19, user_id=d6604e2eed784df2aa337f41aac48ca1, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:08.968628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e4e52-7956-4e8c-861f-721d5afaef3d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:08.982293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c35d18-982c-44d4-b9f7-6d327399b383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc3b583ac4040038698d7112ac315d7, user_id=346fc5890acf419e9102b0501f3aa898, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:08.985053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c35d18-982c-44d4-b9f7-6d327399b383 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:09.041235 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1238/2520] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:05:08 2022] PUT /identity/v3/projects/c97a9c0bbb144de7a36a1306536c8c19/users/d6604e2eed784df2aa337f41aac48ca1/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:09.045313 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e4e52-7956-4e8c-861f-721d5afaef3d admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:09.065660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1283/2521] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:05:08 2022] PUT /identity/v3/projects/ffc3b583ac4040038698d7112ac315d7/users/346fc5890acf419e9102b0501f3aa898/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:05:09.077447 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb987ec6-8135-40f9-81a3-6b7081947db5 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:09.077734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb987ec6-8135-40f9-81a3-6b7081947db5 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:09.078012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb987ec6-8135-40f9-81a3-6b7081947db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:09.107629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-fb987ec6-8135-40f9-81a3-6b7081947db5 None None] MFA Rules not processed for user `346fc5890acf419e9102b0501f3aa898`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:09.108890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-fb987ec6-8135-40f9-81a3-6b7081947db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:09.111449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e4e52-7956-4e8c-861f-721d5afaef3d admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:09.143405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:09.169482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a544e75-f79c-4b00-b5ab-51f14f3dba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:09.170093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a544e75-f79c-4b00-b5ab-51f14f3dba71 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:09.170370 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a544e75-f79c-4b00-b5ab-51f14f3dba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:09.170652 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a544e75-f79c-4b00-b5ab-51f14f3dba71 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:09.171283 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a544e75-f79c-4b00-b5ab-51f14f3dba71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:09.172916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a544e75-f79c-4b00-b5ab-51f14f3dba71 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:09.175943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1284/2522] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:05:09.183559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1239/2523] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:05:09.187503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb987ec6-8135-40f9-81a3-6b7081947db5 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:09.188158 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a544e75-f79c-4b00-b5ab-51f14f3dba71 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:09.188964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-fb987ec6-8135-40f9-81a3-6b7081947db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:09.198279 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a544e75-f79c-4b00-b5ab-51f14f3dba71 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:09.203649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d3aed-1995-45cd-b80c-468f4861ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:09.204339 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3aed-1995-45cd-b80c-468f4861ac8d admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:09.204682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3aed-1995-45cd-b80c-468f4861ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:09.204954 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3aed-1995-45cd-b80c-468f4861ac8d admin admin] PATH_INFO: `/v3/projects/c97a9c0bbb144de7a36a1306536c8c19/users/d6604e2eed784df2aa337f41aac48ca1/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:09.206870 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d3aed-1995-45cd-b80c-468f4861ac8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97a9c0bbb144de7a36a1306536c8c19, user_id=d6604e2eed784df2aa337f41aac48ca1, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:09.209531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d3aed-1995-45cd-b80c-468f4861ac8d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:09.212775 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:09.220788 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1240/2524] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:05:09 2022] PUT /identity/v3/projects/c97a9c0bbb144de7a36a1306536c8c19/users/d6604e2eed784df2aa337f41aac48ca1/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:05:09.237943 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1be20-8559-4336-bbab-ab3dab6e0231 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:09.238231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1be20-8559-4336-bbab-ab3dab6e0231 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:09.238543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1be20-8559-4336-bbab-ab3dab6e0231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:09.249284 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb987ec6-8135-40f9-81a3-6b7081947db5 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:09.268055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-ada1be20-8559-4336-bbab-ab3dab6e0231 None None] MFA Rules not processed for user `d6604e2eed784df2aa337f41aac48ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:09.269331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-ada1be20-8559-4336-bbab-ab3dab6e0231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:09.299829 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a7511-375e-4b75-898d-56c4827abef2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e72cc048a0418cac062d68b8df402f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:09.300476 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7511-375e-4b75-898d-56c4827abef2 service glance] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:09.300757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7511-375e-4b75-898d-56c4827abef2 service glance] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:09.301021 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7511-375e-4b75-898d-56c4827abef2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:09.346851 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1241/2525] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:05:09.358810 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1be20-8559-4336-bbab-ab3dab6e0231 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:09.360979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-ada1be20-8559-4336-bbab-ab3dab6e0231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:09.364564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a7511-375e-4b75-898d-56c4827abef2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:09.366024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a7511-375e-4b75-898d-56c4827abef2 service glance] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:09.376895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1285/2526] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:05:09.427661 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1be20-8559-4336-bbab-ab3dab6e0231 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:09.431484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52a78a-374a-44b6-89b0-8ec35df9c393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:09.432101 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52a78a-374a-44b6-89b0-8ec35df9c393 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:09.432423 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52a78a-374a-44b6-89b0-8ec35df9c393 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:09.432987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52a78a-374a-44b6-89b0-8ec35df9c393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:09.443374 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52a78a-374a-44b6-89b0-8ec35df9c393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:09.444858 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52a78a-374a-44b6-89b0-8ec35df9c393 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:09.456760 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1242/2527] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:05:10.731182 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a7511-375e-4b75-898d-56c4827abef2 service glance] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:10.778900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:10.796878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a7511-375e-4b75-898d-56c4827abef2 service glance] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:10.801598 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6074c-2d8d-4082-8814-bd3ea72393dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:10.802275 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6074c-2d8d-4082-8814-bd3ea72393dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:10.802866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6074c-2d8d-4082-8814-bd3ea72393dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:10.803150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6074c-2d8d-4082-8814-bd3ea72393dc admin admin] PATH_INFO: `/v3/users/43842a1672414a4384400de8f3869757` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:10.804633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6074c-2d8d-4082-8814-bd3ea72393dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=43842a1672414a4384400de8f3869757)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:10.806383 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6074c-2d8d-4082-8814-bd3ea72393dc admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:11.023379 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-87a6074c-2d8d-4082-8814-bd3ea72393dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43842a1672414a4384400de8f3869757'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:11.032310 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-87a6074c-2d8d-4082-8814-bd3ea72393dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43842a1672414a4384400de8f3869757'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:11.106170 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-87a6074c-2d8d-4082-8814-bd3ea72393dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43842a1672414a4384400de8f3869757'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:11.106934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-87a6074c-2d8d-4082-8814-bd3ea72393dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43842a1672414a4384400de8f3869757'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:11.120804 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-87a6074c-2d8d-4082-8814-bd3ea72393dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43842a1672414a4384400de8f3869757'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:11.127327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1286/2528] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:05:10 2022] DELETE /identity/v3/users/43842a1672414a4384400de8f3869757 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:11.132131 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3e258-f37b-4130-abd2-84280629d5e6 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:11.132685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3e258-f37b-4130-abd2-84280629d5e6 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:11.132685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3e258-f37b-4130-abd2-84280629d5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:11.160076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-3bd3e258-f37b-4130-abd2-84280629d5e6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:11.161284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-3bd3e258-f37b-4130-abd2-84280629d5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:11.226167 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1243/2529] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:11.236519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6074c-2d8d-4082-8814-bd3ea72393dc admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:11.238349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-87a6074c-2d8d-4082-8814-bd3ea72393dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:11.311181 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6074c-2d8d-4082-8814-bd3ea72393dc admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:11.315140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d4c1d-09b6-4a7e-bfad-44474a41e073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:11.315749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d4c1d-09b6-4a7e-bfad-44474a41e073 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:11.316026 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d4c1d-09b6-4a7e-bfad-44474a41e073 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:11.318603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d4c1d-09b6-4a7e-bfad-44474a41e073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:11.328102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d4c1d-09b6-4a7e-bfad-44474a41e073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:11.332254 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d4c1d-09b6-4a7e-bfad-44474a41e073 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:11.341531 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1287/2530] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:05:11.782727 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3e258-f37b-4130-abd2-84280629d5e6 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:11.784397 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-3bd3e258-f37b-4130-abd2-84280629d5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:11.799577 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3e258-f37b-4130-abd2-84280629d5e6 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:11.804572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271345a-65fe-4fca-97f6-8c992b725682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:11.805222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271345a-65fe-4fca-97f6-8c992b725682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:11.805506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271345a-65fe-4fca-97f6-8c992b725682 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:11.805778 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271345a-65fe-4fca-97f6-8c992b725682 admin admin] PATH_INFO: `/v3/projects/375c9869b707443484bc168d4e66f0a1` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:11.806941 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271345a-65fe-4fca-97f6-8c992b725682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=375c9869b707443484bc168d4e66f0a1)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:11.810384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271345a-65fe-4fca-97f6-8c992b725682 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:11.837093 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:11.943530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0271345a-65fe-4fca-97f6-8c992b725682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '375c9869b707443484bc168d4e66f0a1', 'request_id': 'req-0271345a-65fe-4fca-97f6-8c992b725682'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:12.017508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0271345a-65fe-4fca-97f6-8c992b725682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '375c9869b707443484bc168d4e66f0a1', 'request_id': 'req-0271345a-65fe-4fca-97f6-8c992b725682'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:12.024366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0271345a-65fe-4fca-97f6-8c992b725682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '375c9869b707443484bc168d4e66f0a1', 'request_id': 'req-0271345a-65fe-4fca-97f6-8c992b725682'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:12.034914 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0271345a-65fe-4fca-97f6-8c992b725682 admin admin] The token cache is being invalidate because project 375c9869b707443484bc168d4e66f0a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:05:12.035202 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0271345a-65fe-4fca-97f6-8c992b725682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:12.035921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0271345a-65fe-4fca-97f6-8c992b725682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:12.037721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1244/2531] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:05:11 2022] DELETE /identity/v3/projects/375c9869b707443484bc168d4e66f0a1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:12.041738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d4c1d-09b6-4a7e-bfad-44474a41e073 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:12.051870 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d4c1d-09b6-4a7e-bfad-44474a41e073 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:12.112059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280d88c-47ba-4aac-b058-7b72b6c1c891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:12.112730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280d88c-47ba-4aac-b058-7b72b6c1c891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:12.113027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280d88c-47ba-4aac-b058-7b72b6c1c891 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:12.113281 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280d88c-47ba-4aac-b058-7b72b6c1c891 admin admin] PATH_INFO: `/v3/users/d6604e2eed784df2aa337f41aac48ca1` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:12.114393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280d88c-47ba-4aac-b058-7b72b6c1c891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6604e2eed784df2aa337f41aac48ca1)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:12.116349 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280d88c-47ba-4aac-b058-7b72b6c1c891 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:12.121664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:12.273758 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-2280d88c-47ba-4aac-b058-7b72b6c1c891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6604e2eed784df2aa337f41aac48ca1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:12.282520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-2280d88c-47ba-4aac-b058-7b72b6c1c891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6604e2eed784df2aa337f41aac48ca1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:12.366530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-2280d88c-47ba-4aac-b058-7b72b6c1c891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6604e2eed784df2aa337f41aac48ca1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:12.367664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-2280d88c-47ba-4aac-b058-7b72b6c1c891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6604e2eed784df2aa337f41aac48ca1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:12.392488 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-2280d88c-47ba-4aac-b058-7b72b6c1c891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6604e2eed784df2aa337f41aac48ca1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:12.399271 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1288/2532] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:05:12 2022] DELETE /identity/v3/users/d6604e2eed784df2aa337f41aac48ca1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:12.879130 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271345a-65fe-4fca-97f6-8c992b725682 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:12.879772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0271345a-65fe-4fca-97f6-8c992b725682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:12.896297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271345a-65fe-4fca-97f6-8c992b725682 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:12.958517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6973fa0-d0ab-4481-be7b-9acfcef58784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:12.959195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6973fa0-d0ab-4481-be7b-9acfcef58784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:12.959430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6973fa0-d0ab-4481-be7b-9acfcef58784 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:12.959703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6973fa0-d0ab-4481-be7b-9acfcef58784 admin admin] PATH_INFO: `/v3/projects/c97a9c0bbb144de7a36a1306536c8c19` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:12.960830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6973fa0-d0ab-4481-be7b-9acfcef58784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c97a9c0bbb144de7a36a1306536c8c19)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:12.962718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6973fa0-d0ab-4481-be7b-9acfcef58784 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:13.084123 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d6973fa0-d0ab-4481-be7b-9acfcef58784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c97a9c0bbb144de7a36a1306536c8c19', 'request_id': 'req-d6973fa0-d0ab-4481-be7b-9acfcef58784'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:13.157127 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d6973fa0-d0ab-4481-be7b-9acfcef58784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c97a9c0bbb144de7a36a1306536c8c19', 'request_id': 'req-d6973fa0-d0ab-4481-be7b-9acfcef58784'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:13.164637 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d6973fa0-d0ab-4481-be7b-9acfcef58784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c97a9c0bbb144de7a36a1306536c8c19', 'request_id': 'req-d6973fa0-d0ab-4481-be7b-9acfcef58784'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:13.175575 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d6973fa0-d0ab-4481-be7b-9acfcef58784 admin admin] The token cache is being invalidate because project c97a9c0bbb144de7a36a1306536c8c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:05:13.175916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d6973fa0-d0ab-4481-be7b-9acfcef58784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:13.176609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d6973fa0-d0ab-4481-be7b-9acfcef58784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:13.178126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1245/2533] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:05:12 2022] DELETE /identity/v3/projects/c97a9c0bbb144de7a36a1306536c8c19 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:13.183537 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90583738-e6f3-4f5b-be73-950141146071 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:13.184010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90583738-e6f3-4f5b-be73-950141146071 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:13.186066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90583738-e6f3-4f5b-be73-950141146071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:13.204658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-90583738-e6f3-4f5b-be73-950141146071 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:13.206007 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-90583738-e6f3-4f5b-be73-950141146071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:13.268124 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1289/2534] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:13.277992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c0fd7-caad-4a39-b2eb-1ebee2268667 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:13.278285 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c0fd7-caad-4a39-b2eb-1ebee2268667 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:13.279270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c0fd7-caad-4a39-b2eb-1ebee2268667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:13.299900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-992c0fd7-caad-4a39-b2eb-1ebee2268667 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:13.301150 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-992c0fd7-caad-4a39-b2eb-1ebee2268667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:13.309406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1246/2535] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:13.314033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90583738-e6f3-4f5b-be73-950141146071 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:13.324210 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90583738-e6f3-4f5b-be73-950141146071 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:13.330465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa380ce-6a23-4720-8f6e-9c887a4fbfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:13.331105 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa380ce-6a23-4720-8f6e-9c887a4fbfcb admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:13.331395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa380ce-6a23-4720-8f6e-9c887a4fbfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:13.331672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa380ce-6a23-4720-8f6e-9c887a4fbfcb admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:13.332370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa380ce-6a23-4720-8f6e-9c887a4fbfcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:05:13.332676 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa380ce-6a23-4720-8f6e-9c887a4fbfcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:13.334301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa380ce-6a23-4720-8f6e-9c887a4fbfcb admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:13.347650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1290/2536] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:05:13.352003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c0fd7-caad-4a39-b2eb-1ebee2268667 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:13.362840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c0fd7-caad-4a39-b2eb-1ebee2268667 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:13.367910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23393353-9174-45d5-a61b-2061f537d74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:13.368748 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23393353-9174-45d5-a61b-2061f537d74a admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:13.369028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23393353-9174-45d5-a61b-2061f537d74a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:13.369297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23393353-9174-45d5-a61b-2061f537d74a admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:13.369985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23393353-9174-45d5-a61b-2061f537d74a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:13.371878 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23393353-9174-45d5-a61b-2061f537d74a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:13.477285 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1247/2537] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:05:13 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:05:13.481529 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa380ce-6a23-4720-8f6e-9c887a4fbfcb admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:13.492397 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa380ce-6a23-4720-8f6e-9c887a4fbfcb admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:13.554496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913432da-ac28-4654-8c6b-14c9b616a2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:13.555135 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913432da-ac28-4654-8c6b-14c9b616a2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:13.555411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913432da-ac28-4654-8c6b-14c9b616a2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:13.555731 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913432da-ac28-4654-8c6b-14c9b616a2c0 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:13.556458 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913432da-ac28-4654-8c6b-14c9b616a2c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:13.558757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913432da-ac28-4654-8c6b-14c9b616a2c0 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:13.658612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1291/2538] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:05:13 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:05:13.663169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23393353-9174-45d5-a61b-2061f537d74a admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:13.673871 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23393353-9174-45d5-a61b-2061f537d74a admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:13.679356 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f06b2b-6318-45a5-8c33-b5d4858562ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:13.680020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f06b2b-6318-45a5-8c33-b5d4858562ec admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:13.680343 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f06b2b-6318-45a5-8c33-b5d4858562ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:13.680621 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f06b2b-6318-45a5-8c33-b5d4858562ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:13.681277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f06b2b-6318-45a5-8c33-b5d4858562ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:13.683180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f06b2b-6318-45a5-8c33-b5d4858562ec admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:13.686347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:13.694945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1248/2539] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:05:13.704044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913432da-ac28-4654-8c6b-14c9b616a2c0 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:13.709334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:13.714992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913432da-ac28-4654-8c6b-14c9b616a2c0 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:13.720772 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589351c5-4534-4b0f-bbec-0f8230d63758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:13.721529 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589351c5-4534-4b0f-bbec-0f8230d63758 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:13.721839 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589351c5-4534-4b0f-bbec-0f8230d63758 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:13.722117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589351c5-4534-4b0f-bbec-0f8230d63758 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:13.722778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589351c5-4534-4b0f-bbec-0f8230d63758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:13.724453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589351c5-4534-4b0f-bbec-0f8230d63758 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:13.735846 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1292/2540] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:05:13.740322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f06b2b-6318-45a5-8c33-b5d4858562ec admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:13.751547 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f06b2b-6318-45a5-8c33-b5d4858562ec admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:13.756520 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3801684-9c50-453d-97b9-c58c30463e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:13.757194 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3801684-9c50-453d-97b9-c58c30463e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:13.757477 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3801684-9c50-453d-97b9-c58c30463e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:13.757751 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3801684-9c50-453d-97b9-c58c30463e59 admin admin] PATH_INFO: `/v3/projects/b5c1aba24f2b47eb8c45e3f3b4943e78/users/beae40feba744618b4c5fb6fb4113811/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:13.775459 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3801684-9c50-453d-97b9-c58c30463e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c1aba24f2b47eb8c45e3f3b4943e78, user_id=beae40feba744618b4c5fb6fb4113811, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:13.778157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3801684-9c50-453d-97b9-c58c30463e59 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:13.864612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1249/2541] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:05:13 2022] PUT /identity/v3/projects/b5c1aba24f2b47eb8c45e3f3b4943e78/users/beae40feba744618b4c5fb6fb4113811/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:13.878100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08902dd5-84e5-4da6-ade2-d3d87110a8d0 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:13.878984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08902dd5-84e5-4da6-ade2-d3d87110a8d0 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:13.879538 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08902dd5-84e5-4da6-ade2-d3d87110a8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:13.915819 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-08902dd5-84e5-4da6-ade2-d3d87110a8d0 None None] MFA Rules not processed for user `beae40feba744618b4c5fb6fb4113811`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:13.917115 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-08902dd5-84e5-4da6-ade2-d3d87110a8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:14.000095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1293/2542] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:14.004736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3801684-9c50-453d-97b9-c58c30463e59 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:14.070689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3801684-9c50-453d-97b9-c58c30463e59 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:14.076602 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e30170-8b5f-4bfb-8490-c654e02282bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:14.077230 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e30170-8b5f-4bfb-8490-c654e02282bb admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:14.077518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e30170-8b5f-4bfb-8490-c654e02282bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:14.077787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e30170-8b5f-4bfb-8490-c654e02282bb admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:14.078426 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e30170-8b5f-4bfb-8490-c654e02282bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:14.080367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e30170-8b5f-4bfb-8490-c654e02282bb admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:14.176124 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1250/2543] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:05:14 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:05:14.184303 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08902dd5-84e5-4da6-ade2-d3d87110a8d0 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:14.197186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08902dd5-84e5-4da6-ade2-d3d87110a8d0 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:14.259519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b139b-ff27-4476-82cc-07e2cde623e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:14.260136 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b139b-ff27-4476-82cc-07e2cde623e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:14.260442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b139b-ff27-4476-82cc-07e2cde623e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:14.260714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b139b-ff27-4476-82cc-07e2cde623e1 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:14.261360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b139b-ff27-4476-82cc-07e2cde623e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:14.263996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b139b-ff27-4476-82cc-07e2cde623e1 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:14.343837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1294/2544] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:05:14 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:05:14.347857 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e30170-8b5f-4bfb-8490-c654e02282bb admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:14.360052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e30170-8b5f-4bfb-8490-c654e02282bb admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:14.365051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b09fa-8152-4f70-a50a-17957ad006d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:14.365663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b09fa-8152-4f70-a50a-17957ad006d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:14.365945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b09fa-8152-4f70-a50a-17957ad006d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:14.366220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b09fa-8152-4f70-a50a-17957ad006d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:14.366909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b09fa-8152-4f70-a50a-17957ad006d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:14.368560 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b09fa-8152-4f70-a50a-17957ad006d0 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:14.381429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1251/2545] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:05:14.385911 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b139b-ff27-4476-82cc-07e2cde623e1 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:14.398937 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b139b-ff27-4476-82cc-07e2cde623e1 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:14.403926 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43591c3-71f7-4f2b-a6d5-79be74592098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:14.404645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43591c3-71f7-4f2b-a6d5-79be74592098 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:14.408443 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43591c3-71f7-4f2b-a6d5-79be74592098 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:14.408443 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43591c3-71f7-4f2b-a6d5-79be74592098 admin admin] PATH_INFO: `/v3/projects/01db1618bfc54c69a1ccff9a1313ccb6/users/02215228bd9e42da9c11e9e1791e20ba/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:14.421121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43591c3-71f7-4f2b-a6d5-79be74592098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01db1618bfc54c69a1ccff9a1313ccb6, user_id=02215228bd9e42da9c11e9e1791e20ba, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:14.424038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43591c3-71f7-4f2b-a6d5-79be74592098 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:14.515879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1295/2546] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:05:14 2022] PUT /identity/v3/projects/01db1618bfc54c69a1ccff9a1313ccb6/users/02215228bd9e42da9c11e9e1791e20ba/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:14.519811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b09fa-8152-4f70-a50a-17957ad006d0 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:14.530166 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b09fa-8152-4f70-a50a-17957ad006d0 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:14.588686 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544abc2-c799-4144-9f4e-63a9616a5d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:14.589339 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544abc2-c799-4144-9f4e-63a9616a5d6b admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:14.589624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544abc2-c799-4144-9f4e-63a9616a5d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:14.589899 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544abc2-c799-4144-9f4e-63a9616a5d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:14.590553 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544abc2-c799-4144-9f4e-63a9616a5d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:14.592296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544abc2-c799-4144-9f4e-63a9616a5d6b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:14.602945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1252/2547] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:05:14.611753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43591c3-71f7-4f2b-a6d5-79be74592098 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:14.624581 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43591c3-71f7-4f2b-a6d5-79be74592098 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:14.629578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ff5f8-0b9a-4282-a32f-ccba3f09ceb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:14.630257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ff5f8-0b9a-4282-a32f-ccba3f09ceb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:14.630536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ff5f8-0b9a-4282-a32f-ccba3f09ceb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:14.630810 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ff5f8-0b9a-4282-a32f-ccba3f09ceb3 admin admin] PATH_INFO: `/v3/projects/01db1618bfc54c69a1ccff9a1313ccb6/users/02215228bd9e42da9c11e9e1791e20ba/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:14.632773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ff5f8-0b9a-4282-a32f-ccba3f09ceb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01db1618bfc54c69a1ccff9a1313ccb6, user_id=02215228bd9e42da9c11e9e1791e20ba, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:14.635431 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ff5f8-0b9a-4282-a32f-ccba3f09ceb3 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:14.647106 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1296/2548] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:05:14 2022] PUT /identity/v3/projects/01db1618bfc54c69a1ccff9a1313ccb6/users/02215228bd9e42da9c11e9e1791e20ba/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:14.658237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ffa9b-4383-4e14-931e-3e71fb0aa43f None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:14.658518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ffa9b-4383-4e14-931e-3e71fb0aa43f None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:14.658798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ffa9b-4383-4e14-931e-3e71fb0aa43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:14.691162 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-285ffa9b-4383-4e14-931e-3e71fb0aa43f None None] MFA Rules not processed for user `02215228bd9e42da9c11e9e1791e20ba`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:14.692522 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-285ffa9b-4383-4e14-931e-3e71fb0aa43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:14.726856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:14.765460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1253/2549] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:05:14.777008 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ff5f8-0b9a-4282-a32f-ccba3f09ceb3 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:14.778771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b47ff5f8-0b9a-4282-a32f-ccba3f09ceb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:14.815453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:14.842056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ff5f8-0b9a-4282-a32f-ccba3f09ceb3 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:14.846082 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099740a-ce1c-40ba-bbf0-c076e541bb3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:14.846949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099740a-ce1c-40ba-bbf0-c076e541bb3c service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:14.847339 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099740a-ce1c-40ba-bbf0-c076e541bb3c service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:14.847520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099740a-ce1c-40ba-bbf0-c076e541bb3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:14.923951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099740a-ce1c-40ba-bbf0-c076e541bb3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:14.923951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099740a-ce1c-40ba-bbf0-c076e541bb3c service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:14.932056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1297/2550] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:05:20.390336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ffa9b-4383-4e14-931e-3e71fb0aa43f None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:20.400524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ffa9b-4383-4e14-931e-3e71fb0aa43f None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:20.404051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354bedc-3742-425b-b404-e9e2e37ab9ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:20.404696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354bedc-3742-425b-b404-e9e2e37ab9ad service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:20.405626 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354bedc-3742-425b-b404-e9e2e37ab9ad service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:20.405907 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354bedc-3742-425b-b404-e9e2e37ab9ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:20.417832 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354bedc-3742-425b-b404-e9e2e37ab9ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:20.419284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354bedc-3742-425b-b404-e9e2e37ab9ad service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:20.430171 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1254/2551] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:05:25.025218 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=33 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:26.303624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099740a-ce1c-40ba-bbf0-c076e541bb3c service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:26.373468 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099740a-ce1c-40ba-bbf0-c076e541bb3c service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:26.379746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5fb8d-eebc-4d32-8b23-c0d71ce14b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:26.380430 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5fb8d-eebc-4d32-8b23-c0d71ce14b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:26.380711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5fb8d-eebc-4d32-8b23-c0d71ce14b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:26.380987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5fb8d-eebc-4d32-8b23-c0d71ce14b34 admin admin] PATH_INFO: `/v3/users/beae40feba744618b4c5fb6fb4113811` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:26.382307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5fb8d-eebc-4d32-8b23-c0d71ce14b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beae40feba744618b4c5fb6fb4113811)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:26.384255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5fb8d-eebc-4d32-8b23-c0d71ce14b34 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:26.593497 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b6e5fb8d-eebc-4d32-8b23-c0d71ce14b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beae40feba744618b4c5fb6fb4113811'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:26.601293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b6e5fb8d-eebc-4d32-8b23-c0d71ce14b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beae40feba744618b4c5fb6fb4113811'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:26.697616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b6e5fb8d-eebc-4d32-8b23-c0d71ce14b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beae40feba744618b4c5fb6fb4113811'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:26.698178 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b6e5fb8d-eebc-4d32-8b23-c0d71ce14b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beae40feba744618b4c5fb6fb4113811'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:26.711925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b6e5fb8d-eebc-4d32-8b23-c0d71ce14b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beae40feba744618b4c5fb6fb4113811'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:26.717919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1298/2552] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:05:26 2022] DELETE /identity/v3/users/beae40feba744618b4c5fb6fb4113811 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:26.722551 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830da9-14eb-40ad-9632-530b030faf8c None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:26.723064 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830da9-14eb-40ad-9632-530b030faf8c None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:26.723199 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830da9-14eb-40ad-9632-530b030faf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:26.742858 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-2b830da9-14eb-40ad-9632-530b030faf8c None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:26.744107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2b830da9-14eb-40ad-9632-530b030faf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:26.805834 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1255/2553] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:26.816686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5fb8d-eebc-4d32-8b23-c0d71ce14b34 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:26.818099 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b6e5fb8d-eebc-4d32-8b23-c0d71ce14b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:26.876125 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5fb8d-eebc-4d32-8b23-c0d71ce14b34 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:26.879979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4040bdc-6454-456e-94f9-61bda79868ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:26.880625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4040bdc-6454-456e-94f9-61bda79868ce service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:26.880908 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4040bdc-6454-456e-94f9-61bda79868ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:26.881182 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4040bdc-6454-456e-94f9-61bda79868ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:26.890480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4040bdc-6454-456e-94f9-61bda79868ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:26.892003 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4040bdc-6454-456e-94f9-61bda79868ce service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:26.901643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1299/2554] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:05:27.372044 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b830da9-14eb-40ad-9632-530b030faf8c None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:27.373645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2b830da9-14eb-40ad-9632-530b030faf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:27.390820 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b830da9-14eb-40ad-9632-530b030faf8c None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:27.397766 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdf00b-3910-4259-8103-3a582f6fc2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:27.398437 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdf00b-3910-4259-8103-3a582f6fc2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:27.398732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdf00b-3910-4259-8103-3a582f6fc2df admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:27.399142 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdf00b-3910-4259-8103-3a582f6fc2df admin admin] PATH_INFO: `/v3/projects/b5c1aba24f2b47eb8c45e3f3b4943e78` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:27.400364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdf00b-3910-4259-8103-3a582f6fc2df admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5c1aba24f2b47eb8c45e3f3b4943e78)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:27.402345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdf00b-3910-4259-8103-3a582f6fc2df admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:27.534971 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2ffdf00b-3910-4259-8103-3a582f6fc2df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5c1aba24f2b47eb8c45e3f3b4943e78', 'request_id': 'req-2ffdf00b-3910-4259-8103-3a582f6fc2df'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:27.613011 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2ffdf00b-3910-4259-8103-3a582f6fc2df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5c1aba24f2b47eb8c45e3f3b4943e78', 'request_id': 'req-2ffdf00b-3910-4259-8103-3a582f6fc2df'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:27.620047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2ffdf00b-3910-4259-8103-3a582f6fc2df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5c1aba24f2b47eb8c45e3f3b4943e78', 'request_id': 'req-2ffdf00b-3910-4259-8103-3a582f6fc2df'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:27.632718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2ffdf00b-3910-4259-8103-3a582f6fc2df admin admin] The token cache is being invalidate because project b5c1aba24f2b47eb8c45e3f3b4943e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:05:27.633143 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2ffdf00b-3910-4259-8103-3a582f6fc2df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:27.633905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-2ffdf00b-3910-4259-8103-3a582f6fc2df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:27.635529 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1256/2555] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:05:27 2022] DELETE /identity/v3/projects/b5c1aba24f2b47eb8c45e3f3b4943e78 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:27.639754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4040bdc-6454-456e-94f9-61bda79868ce service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:27.650356 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4040bdc-6454-456e-94f9-61bda79868ce service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:27.669851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:27.712418 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecc998-4315-477a-bafa-af6f7526acfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:27.713150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecc998-4315-477a-bafa-af6f7526acfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:27.713432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecc998-4315-477a-bafa-af6f7526acfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:27.713708 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecc998-4315-477a-bafa-af6f7526acfc admin admin] PATH_INFO: `/v3/users/02215228bd9e42da9c11e9e1791e20ba` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:27.714869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecc998-4315-477a-bafa-af6f7526acfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=02215228bd9e42da9c11e9e1791e20ba)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:27.716987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecc998-4315-477a-bafa-af6f7526acfc admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:27.949027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d6ecc998-4315-477a-bafa-af6f7526acfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02215228bd9e42da9c11e9e1791e20ba'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:27.956051 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d6ecc998-4315-477a-bafa-af6f7526acfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02215228bd9e42da9c11e9e1791e20ba'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:28.042548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d6ecc998-4315-477a-bafa-af6f7526acfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02215228bd9e42da9c11e9e1791e20ba'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:28.043176 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d6ecc998-4315-477a-bafa-af6f7526acfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02215228bd9e42da9c11e9e1791e20ba'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:28.056260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d6ecc998-4315-477a-bafa-af6f7526acfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02215228bd9e42da9c11e9e1791e20ba'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:28.062426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1300/2556] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:05:27 2022] DELETE /identity/v3/users/02215228bd9e42da9c11e9e1791e20ba => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:05:28.517852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdf00b-3910-4259-8103-3a582f6fc2df admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:28.519456 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2ffdf00b-3910-4259-8103-3a582f6fc2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:28.543557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdf00b-3910-4259-8103-3a582f6fc2df admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:28.601025 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:28.621566 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb79b0-d37c-41d6-bec8-f2a50de05c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:28.632638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb79b0-d37c-41d6-bec8-f2a50de05c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:28.632638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb79b0-d37c-41d6-bec8-f2a50de05c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:28.632638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb79b0-d37c-41d6-bec8-f2a50de05c1b admin admin] PATH_INFO: `/v3/projects/01db1618bfc54c69a1ccff9a1313ccb6` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:28.632638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb79b0-d37c-41d6-bec8-f2a50de05c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=01db1618bfc54c69a1ccff9a1313ccb6)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:28.632638 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb79b0-d37c-41d6-bec8-f2a50de05c1b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:28.749632 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b4fb79b0-d37c-41d6-bec8-f2a50de05c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01db1618bfc54c69a1ccff9a1313ccb6', 'request_id': 'req-b4fb79b0-d37c-41d6-bec8-f2a50de05c1b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:28.818400 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b4fb79b0-d37c-41d6-bec8-f2a50de05c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01db1618bfc54c69a1ccff9a1313ccb6', 'request_id': 'req-b4fb79b0-d37c-41d6-bec8-f2a50de05c1b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:28.825453 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b4fb79b0-d37c-41d6-bec8-f2a50de05c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01db1618bfc54c69a1ccff9a1313ccb6', 'request_id': 'req-b4fb79b0-d37c-41d6-bec8-f2a50de05c1b'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:28.836865 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b4fb79b0-d37c-41d6-bec8-f2a50de05c1b admin admin] The token cache is being invalidate because project 01db1618bfc54c69a1ccff9a1313ccb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:05:28.837157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b4fb79b0-d37c-41d6-bec8-f2a50de05c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:28.837819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b4fb79b0-d37c-41d6-bec8-f2a50de05c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:28.839357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1257/2557] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:05:28 2022] DELETE /identity/v3/projects/01db1618bfc54c69a1ccff9a1313ccb6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:28.848727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a8c83-2555-4d10-9911-531d4ee0d11a None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:28.849279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a8c83-2555-4d10-9911-531d4ee0d11a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:28.849279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a8c83-2555-4d10-9911-531d4ee0d11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:28.871996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-3c9a8c83-2555-4d10-9911-531d4ee0d11a None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:28.873678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-3c9a8c83-2555-4d10-9911-531d4ee0d11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:28.938282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1301/2558] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:28.949422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf5c39-f4be-4a90-bede-337116e7c85f None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:28.949863 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf5c39-f4be-4a90-bede-337116e7c85f None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:28.950592 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf5c39-f4be-4a90-bede-337116e7c85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:28.971641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-0daf5c39-f4be-4a90-bede-337116e7c85f None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:28.972891 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0daf5c39-f4be-4a90-bede-337116e7c85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:28.981118 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1258/2559] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:28.986319 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a8c83-2555-4d10-9911-531d4ee0d11a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:28.995942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a8c83-2555-4d10-9911-531d4ee0d11a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:29.000749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe5a4a-e212-4eae-88f3-1b792141d540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:29.002025 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe5a4a-e212-4eae-88f3-1b792141d540 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:29.002146 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe5a4a-e212-4eae-88f3-1b792141d540 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:29.002376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe5a4a-e212-4eae-88f3-1b792141d540 admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:29.003031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe5a4a-e212-4eae-88f3-1b792141d540 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:05:29.003335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe5a4a-e212-4eae-88f3-1b792141d540 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:29.004998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe5a4a-e212-4eae-88f3-1b792141d540 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:29.017448 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1302/2560] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:05:29.022243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf5c39-f4be-4a90-bede-337116e7c85f None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:29.031926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf5c39-f4be-4a90-bede-337116e7c85f None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:29.037069 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7406756-f2e7-4d4a-80c1-940dc00cd71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:29.037683 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406756-f2e7-4d4a-80c1-940dc00cd71d admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:29.037966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406756-f2e7-4d4a-80c1-940dc00cd71d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:29.038243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406756-f2e7-4d4a-80c1-940dc00cd71d admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:29.038892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7406756-f2e7-4d4a-80c1-940dc00cd71d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:29.040850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7406756-f2e7-4d4a-80c1-940dc00cd71d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:29.136173 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1259/2561] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:05:29 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:05:29.140468 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe5a4a-e212-4eae-88f3-1b792141d540 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:29.151147 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe5a4a-e212-4eae-88f3-1b792141d540 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:29.180584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:29.210710 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1016b-679a-40d6-bad5-eaa29fb241de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:29.211346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1016b-679a-40d6-bad5-eaa29fb241de admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:29.211625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1016b-679a-40d6-bad5-eaa29fb241de admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:29.211897 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1016b-679a-40d6-bad5-eaa29fb241de admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:29.212587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1016b-679a-40d6-bad5-eaa29fb241de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:29.214488 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1016b-679a-40d6-bad5-eaa29fb241de admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:29.346096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1303/2562] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:05:29 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:05:29.350237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7406756-f2e7-4d4a-80c1-940dc00cd71d admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:29.361288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7406756-f2e7-4d4a-80c1-940dc00cd71d admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:29.365809 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea0ab3-8123-4eb4-8770-e568a4cee8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:29.366408 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea0ab3-8123-4eb4-8770-e568a4cee8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:29.366687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea0ab3-8123-4eb4-8770-e568a4cee8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:29.366957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea0ab3-8123-4eb4-8770-e568a4cee8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:29.367596 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea0ab3-8123-4eb4-8770-e568a4cee8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:29.369210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea0ab3-8123-4eb4-8770-e568a4cee8e2 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:29.379981 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1260/2563] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:05:29.384078 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1016b-679a-40d6-bad5-eaa29fb241de admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:29.395687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1016b-679a-40d6-bad5-eaa29fb241de admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:29.401263 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a586cad-bdb2-4bac-aafa-c97b99b25539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:29.401811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a586cad-bdb2-4bac-aafa-c97b99b25539 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:29.402091 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a586cad-bdb2-4bac-aafa-c97b99b25539 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:29.402364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a586cad-bdb2-4bac-aafa-c97b99b25539 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:29.403009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a586cad-bdb2-4bac-aafa-c97b99b25539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:29.404749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a586cad-bdb2-4bac-aafa-c97b99b25539 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:29.416876 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1304/2564] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:05:29.422429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea0ab3-8123-4eb4-8770-e568a4cee8e2 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:29.433521 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea0ab3-8123-4eb4-8770-e568a4cee8e2 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:29.438036 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d8a04-54f3-480d-85f5-c2483fb04b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:29.438843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d8a04-54f3-480d-85f5-c2483fb04b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:29.439146 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d8a04-54f3-480d-85f5-c2483fb04b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:29.439422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d8a04-54f3-480d-85f5-c2483fb04b76 admin admin] PATH_INFO: `/v3/projects/3dae137a9e80419f8de1d1fb526bbce0/users/7b1ce8e7f17f4a768de8ee037ca797a1/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:29.453634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d8a04-54f3-480d-85f5-c2483fb04b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dae137a9e80419f8de1d1fb526bbce0, user_id=7b1ce8e7f17f4a768de8ee037ca797a1, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:29.457007 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d8a04-54f3-480d-85f5-c2483fb04b76 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:29.533780 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1261/2565] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:05:29 2022] PUT /identity/v3/projects/3dae137a9e80419f8de1d1fb526bbce0/users/7b1ce8e7f17f4a768de8ee037ca797a1/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:29.544175 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973612b0-e8b1-4bfc-96c4-6541a6e32f1f None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:29.544496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973612b0-e8b1-4bfc-96c4-6541a6e32f1f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:29.544772 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973612b0-e8b1-4bfc-96c4-6541a6e32f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:29.575130 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-973612b0-e8b1-4bfc-96c4-6541a6e32f1f None None] MFA Rules not processed for user `7b1ce8e7f17f4a768de8ee037ca797a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:29.576448 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-973612b0-e8b1-4bfc-96c4-6541a6e32f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:29.643423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1305/2566] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:29.660749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d8a04-54f3-480d-85f5-c2483fb04b76 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:29.662812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-665d8a04-54f3-480d-85f5-c2483fb04b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:29.736500 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d8a04-54f3-480d-85f5-c2483fb04b76 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:29.741013 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f27a1-ba0a-4536-aa31-625ec6c57302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:29.741945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f27a1-ba0a-4536-aa31-625ec6c57302 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:29.742331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f27a1-ba0a-4536-aa31-625ec6c57302 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:29.742714 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f27a1-ba0a-4536-aa31-625ec6c57302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:29.755126 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f27a1-ba0a-4536-aa31-625ec6c57302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:29.759359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f27a1-ba0a-4536-aa31-625ec6c57302 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:29.780339 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1262/2567] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:05:29.800687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973612b0-e8b1-4bfc-96c4-6541a6e32f1f None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:29.870377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973612b0-e8b1-4bfc-96c4-6541a6e32f1f None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:29.877311 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15343c-0470-47d2-bd84-630e1e51ddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:29.877947 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15343c-0470-47d2-bd84-630e1e51ddc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:29.878230 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15343c-0470-47d2-bd84-630e1e51ddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:29.878503 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15343c-0470-47d2-bd84-630e1e51ddc4 admin admin] PATH_INFO: `/v3/users/7b1ce8e7f17f4a768de8ee037ca797a1` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:29.879672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15343c-0470-47d2-bd84-630e1e51ddc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1ce8e7f17f4a768de8ee037ca797a1)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:29.881673 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15343c-0470-47d2-bd84-630e1e51ddc4 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:30.089759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:30.095645 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5c15343c-0470-47d2-bd84-630e1e51ddc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1ce8e7f17f4a768de8ee037ca797a1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:30.102466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5c15343c-0470-47d2-bd84-630e1e51ddc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1ce8e7f17f4a768de8ee037ca797a1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:30.195232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5c15343c-0470-47d2-bd84-630e1e51ddc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1ce8e7f17f4a768de8ee037ca797a1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:30.196034 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5c15343c-0470-47d2-bd84-630e1e51ddc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1ce8e7f17f4a768de8ee037ca797a1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:30.209829 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5c15343c-0470-47d2-bd84-630e1e51ddc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1ce8e7f17f4a768de8ee037ca797a1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:30.216154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1306/2568] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:05:29 2022] DELETE /identity/v3/users/7b1ce8e7f17f4a768de8ee037ca797a1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:30.220783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dcd90-2e17-4e52-9561-8a7d13e5e115 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:30.221094 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dcd90-2e17-4e52-9561-8a7d13e5e115 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:30.221363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dcd90-2e17-4e52-9561-8a7d13e5e115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:30.241613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-cd0dcd90-2e17-4e52-9561-8a7d13e5e115 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:30.242878 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-cd0dcd90-2e17-4e52-9561-8a7d13e5e115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:30.249554 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:30.311229 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1263/2569] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:30.320949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15343c-0470-47d2-bd84-630e1e51ddc4 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:30.323172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-5c15343c-0470-47d2-bd84-630e1e51ddc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:30.387616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15343c-0470-47d2-bd84-630e1e51ddc4 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:30.391384 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bff487-ac76-463c-8982-0eea9fe09e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:30.391987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bff487-ac76-463c-8982-0eea9fe09e10 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:30.397362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bff487-ac76-463c-8982-0eea9fe09e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:30.397362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bff487-ac76-463c-8982-0eea9fe09e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:30.402181 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bff487-ac76-463c-8982-0eea9fe09e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:30.403617 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bff487-ac76-463c-8982-0eea9fe09e10 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:30.413685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1307/2570] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:05:30.876379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dcd90-2e17-4e52-9561-8a7d13e5e115 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:30.877820 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-cd0dcd90-2e17-4e52-9561-8a7d13e5e115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:30.891471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dcd90-2e17-4e52-9561-8a7d13e5e115 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:30.896240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19debc-60d5-4d89-a3e4-e2ae847e8ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:30.896881 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19debc-60d5-4d89-a3e4-e2ae847e8ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:30.897158 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19debc-60d5-4d89-a3e4-e2ae847e8ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:30.897429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19debc-60d5-4d89-a3e4-e2ae847e8ad6 admin admin] PATH_INFO: `/v3/projects/3dae137a9e80419f8de1d1fb526bbce0` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:30.899256 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19debc-60d5-4d89-a3e4-e2ae847e8ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dae137a9e80419f8de1d1fb526bbce0)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:30.901304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19debc-60d5-4d89-a3e4-e2ae847e8ad6 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:31.013082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-de19debc-60d5-4d89-a3e4-e2ae847e8ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dae137a9e80419f8de1d1fb526bbce0', 'request_id': 'req-de19debc-60d5-4d89-a3e4-e2ae847e8ad6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:31.092288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-de19debc-60d5-4d89-a3e4-e2ae847e8ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dae137a9e80419f8de1d1fb526bbce0', 'request_id': 'req-de19debc-60d5-4d89-a3e4-e2ae847e8ad6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:31.099688 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-de19debc-60d5-4d89-a3e4-e2ae847e8ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dae137a9e80419f8de1d1fb526bbce0', 'request_id': 'req-de19debc-60d5-4d89-a3e4-e2ae847e8ad6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:31.110806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-de19debc-60d5-4d89-a3e4-e2ae847e8ad6 admin admin] The token cache is being invalidate because project 3dae137a9e80419f8de1d1fb526bbce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:05:31.111095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-de19debc-60d5-4d89-a3e4-e2ae847e8ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:31.111920 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-de19debc-60d5-4d89-a3e4-e2ae847e8ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:31.113749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1264/2571] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:05:30 2022] DELETE /identity/v3/projects/3dae137a9e80419f8de1d1fb526bbce0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:31.119823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2631b4b-e5f2-4c6a-a766-123f990d6d72 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:31.120400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2631b4b-e5f2-4c6a-a766-123f990d6d72 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:31.120400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2631b4b-e5f2-4c6a-a766-123f990d6d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:31.140314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f2631b4b-e5f2-4c6a-a766-123f990d6d72 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:31.141545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f2631b4b-e5f2-4c6a-a766-123f990d6d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:31.207064 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1308/2572] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:05:31.214915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86262769-a2b3-4310-b81a-08d9e9c2adaa None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:31.215204 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86262769-a2b3-4310-b81a-08d9e9c2adaa None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:31.215485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86262769-a2b3-4310-b81a-08d9e9c2adaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:31.237496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-86262769-a2b3-4310-b81a-08d9e9c2adaa None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:31.239005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-86262769-a2b3-4310-b81a-08d9e9c2adaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:31.247243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1265/2573] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:31.251878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2631b4b-e5f2-4c6a-a766-123f990d6d72 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:31.262719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2631b4b-e5f2-4c6a-a766-123f990d6d72 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:31.267486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84f91e-ee0c-4090-bead-312af3bdda3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:31.268080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f91e-ee0c-4090-bead-312af3bdda3f admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:31.268453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f91e-ee0c-4090-bead-312af3bdda3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:31.269681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f91e-ee0c-4090-bead-312af3bdda3f admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:31.269681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84f91e-ee0c-4090-bead-312af3bdda3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:05:31.269681 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84f91e-ee0c-4090-bead-312af3bdda3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:31.271204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84f91e-ee0c-4090-bead-312af3bdda3f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:31.284937 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1309/2574] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:05:31.292336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86262769-a2b3-4310-b81a-08d9e9c2adaa None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:31.303131 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86262769-a2b3-4310-b81a-08d9e9c2adaa None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:31.308061 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131d3bd-0dcb-4060-85cc-55f94ef24a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:31.308707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131d3bd-0dcb-4060-85cc-55f94ef24a64 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:31.308988 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131d3bd-0dcb-4060-85cc-55f94ef24a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:31.309257 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131d3bd-0dcb-4060-85cc-55f94ef24a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:31.309900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131d3bd-0dcb-4060-85cc-55f94ef24a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:31.311775 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131d3bd-0dcb-4060-85cc-55f94ef24a64 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:31.455799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1266/2575] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:05:31 2022] POST /identity/v3/projects => generated 363 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:05:31.460224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84f91e-ee0c-4090-bead-312af3bdda3f admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:31.470735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84f91e-ee0c-4090-bead-312af3bdda3f admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:31.518277 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:31.531427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbea02a-f095-4e30-ba2f-37e36c9abfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:31.532096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbea02a-f095-4e30-ba2f-37e36c9abfd8 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:31.532379 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbea02a-f095-4e30-ba2f-37e36c9abfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:31.532660 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbea02a-f095-4e30-ba2f-37e36c9abfd8 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:31.533308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbea02a-f095-4e30-ba2f-37e36c9abfd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:31.535777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbea02a-f095-4e30-ba2f-37e36c9abfd8 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:31.651766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1310/2576] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:05:31 2022] POST /identity/v3/users => generated 282 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:05:31.655857 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131d3bd-0dcb-4060-85cc-55f94ef24a64 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:31.666939 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131d3bd-0dcb-4060-85cc-55f94ef24a64 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:31.671796 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed1aea-f65f-4cc7-95cc-69a008a0fb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:31.672510 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed1aea-f65f-4cc7-95cc-69a008a0fb9f admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:31.672790 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed1aea-f65f-4cc7-95cc-69a008a0fb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:31.673064 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed1aea-f65f-4cc7-95cc-69a008a0fb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:31.673721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed1aea-f65f-4cc7-95cc-69a008a0fb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:31.675323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed1aea-f65f-4cc7-95cc-69a008a0fb9f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:31.689074 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1267/2577] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:05:31.690799 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbea02a-f095-4e30-ba2f-37e36c9abfd8 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:31.701376 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbea02a-f095-4e30-ba2f-37e36c9abfd8 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:31.707302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12245ec1-c892-498f-80f9-31257c1e4874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:31.712045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12245ec1-c892-498f-80f9-31257c1e4874 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:31.712045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12245ec1-c892-498f-80f9-31257c1e4874 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:31.712045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12245ec1-c892-498f-80f9-31257c1e4874 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:31.712045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12245ec1-c892-498f-80f9-31257c1e4874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:31.712045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12245ec1-c892-498f-80f9-31257c1e4874 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:31.723855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1311/2578] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:05:31.728164 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed1aea-f65f-4cc7-95cc-69a008a0fb9f admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:31.738373 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed1aea-f65f-4cc7-95cc-69a008a0fb9f admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:31.743066 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728af5e-0ce6-4b67-8d3e-fc3a45fd28bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:31.743743 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728af5e-0ce6-4b67-8d3e-fc3a45fd28bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:31.746484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728af5e-0ce6-4b67-8d3e-fc3a45fd28bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:31.746484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728af5e-0ce6-4b67-8d3e-fc3a45fd28bf admin admin] PATH_INFO: `/v3/projects/576d6f0782b8448aa80592f1d49f7292/users/0a26933ef8694002bde69d7f9f15a3a5/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:31.759794 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728af5e-0ce6-4b67-8d3e-fc3a45fd28bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=576d6f0782b8448aa80592f1d49f7292, user_id=0a26933ef8694002bde69d7f9f15a3a5, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:31.762595 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728af5e-0ce6-4b67-8d3e-fc3a45fd28bf admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:31.886876 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1268/2579] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:05:31 2022] PUT /identity/v3/projects/576d6f0782b8448aa80592f1d49f7292/users/0a26933ef8694002bde69d7f9f15a3a5/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:31.898809 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbef64-ecd6-4bae-9376-ee4d801b6477 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:31.899113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbef64-ecd6-4bae-9376-ee4d801b6477 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:31.899388 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbef64-ecd6-4bae-9376-ee4d801b6477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:31.931905 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-4cdbef64-ecd6-4bae-9376-ee4d801b6477 None None] MFA Rules not processed for user `0a26933ef8694002bde69d7f9f15a3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:31.933487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4cdbef64-ecd6-4bae-9376-ee4d801b6477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:32.002162 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1312/2580] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:32.014082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728af5e-0ce6-4b67-8d3e-fc3a45fd28bf admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:32.015873 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5728af5e-0ce6-4b67-8d3e-fc3a45fd28bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:32.049222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:32.074765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728af5e-0ce6-4b67-8d3e-fc3a45fd28bf admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:32.078594 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483673ba-ae7c-437b-92b9-e0343074018e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:32.079343 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483673ba-ae7c-437b-92b9-e0343074018e service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:32.079624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483673ba-ae7c-437b-92b9-e0343074018e service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:32.079895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483673ba-ae7c-437b-92b9-e0343074018e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:32.088964 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483673ba-ae7c-437b-92b9-e0343074018e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:32.090377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483673ba-ae7c-437b-92b9-e0343074018e service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:32.099321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1269/2581] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:05:38.106583 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbef64-ecd6-4bae-9376-ee4d801b6477 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:38.108017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4cdbef64-ecd6-4bae-9376-ee4d801b6477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:38.174650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbef64-ecd6-4bae-9376-ee4d801b6477 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:38.179412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d595e-a926-4e41-883f-00bcf7512fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:38.180046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d595e-a926-4e41-883f-00bcf7512fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:38.180363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d595e-a926-4e41-883f-00bcf7512fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:38.180634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d595e-a926-4e41-883f-00bcf7512fe2 admin admin] PATH_INFO: `/v3/users/346fc5890acf419e9102b0501f3aa898` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:38.181789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d595e-a926-4e41-883f-00bcf7512fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=346fc5890acf419e9102b0501f3aa898)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:38.184172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d595e-a926-4e41-883f-00bcf7512fe2 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:38.433285 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-844d595e-a926-4e41-883f-00bcf7512fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346fc5890acf419e9102b0501f3aa898'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:38.440268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-844d595e-a926-4e41-883f-00bcf7512fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346fc5890acf419e9102b0501f3aa898'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:38.441940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:38.505713 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-844d595e-a926-4e41-883f-00bcf7512fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346fc5890acf419e9102b0501f3aa898'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:38.506461 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-844d595e-a926-4e41-883f-00bcf7512fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346fc5890acf419e9102b0501f3aa898'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:38.520588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-844d595e-a926-4e41-883f-00bcf7512fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346fc5890acf419e9102b0501f3aa898'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:38.526956 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1313/2582] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:05:38 2022] DELETE /identity/v3/users/346fc5890acf419e9102b0501f3aa898 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:38.532215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ccd1c-5358-48c8-9a85-69887436c2f0 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:38.532811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ccd1c-5358-48c8-9a85-69887436c2f0 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:38.532811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ccd1c-5358-48c8-9a85-69887436c2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:38.552682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-da6ccd1c-5358-48c8-9a85-69887436c2f0 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:38.554671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-da6ccd1c-5358-48c8-9a85-69887436c2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:38.620238 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1270/2583] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:05:38.630080 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d595e-a926-4e41-883f-00bcf7512fe2 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:38.631563 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-844d595e-a926-4e41-883f-00bcf7512fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:38.692619 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d595e-a926-4e41-883f-00bcf7512fe2 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:38.696534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdfb3c-e747-4d78-a008-95ed0f51b53d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:38.697147 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdfb3c-e747-4d78-a008-95ed0f51b53d service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:38.697429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdfb3c-e747-4d78-a008-95ed0f51b53d service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:38.697703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdfb3c-e747-4d78-a008-95ed0f51b53d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:38.708151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdfb3c-e747-4d78-a008-95ed0f51b53d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:38.709639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdfb3c-e747-4d78-a008-95ed0f51b53d service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:38.720221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1314/2584] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:05:39.295342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ccd1c-5358-48c8-9a85-69887436c2f0 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:39.295342 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-da6ccd1c-5358-48c8-9a85-69887436c2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:39.310526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ccd1c-5358-48c8-9a85-69887436c2f0 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:39.315369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265428a6-5a87-474c-bf23-0c4d0deb0708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:39.316020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265428a6-5a87-474c-bf23-0c4d0deb0708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:39.316335 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265428a6-5a87-474c-bf23-0c4d0deb0708 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:39.316793 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265428a6-5a87-474c-bf23-0c4d0deb0708 admin admin] PATH_INFO: `/v3/projects/ffc3b583ac4040038698d7112ac315d7` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:39.318058 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265428a6-5a87-474c-bf23-0c4d0deb0708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc3b583ac4040038698d7112ac315d7)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:39.322557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265428a6-5a87-474c-bf23-0c4d0deb0708 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:39.436707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-265428a6-5a87-474c-bf23-0c4d0deb0708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc3b583ac4040038698d7112ac315d7', 'request_id': 'req-265428a6-5a87-474c-bf23-0c4d0deb0708'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:39.511048 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-265428a6-5a87-474c-bf23-0c4d0deb0708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc3b583ac4040038698d7112ac315d7', 'request_id': 'req-265428a6-5a87-474c-bf23-0c4d0deb0708'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:39.518000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-265428a6-5a87-474c-bf23-0c4d0deb0708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc3b583ac4040038698d7112ac315d7', 'request_id': 'req-265428a6-5a87-474c-bf23-0c4d0deb0708'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:39.529297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-265428a6-5a87-474c-bf23-0c4d0deb0708 admin admin] The token cache is being invalidate because project ffc3b583ac4040038698d7112ac315d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:05:39.529586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-265428a6-5a87-474c-bf23-0c4d0deb0708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:39.530232 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-265428a6-5a87-474c-bf23-0c4d0deb0708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:39.531720 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1271/2585] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:05:39 2022] DELETE /identity/v3/projects/ffc3b583ac4040038698d7112ac315d7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:46.300437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdfb3c-e747-4d78-a008-95ed0f51b53d service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:46.309695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdfb3c-e747-4d78-a008-95ed0f51b53d service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:46.360415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7dca4-e6cc-4044-b3ae-f3329a1a303a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:46.361056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7dca4-e6cc-4044-b3ae-f3329a1a303a service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:46.361332 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7dca4-e6cc-4044-b3ae-f3329a1a303a service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:46.361607 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7dca4-e6cc-4044-b3ae-f3329a1a303a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:46.363387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-2fb7dca4-e6cc-4044-b3ae-f3329a1a303a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:46.434530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7dca4-e6cc-4044-b3ae-f3329a1a303a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:46.436004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7dca4-e6cc-4044-b3ae-f3329a1a303a service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:46.446746 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1315/2586] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:05:49.526280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=67,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:50.360388 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265428a6-5a87-474c-bf23-0c4d0deb0708 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:50.361910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-265428a6-5a87-474c-bf23-0c4d0deb0708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:50.450344 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265428a6-5a87-474c-bf23-0c4d0deb0708 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:50.455270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe795e4-7223-40a8-b91a-1743491be149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:50.456024 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe795e4-7223-40a8-b91a-1743491be149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:50.456370 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe795e4-7223-40a8-b91a-1743491be149 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:50.456674 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe795e4-7223-40a8-b91a-1743491be149 admin admin] PATH_INFO: `/v3/users/12245620ca0e4579890a93e4492e4fc0` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:50.457847 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe795e4-7223-40a8-b91a-1743491be149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12245620ca0e4579890a93e4492e4fc0)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:50.459995 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe795e4-7223-40a8-b91a-1743491be149 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:50.656907 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-afe795e4-7223-40a8-b91a-1743491be149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12245620ca0e4579890a93e4492e4fc0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:50.657575 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-afe795e4-7223-40a8-b91a-1743491be149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12245620ca0e4579890a93e4492e4fc0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:50.658398 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-afe795e4-7223-40a8-b91a-1743491be149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12245620ca0e4579890a93e4492e4fc0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:50.675035 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-afe795e4-7223-40a8-b91a-1743491be149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12245620ca0e4579890a93e4492e4fc0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:50.683557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-afe795e4-7223-40a8-b91a-1743491be149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12245620ca0e4579890a93e4492e4fc0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:50.778432 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1272/2587] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:05:50 2022] DELETE /identity/v3/users/12245620ca0e4579890a93e4492e4fc0 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:51.066862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7dca4-e6cc-4044-b3ae-f3329a1a303a service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:51.116935 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:51.139326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7dca4-e6cc-4044-b3ae-f3329a1a303a service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:51.199659 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfa3f0-7a9e-4c1c-9609-418b8f429bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:51.200346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfa3f0-7a9e-4c1c-9609-418b8f429bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:51.200635 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfa3f0-7a9e-4c1c-9609-418b8f429bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:51.200908 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfa3f0-7a9e-4c1c-9609-418b8f429bc9 admin admin] PATH_INFO: `/v3/projects/00847a5fa63d48fb978c5594aa89d174` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:51.202066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfa3f0-7a9e-4c1c-9609-418b8f429bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00847a5fa63d48fb978c5594aa89d174)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:51.204089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfa3f0-7a9e-4c1c-9609-418b8f429bc9 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:51.328519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-74dfa3f0-7a9e-4c1c-9609-418b8f429bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00847a5fa63d48fb978c5594aa89d174', 'request_id': 'req-74dfa3f0-7a9e-4c1c-9609-418b8f429bc9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:51.336096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-74dfa3f0-7a9e-4c1c-9609-418b8f429bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00847a5fa63d48fb978c5594aa89d174', 'request_id': 'req-74dfa3f0-7a9e-4c1c-9609-418b8f429bc9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:51.343424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-74dfa3f0-7a9e-4c1c-9609-418b8f429bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00847a5fa63d48fb978c5594aa89d174', 'request_id': 'req-74dfa3f0-7a9e-4c1c-9609-418b8f429bc9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:51.417580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-74dfa3f0-7a9e-4c1c-9609-418b8f429bc9 admin admin] The token cache is being invalidate because project 00847a5fa63d48fb978c5594aa89d174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:05:51.417860 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-74dfa3f0-7a9e-4c1c-9609-418b8f429bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:51.418551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-74dfa3f0-7a9e-4c1c-9609-418b8f429bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:51.420348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1316/2588] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:05:51 2022] DELETE /identity/v3/projects/00847a5fa63d48fb978c5594aa89d174 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:51.428102 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6242845-d27c-4c9a-82af-77dcfa48e07c None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:51.428617 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6242845-d27c-4c9a-82af-77dcfa48e07c None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:51.429041 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6242845-d27c-4c9a-82af-77dcfa48e07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:51.491347 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-a6242845-d27c-4c9a-82af-77dcfa48e07c None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:51.492674 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-a6242845-d27c-4c9a-82af-77dcfa48e07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:51.530938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:51.556234 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1273/2589] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:05:51.564411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d31d80-759b-4025-ac17-1caaa74a2344 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:51.566159 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d31d80-759b-4025-ac17-1caaa74a2344 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:51.566159 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d31d80-759b-4025-ac17-1caaa74a2344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:51.598975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f8d31d80-759b-4025-ac17-1caaa74a2344 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:51.600215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f8d31d80-759b-4025-ac17-1caaa74a2344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:51.608805 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1317/2590] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:51.613222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6242845-d27c-4c9a-82af-77dcfa48e07c None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:51.623903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6242845-d27c-4c9a-82af-77dcfa48e07c None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:51.629279 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285810b8-603b-4b6b-be8b-27b795db8542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:51.629279 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285810b8-603b-4b6b-be8b-27b795db8542 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:51.629622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285810b8-603b-4b6b-be8b-27b795db8542 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:51.629946 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285810b8-603b-4b6b-be8b-27b795db8542 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:51.632995 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285810b8-603b-4b6b-be8b-27b795db8542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:05:51.633997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285810b8-603b-4b6b-be8b-27b795db8542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:51.635670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285810b8-603b-4b6b-be8b-27b795db8542 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:51.649479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1274/2591] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:05:51.654367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d31d80-759b-4025-ac17-1caaa74a2344 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:51.670068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d31d80-759b-4025-ac17-1caaa74a2344 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:51.674964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42968625-440a-4dd4-929d-09c34acea73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:51.675591 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42968625-440a-4dd4-929d-09c34acea73e admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:51.675873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42968625-440a-4dd4-929d-09c34acea73e admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:51.676154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42968625-440a-4dd4-929d-09c34acea73e admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:51.676888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42968625-440a-4dd4-929d-09c34acea73e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:51.680428 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42968625-440a-4dd4-929d-09c34acea73e admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:51.808096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1318/2592] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:05:51 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:05:51.812538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285810b8-603b-4b6b-be8b-27b795db8542 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:51.823683 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285810b8-603b-4b6b-be8b-27b795db8542 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:51.900330 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc4714-155c-4999-936a-07c7bf5ff81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:51.900958 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc4714-155c-4999-936a-07c7bf5ff81a admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:51.901243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc4714-155c-4999-936a-07c7bf5ff81a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:51.901514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc4714-155c-4999-936a-07c7bf5ff81a admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:51.902155 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc4714-155c-4999-936a-07c7bf5ff81a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:51.904250 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc4714-155c-4999-936a-07c7bf5ff81a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:51.999184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1275/2593] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:05:51 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:05:52.009992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42968625-440a-4dd4-929d-09c34acea73e admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:52.020813 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42968625-440a-4dd4-929d-09c34acea73e admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:52.026069 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10526008-346f-4b8e-a6f8-5670b31faf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:52.026678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10526008-346f-4b8e-a6f8-5670b31faf65 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:52.026957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10526008-346f-4b8e-a6f8-5670b31faf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:52.027228 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10526008-346f-4b8e-a6f8-5670b31faf65 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:52.027878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10526008-346f-4b8e-a6f8-5670b31faf65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:52.029619 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10526008-346f-4b8e-a6f8-5670b31faf65 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:52.041726 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1319/2594] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:05:52.046878 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc4714-155c-4999-936a-07c7bf5ff81a admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:52.058605 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc4714-155c-4999-936a-07c7bf5ff81a admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:52.063543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33738ae4-8a33-44b5-827b-be2be69993f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:52.063965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33738ae4-8a33-44b5-827b-be2be69993f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:52.064273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33738ae4-8a33-44b5-827b-be2be69993f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:52.064545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33738ae4-8a33-44b5-827b-be2be69993f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:52.065178 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33738ae4-8a33-44b5-827b-be2be69993f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:52.066764 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33738ae4-8a33-44b5-827b-be2be69993f0 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:52.078691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1276/2595] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:05:52.083149 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10526008-346f-4b8e-a6f8-5670b31faf65 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:52.097104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10526008-346f-4b8e-a6f8-5670b31faf65 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:52.102811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d0023-5fed-476a-8fc0-c1604b1c03f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:52.103322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d0023-5fed-476a-8fc0-c1604b1c03f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:52.103605 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d0023-5fed-476a-8fc0-c1604b1c03f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:52.104001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d0023-5fed-476a-8fc0-c1604b1c03f8 admin admin] PATH_INFO: `/v3/projects/7533e37e1e4b4fee84cfd6b8859fec9e/users/38fb2064a7af45459bb4a0611c405f79/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:52.122427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d0023-5fed-476a-8fc0-c1604b1c03f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7533e37e1e4b4fee84cfd6b8859fec9e, user_id=38fb2064a7af45459bb4a0611c405f79, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:52.125509 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d0023-5fed-476a-8fc0-c1604b1c03f8 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:52.194593 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1320/2596] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:05:52 2022] PUT /identity/v3/projects/7533e37e1e4b4fee84cfd6b8859fec9e/users/38fb2064a7af45459bb4a0611c405f79/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:52.211406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e800a7-b176-4dab-b061-942046212d93 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:52.211696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e800a7-b176-4dab-b061-942046212d93 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:52.211973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e800a7-b176-4dab-b061-942046212d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:52.250967 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-c7e800a7-b176-4dab-b061-942046212d93 None None] MFA Rules not processed for user `38fb2064a7af45459bb4a0611c405f79`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:52.252296 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c7e800a7-b176-4dab-b061-942046212d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:52.316725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1277/2597] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:52.328425 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d0023-5fed-476a-8fc0-c1604b1c03f8 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:52.330515 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4f1d0023-5fed-476a-8fc0-c1604b1c03f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:52.346107 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:52.466658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d0023-5fed-476a-8fc0-c1604b1c03f8 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:52.472369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d3a04-2ed4-47b6-9250-68401f47aee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:52.472985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3a04-2ed4-47b6-9250-68401f47aee9 service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:52.473264 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3a04-2ed4-47b6-9250-68401f47aee9 service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:52.473537 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3a04-2ed4-47b6-9250-68401f47aee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:52.482575 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d3a04-2ed4-47b6-9250-68401f47aee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:52.484163 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d3a04-2ed4-47b6-9250-68401f47aee9 service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:52.494192 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1321/2598] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:05:58.750255 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e800a7-b176-4dab-b061-942046212d93 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:58.793322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:58.818054 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e800a7-b176-4dab-b061-942046212d93 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:58.823865 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c248-8426-4fa4-af72-3f1228f5533b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:58.824668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c248-8426-4fa4-af72-3f1228f5533b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:58.824951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c248-8426-4fa4-af72-3f1228f5533b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:58.825225 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c248-8426-4fa4-af72-3f1228f5533b admin admin] PATH_INFO: `/v3/users/38fb2064a7af45459bb4a0611c405f79` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:58.826376 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0c248-8426-4fa4-af72-3f1228f5533b admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fb2064a7af45459bb4a0611c405f79)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:58.828335 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0c248-8426-4fa4-af72-3f1228f5533b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:59.034146 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-bfa0c248-8426-4fa4-af72-3f1228f5533b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fb2064a7af45459bb4a0611c405f79'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:59.034792 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-bfa0c248-8426-4fa4-af72-3f1228f5533b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fb2064a7af45459bb4a0611c405f79'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:59.035671 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-bfa0c248-8426-4fa4-af72-3f1228f5533b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fb2064a7af45459bb4a0611c405f79'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:59.051235 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-bfa0c248-8426-4fa4-af72-3f1228f5533b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fb2064a7af45459bb4a0611c405f79'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:59.059463 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-bfa0c248-8426-4fa4-af72-3f1228f5533b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fb2064a7af45459bb4a0611c405f79'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:59.128233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1278/2599] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:05:58 2022] DELETE /identity/v3/users/38fb2064a7af45459bb4a0611c405f79 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:59.133093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4920196-7a55-4cc7-bdab-f63f31834421 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:59.133598 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4920196-7a55-4cc7-bdab-f63f31834421 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:59.133716 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4920196-7a55-4cc7-bdab-f63f31834421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:59.154251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-c4920196-7a55-4cc7-bdab-f63f31834421 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:05:59.155616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c4920196-7a55-4cc7-bdab-f63f31834421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:59.217122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1322/2600] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:05:59.226701 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c248-8426-4fa4-af72-3f1228f5533b admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:59.228145 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-bfa0c248-8426-4fa4-af72-3f1228f5533b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:59.289449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c248-8426-4fa4-af72-3f1228f5533b admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:59.293367 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5ce07-c655-4466-9c2c-39b4be9476d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:59.293977 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5ce07-c655-4466-9c2c-39b4be9476d0 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:59.294287 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5ce07-c655-4466-9c2c-39b4be9476d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:59.294559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5ce07-c655-4466-9c2c-39b4be9476d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:59.303465 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5ce07-c655-4466-9c2c-39b4be9476d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:59.304956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5ce07-c655-4466-9c2c-39b4be9476d0 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:59.315765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1279/2601] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:05:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:05:59.751623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4920196-7a55-4cc7-bdab-f63f31834421 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:05:59.753588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c4920196-7a55-4cc7-bdab-f63f31834421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:05:59.767200 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4920196-7a55-4cc7-bdab-f63f31834421 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:05:59.772264 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6e408-aff8-41f5-a39f-099647045b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:05:59.772945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6e408-aff8-41f5-a39f-099647045b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:59.773211 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6e408-aff8-41f5-a39f-099647045b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:59.773487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6e408-aff8-41f5-a39f-099647045b56 admin admin] PATH_INFO: `/v3/projects/7533e37e1e4b4fee84cfd6b8859fec9e` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:05:59.774638 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6e408-aff8-41f5-a39f-099647045b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7533e37e1e4b4fee84cfd6b8859fec9e)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:05:59.776679 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6e408-aff8-41f5-a39f-099647045b56 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:05:59.894957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5ce6e408-aff8-41f5-a39f-099647045b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7533e37e1e4b4fee84cfd6b8859fec9e', 'request_id': 'req-5ce6e408-aff8-41f5-a39f-099647045b56'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:59.897794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:59.902798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5ce6e408-aff8-41f5-a39f-099647045b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7533e37e1e4b4fee84cfd6b8859fec9e', 'request_id': 'req-5ce6e408-aff8-41f5-a39f-099647045b56'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:59.908650 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5ce6e408-aff8-41f5-a39f-099647045b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7533e37e1e4b4fee84cfd6b8859fec9e', 'request_id': 'req-5ce6e408-aff8-41f5-a39f-099647045b56'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:59.972992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5ce6e408-aff8-41f5-a39f-099647045b56 admin admin] The token cache is being invalidate because project 7533e37e1e4b4fee84cfd6b8859fec9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:05:59.973282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5ce6e408-aff8-41f5-a39f-099647045b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:59.973926 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-5ce6e408-aff8-41f5-a39f-099647045b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:05:59.975421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1323/2602] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:05:59 2022] DELETE /identity/v3/projects/7533e37e1e4b4fee84cfd6b8859fec9e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:05:59.981069 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345eb71-0500-44ca-a6f3-5385cf14aec6 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:05:59.983228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345eb71-0500-44ca-a6f3-5385cf14aec6 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:05:59.983228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345eb71-0500-44ca-a6f3-5385cf14aec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:00.002300 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-5345eb71-0500-44ca-a6f3-5385cf14aec6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:00.003496 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5345eb71-0500-44ca-a6f3-5385cf14aec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:00.057604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:00.067213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1280/2603] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:00.076546 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208051dc-ead1-4952-92f0-5fe80b259873 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:00.076833 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208051dc-ead1-4952-92f0-5fe80b259873 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:00.077117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208051dc-ead1-4952-92f0-5fe80b259873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:00.099038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-208051dc-ead1-4952-92f0-5fe80b259873 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:00.100209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-208051dc-ead1-4952-92f0-5fe80b259873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:00.113570 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1324/2604] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:00.117908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345eb71-0500-44ca-a6f3-5385cf14aec6 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:00.127738 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345eb71-0500-44ca-a6f3-5385cf14aec6 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:00.132366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef2078-d164-4533-a849-e28cf841ba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:00.132978 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef2078-d164-4533-a849-e28cf841ba84 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:00.133254 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef2078-d164-4533-a849-e28cf841ba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:00.133524 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef2078-d164-4533-a849-e28cf841ba84 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:00.134172 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef2078-d164-4533-a849-e28cf841ba84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:06:00.134505 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef2078-d164-4533-a849-e28cf841ba84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:00.136119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef2078-d164-4533-a849-e28cf841ba84 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:00.149330 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1281/2605] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:06:00.154471 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208051dc-ead1-4952-92f0-5fe80b259873 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:00.164128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208051dc-ead1-4952-92f0-5fe80b259873 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:00.170169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9f624-cfd6-45fe-9e22-18c10fcae3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:00.170872 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9f624-cfd6-45fe-9e22-18c10fcae3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:00.171159 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9f624-cfd6-45fe-9e22-18c10fcae3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:00.171436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9f624-cfd6-45fe-9e22-18c10fcae3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:00.172091 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9f624-cfd6-45fe-9e22-18c10fcae3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:00.174059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9f624-cfd6-45fe-9e22-18c10fcae3c9 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:00.284437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1325/2606] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:00 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:00.288734 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef2078-d164-4533-a849-e28cf841ba84 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:00.299398 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef2078-d164-4533-a849-e28cf841ba84 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:00.359846 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aef682-0364-4915-b7fe-cc83dccb8646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:00.360497 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aef682-0364-4915-b7fe-cc83dccb8646 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:00.360787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aef682-0364-4915-b7fe-cc83dccb8646 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:00.361073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aef682-0364-4915-b7fe-cc83dccb8646 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:00.361703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aef682-0364-4915-b7fe-cc83dccb8646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:00.363679 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aef682-0364-4915-b7fe-cc83dccb8646 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:00.494620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1282/2607] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:00 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:00.498723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9f624-cfd6-45fe-9e22-18c10fcae3c9 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:00.509279 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9f624-cfd6-45fe-9e22-18c10fcae3c9 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:00.514113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517329d-6cf5-4823-876a-7f698390b132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:00.514765 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517329d-6cf5-4823-876a-7f698390b132 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:00.515022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517329d-6cf5-4823-876a-7f698390b132 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:00.515276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517329d-6cf5-4823-876a-7f698390b132 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:00.515928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517329d-6cf5-4823-876a-7f698390b132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:00.517581 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517329d-6cf5-4823-876a-7f698390b132 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:00.528841 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1326/2608] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:00.533539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aef682-0364-4915-b7fe-cc83dccb8646 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:00.544517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aef682-0364-4915-b7fe-cc83dccb8646 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:00.549381 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23a114-6c2b-48cd-ab32-7838fe56e04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:00.549986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23a114-6c2b-48cd-ab32-7838fe56e04d admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:00.550267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23a114-6c2b-48cd-ab32-7838fe56e04d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:00.550540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23a114-6c2b-48cd-ab32-7838fe56e04d admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:00.551179 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23a114-6c2b-48cd-ab32-7838fe56e04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:00.552839 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23a114-6c2b-48cd-ab32-7838fe56e04d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:00.565311 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1283/2609] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:00.569869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517329d-6cf5-4823-876a-7f698390b132 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:00.580338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517329d-6cf5-4823-876a-7f698390b132 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:00.585034 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cb1cd-19ee-4947-959f-2c08d1b42cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:00.585692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cb1cd-19ee-4947-959f-2c08d1b42cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:00.585971 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cb1cd-19ee-4947-959f-2c08d1b42cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:00.586246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cb1cd-19ee-4947-959f-2c08d1b42cfb admin admin] PATH_INFO: `/v3/projects/908cf04e004947ba8f656cdd0199a129/users/b62ed204eb7c48af8622b41abcbfa646/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:00.601271 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509cb1cd-19ee-4947-959f-2c08d1b42cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=908cf04e004947ba8f656cdd0199a129, user_id=b62ed204eb7c48af8622b41abcbfa646, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:00.604596 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509cb1cd-19ee-4947-959f-2c08d1b42cfb admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:00.671909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1327/2610] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:00 2022] PUT /identity/v3/projects/908cf04e004947ba8f656cdd0199a129/users/b62ed204eb7c48af8622b41abcbfa646/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:06:00.683568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c58ed9-2dc0-44b1-b309-d18b07c4f0f5 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:00.683850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c58ed9-2dc0-44b1-b309-d18b07c4f0f5 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:00.684123 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c58ed9-2dc0-44b1-b309-d18b07c4f0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:00.714311 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-24c58ed9-2dc0-44b1-b309-d18b07c4f0f5 None None] MFA Rules not processed for user `b62ed204eb7c48af8622b41abcbfa646`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:00.715586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-24c58ed9-2dc0-44b1-b309-d18b07c4f0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:00.792943 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1284/2611] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:00.797405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cb1cd-19ee-4947-959f-2c08d1b42cfb admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:00.876566 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cb1cd-19ee-4947-959f-2c08d1b42cfb admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:00.879265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26333fa-80c5-4354-95fe-24654d94845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:00.879904 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26333fa-80c5-4354-95fe-24654d94845b admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:00.880390 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26333fa-80c5-4354-95fe-24654d94845b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:00.880959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26333fa-80c5-4354-95fe-24654d94845b admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:00.881406 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26333fa-80c5-4354-95fe-24654d94845b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:00.883493 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26333fa-80c5-4354-95fe-24654d94845b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:00.997463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1328/2612] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:00 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:06:01.001945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c58ed9-2dc0-44b1-b309-d18b07c4f0f5 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:01.013169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c58ed9-2dc0-44b1-b309-d18b07c4f0f5 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:01.063442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:01.073213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e628e-2db3-4f62-8dd3-e981b5531022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:01.073833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e628e-2db3-4f62-8dd3-e981b5531022 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:01.074115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e628e-2db3-4f62-8dd3-e981b5531022 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:01.074390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e628e-2db3-4f62-8dd3-e981b5531022 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:01.075056 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e628e-2db3-4f62-8dd3-e981b5531022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:01.077217 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e628e-2db3-4f62-8dd3-e981b5531022 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:01.193658 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1285/2613] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:01 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:01.196651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26333fa-80c5-4354-95fe-24654d94845b admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:01.207931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26333fa-80c5-4354-95fe-24654d94845b admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:01.215258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3563ce7-c0f5-4ab7-ae5c-705b122af5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:01.215811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3563ce7-c0f5-4ab7-ae5c-705b122af5bd admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:01.216173 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3563ce7-c0f5-4ab7-ae5c-705b122af5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:01.216477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3563ce7-c0f5-4ab7-ae5c-705b122af5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:01.217131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3563ce7-c0f5-4ab7-ae5c-705b122af5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:01.218754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3563ce7-c0f5-4ab7-ae5c-705b122af5bd admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:01.230405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1329/2614] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:01.234489 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e628e-2db3-4f62-8dd3-e981b5531022 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:01.248896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e628e-2db3-4f62-8dd3-e981b5531022 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:01.249787 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1ee4e-ceaf-4729-a56b-4a88d93fcc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:01.250530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1ee4e-ceaf-4729-a56b-4a88d93fcc65 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:01.250846 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1ee4e-ceaf-4729-a56b-4a88d93fcc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:01.251125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1ee4e-ceaf-4729-a56b-4a88d93fcc65 admin admin] PATH_INFO: `/v3/projects/aea2b11370274093afba1f0e149b6d01/users/d906b51ddac04fe48be7259b31ef7311/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:01.268747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1ee4e-ceaf-4729-a56b-4a88d93fcc65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea2b11370274093afba1f0e149b6d01, user_id=d906b51ddac04fe48be7259b31ef7311, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:01.271487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1ee4e-ceaf-4729-a56b-4a88d93fcc65 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:01.362744 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1286/2615] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:01 2022] PUT /identity/v3/projects/aea2b11370274093afba1f0e149b6d01/users/d906b51ddac04fe48be7259b31ef7311/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:01.367054 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3563ce7-c0f5-4ab7-ae5c-705b122af5bd admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:01.377394 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3563ce7-c0f5-4ab7-ae5c-705b122af5bd admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:01.427636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:01.437863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd8515-d8f1-4241-a70c-b2a29fbd980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:01.438467 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd8515-d8f1-4241-a70c-b2a29fbd980d admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:01.438747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd8515-d8f1-4241-a70c-b2a29fbd980d admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:01.439022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd8515-d8f1-4241-a70c-b2a29fbd980d admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:01.439666 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd8515-d8f1-4241-a70c-b2a29fbd980d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:01.441314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd8515-d8f1-4241-a70c-b2a29fbd980d admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:01.452124 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1330/2616] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:01.456326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1ee4e-ceaf-4729-a56b-4a88d93fcc65 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:01.468885 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1ee4e-ceaf-4729-a56b-4a88d93fcc65 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:01.473622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904da4b-b522-4372-9266-fbe215c4b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:01.474252 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904da4b-b522-4372-9266-fbe215c4b924 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:01.474533 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904da4b-b522-4372-9266-fbe215c4b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:01.474805 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904da4b-b522-4372-9266-fbe215c4b924 admin admin] PATH_INFO: `/v3/projects/aea2b11370274093afba1f0e149b6d01/users/d906b51ddac04fe48be7259b31ef7311/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:01.476810 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904da4b-b522-4372-9266-fbe215c4b924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea2b11370274093afba1f0e149b6d01, user_id=d906b51ddac04fe48be7259b31ef7311, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:01.480961 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904da4b-b522-4372-9266-fbe215c4b924 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:01.490528 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1287/2617] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:01 2022] PUT /identity/v3/projects/aea2b11370274093afba1f0e149b6d01/users/d906b51ddac04fe48be7259b31ef7311/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:01.502028 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db92a22-e373-43f4-8588-a6ab535a4e67 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:01.505188 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db92a22-e373-43f4-8588-a6ab535a4e67 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:01.505188 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db92a22-e373-43f4-8588-a6ab535a4e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:01.530614 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-1db92a22-e373-43f4-8588-a6ab535a4e67 None None] MFA Rules not processed for user `d906b51ddac04fe48be7259b31ef7311`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:01.531848 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-1db92a22-e373-43f4-8588-a6ab535a4e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:01.603329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1331/2618] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:01.614896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904da4b-b522-4372-9266-fbe215c4b924 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:01.616761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-6904da4b-b522-4372-9266-fbe215c4b924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:01.682261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904da4b-b522-4372-9266-fbe215c4b924 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:01.686258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04349db-1309-4d4a-a486-1571408c24af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:01.686881 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04349db-1309-4d4a-a486-1571408c24af service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:01.687201 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04349db-1309-4d4a-a486-1571408c24af service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:01.687474 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04349db-1309-4d4a-a486-1571408c24af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:01.697548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04349db-1309-4d4a-a486-1571408c24af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:01.699125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04349db-1309-4d4a-a486-1571408c24af service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:01.708749 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1288/2619] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:01.952494 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db92a22-e373-43f4-8588-a6ab535a4e67 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:01.965323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db92a22-e373-43f4-8588-a6ab535a4e67 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:01.968845 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14540a27-8468-42da-9451-8a4381621d39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:01.969654 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14540a27-8468-42da-9451-8a4381621d39 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:01.969782 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14540a27-8468-42da-9451-8a4381621d39 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:01.969985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14540a27-8468-42da-9451-8a4381621d39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:02.034902 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14540a27-8468-42da-9451-8a4381621d39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:02.036601 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14540a27-8468-42da-9451-8a4381621d39 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:02.047427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1332/2620] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:06:02.351336 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04349db-1309-4d4a-a486-1571408c24af service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:02.354595 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f04349db-1309-4d4a-a486-1571408c24af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:02.443970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04349db-1309-4d4a-a486-1571408c24af service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:02.454383 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd908f-e5e0-4cf4-ac9a-b5b2075a814b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:02.457244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd908f-e5e0-4cf4-ac9a-b5b2075a814b service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:02.457244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd908f-e5e0-4cf4-ac9a-b5b2075a814b service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:02.457244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd908f-e5e0-4cf4-ac9a-b5b2075a814b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:02.457561 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-bbdd908f-e5e0-4cf4-ac9a-b5b2075a814b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:02.566165 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd908f-e5e0-4cf4-ac9a-b5b2075a814b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:02.567856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd908f-e5e0-4cf4-ac9a-b5b2075a814b service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:02.573034 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:02.585163 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1289/2621] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:04.861359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14540a27-8468-42da-9451-8a4381621d39 service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:04.864103 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-14540a27-8468-42da-9451-8a4381621d39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:04.970386 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:04.986241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14540a27-8468-42da-9451-8a4381621d39 service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:04.991785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a1b4f-b5ff-4eb3-8e07-b6ea1a956798 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5fb88d96640089eba545f4c8d3c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:04.992980 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a1b4f-b5ff-4eb3-8e07-b6ea1a956798 service placement] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:04.993267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a1b4f-b5ff-4eb3-8e07-b6ea1a956798 service placement] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:04.993539 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a1b4f-b5ff-4eb3-8e07-b6ea1a956798 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:04.995765 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8f3a1b4f-b5ff-4eb3-8e07-b6ea1a956798 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:05.008750 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a1b4f-b5ff-4eb3-8e07-b6ea1a956798 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:05.018198 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a1b4f-b5ff-4eb3-8e07-b6ea1a956798 service placement] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:05.027470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1333/2622] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:06.444348 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd908f-e5e0-4cf4-ac9a-b5b2075a814b service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:06.445894 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-bbdd908f-e5e0-4cf4-ac9a-b5b2075a814b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:06.464092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd908f-e5e0-4cf4-ac9a-b5b2075a814b service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:06.468024 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bcabea-1700-4dcf-87bd-9fdb1373b90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:06.468693 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcabea-1700-4dcf-87bd-9fdb1373b90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:06.468971 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcabea-1700-4dcf-87bd-9fdb1373b90a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:06.469238 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcabea-1700-4dcf-87bd-9fdb1373b90a admin admin] PATH_INFO: `/v3/users/fbdd4001b2ea4c6cbd6e012f497275cb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:06.470355 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bcabea-1700-4dcf-87bd-9fdb1373b90a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbdd4001b2ea4c6cbd6e012f497275cb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:06.472331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bcabea-1700-4dcf-87bd-9fdb1373b90a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:06.696570 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-38bcabea-1700-4dcf-87bd-9fdb1373b90a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbdd4001b2ea4c6cbd6e012f497275cb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:06.697220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-38bcabea-1700-4dcf-87bd-9fdb1373b90a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbdd4001b2ea4c6cbd6e012f497275cb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:06.697909 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-38bcabea-1700-4dcf-87bd-9fdb1373b90a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbdd4001b2ea4c6cbd6e012f497275cb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:06.711270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-38bcabea-1700-4dcf-87bd-9fdb1373b90a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbdd4001b2ea4c6cbd6e012f497275cb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:06.721688 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-38bcabea-1700-4dcf-87bd-9fdb1373b90a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbdd4001b2ea4c6cbd6e012f497275cb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:06.785536 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1290/2623] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:06:06 2022] DELETE /identity/v3/users/fbdd4001b2ea4c6cbd6e012f497275cb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:07.036460 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a1b4f-b5ff-4eb3-8e07-b6ea1a956798 service placement] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:07.048807 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a1b4f-b5ff-4eb3-8e07-b6ea1a956798 service placement] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:07.111956 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea5539-c94c-423f-8e8d-38d99a072fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:07.112629 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea5539-c94c-423f-8e8d-38d99a072fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:07.112918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea5539-c94c-423f-8e8d-38d99a072fad admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:07.113202 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea5539-c94c-423f-8e8d-38d99a072fad admin admin] PATH_INFO: `/v3/projects/ba85b12261b34ab4a5ae59e2065ff993` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:07.114339 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea5539-c94c-423f-8e8d-38d99a072fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba85b12261b34ab4a5ae59e2065ff993)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:07.116397 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea5539-c94c-423f-8e8d-38d99a072fad admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:07.227574 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24ea5539-c94c-423f-8e8d-38d99a072fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba85b12261b34ab4a5ae59e2065ff993', 'request_id': 'req-24ea5539-c94c-423f-8e8d-38d99a072fad'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:07.240151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24ea5539-c94c-423f-8e8d-38d99a072fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba85b12261b34ab4a5ae59e2065ff993', 'request_id': 'req-24ea5539-c94c-423f-8e8d-38d99a072fad'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:07.246764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24ea5539-c94c-423f-8e8d-38d99a072fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba85b12261b34ab4a5ae59e2065ff993', 'request_id': 'req-24ea5539-c94c-423f-8e8d-38d99a072fad'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:07.336865 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24ea5539-c94c-423f-8e8d-38d99a072fad admin admin] The token cache is being invalidate because project ba85b12261b34ab4a5ae59e2065ff993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:06:07.337151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24ea5539-c94c-423f-8e8d-38d99a072fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:07.338375 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-24ea5539-c94c-423f-8e8d-38d99a072fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:07.340377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1334/2624] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:06:07 2022] DELETE /identity/v3/projects/ba85b12261b34ab4a5ae59e2065ff993 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:07.345548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95770f9-4a39-4535-80b2-2db9a714191c None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:07.345833 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95770f9-4a39-4535-80b2-2db9a714191c None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:07.346136 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95770f9-4a39-4535-80b2-2db9a714191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:07.366823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-d95770f9-4a39-4535-80b2-2db9a714191c None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:07.368025 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d95770f9-4a39-4535-80b2-2db9a714191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:07.440614 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1291/2625] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:07.449838 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a97e97-a1d9-4f28-aecf-afa5eb51621d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:07.450129 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a97e97-a1d9-4f28-aecf-afa5eb51621d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:07.450405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a97e97-a1d9-4f28-aecf-afa5eb51621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:07.472656 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-79a97e97-a1d9-4f28-aecf-afa5eb51621d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:07.473995 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-79a97e97-a1d9-4f28-aecf-afa5eb51621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:07.483044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1335/2626] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:07.487260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95770f9-4a39-4535-80b2-2db9a714191c None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:07.498090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95770f9-4a39-4535-80b2-2db9a714191c None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:07.503091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fca3a-8c83-4690-a964-555097a5c0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:07.503751 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fca3a-8c83-4690-a964-555097a5c0df admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:07.504027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fca3a-8c83-4690-a964-555097a5c0df admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:07.504330 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fca3a-8c83-4690-a964-555097a5c0df admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:07.504974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fca3a-8c83-4690-a964-555097a5c0df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:06:07.505276 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fca3a-8c83-4690-a964-555097a5c0df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:07.506886 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fca3a-8c83-4690-a964-555097a5c0df admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:07.519574 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1292/2627] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:06:07.524171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a97e97-a1d9-4f28-aecf-afa5eb51621d None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:07.533983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a97e97-a1d9-4f28-aecf-afa5eb51621d None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:07.538902 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b9847-e0fe-40f0-9b90-69f539c9998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:07.539508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b9847-e0fe-40f0-9b90-69f539c9998e admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:07.539791 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b9847-e0fe-40f0-9b90-69f539c9998e admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:07.540065 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b9847-e0fe-40f0-9b90-69f539c9998e admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:07.540740 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b9847-e0fe-40f0-9b90-69f539c9998e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:07.542754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b9847-e0fe-40f0-9b90-69f539c9998e admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:07.645380 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1336/2628] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:07 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:07.649609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fca3a-8c83-4690-a964-555097a5c0df admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:07.661382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fca3a-8c83-4690-a964-555097a5c0df admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:07.715837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:07.722040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d6cde-242c-4a80-a893-77723530e305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:07.722649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d6cde-242c-4a80-a893-77723530e305 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:07.722935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d6cde-242c-4a80-a893-77723530e305 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:07.723214 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d6cde-242c-4a80-a893-77723530e305 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:07.723863 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d6cde-242c-4a80-a893-77723530e305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:07.725873 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d6cde-242c-4a80-a893-77723530e305 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:07.829972 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1293/2629] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:07 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:07.834427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b9847-e0fe-40f0-9b90-69f539c9998e admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:07.845703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b9847-e0fe-40f0-9b90-69f539c9998e admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:07.851262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6680214-abfb-4653-bc8f-356e0510a901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:07.851945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6680214-abfb-4653-bc8f-356e0510a901 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:07.852260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6680214-abfb-4653-bc8f-356e0510a901 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:07.852664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6680214-abfb-4653-bc8f-356e0510a901 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:07.853201 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6680214-abfb-4653-bc8f-356e0510a901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:07.855663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6680214-abfb-4653-bc8f-356e0510a901 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:07.867742 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1337/2630] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:06:07.872911 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d6cde-242c-4a80-a893-77723530e305 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:07.883311 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d6cde-242c-4a80-a893-77723530e305 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:07.889754 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9cff4-9e74-49ba-a67b-4795bfd0f715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:07.890466 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9cff4-9e74-49ba-a67b-4795bfd0f715 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:07.890758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9cff4-9e74-49ba-a67b-4795bfd0f715 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:07.891096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9cff4-9e74-49ba-a67b-4795bfd0f715 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:07.891848 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9cff4-9e74-49ba-a67b-4795bfd0f715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:07.893267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9cff4-9e74-49ba-a67b-4795bfd0f715 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:07.904966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1294/2631] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:07.909338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6680214-abfb-4653-bc8f-356e0510a901 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:07.922139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6680214-abfb-4653-bc8f-356e0510a901 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:07.928429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9970d-0738-46f8-91a7-bd883e6e2732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:07.929009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9970d-0738-46f8-91a7-bd883e6e2732 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:07.929314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9970d-0738-46f8-91a7-bd883e6e2732 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:07.929718 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9970d-0738-46f8-91a7-bd883e6e2732 admin admin] PATH_INFO: `/v3/projects/3e0093036bd04509ab58ab44f6bc43eb/users/5a723a2aa1f34519893cb7024cf3e87c/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:07.946157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9970d-0738-46f8-91a7-bd883e6e2732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0093036bd04509ab58ab44f6bc43eb, user_id=5a723a2aa1f34519893cb7024cf3e87c, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:07.949119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9970d-0738-46f8-91a7-bd883e6e2732 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:08.013998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1338/2632] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:07 2022] PUT /identity/v3/projects/3e0093036bd04509ab58ab44f6bc43eb/users/5a723a2aa1f34519893cb7024cf3e87c/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:08.025471 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069f0ae-8465-4d86-bf40-b2b1d1b66c2a None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:08.025756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069f0ae-8465-4d86-bf40-b2b1d1b66c2a None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:08.026078 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069f0ae-8465-4d86-bf40-b2b1d1b66c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:08.055147 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-e069f0ae-8465-4d86-bf40-b2b1d1b66c2a None None] MFA Rules not processed for user `5a723a2aa1f34519893cb7024cf3e87c`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:08.056422 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e069f0ae-8465-4d86-bf40-b2b1d1b66c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:08.125819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1295/2633] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:08.138460 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9970d-0738-46f8-91a7-bd883e6e2732 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:08.140180 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b2b9970d-0738-46f8-91a7-bd883e6e2732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:08.150888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:08.225974 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9970d-0738-46f8-91a7-bd883e6e2732 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:08.233094 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab84bf-903b-4a43-82a7-3bfa296886b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:08.233714 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab84bf-903b-4a43-82a7-3bfa296886b7 service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:08.234119 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab84bf-903b-4a43-82a7-3bfa296886b7 service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:08.234407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab84bf-903b-4a43-82a7-3bfa296886b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:08.243178 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab84bf-903b-4a43-82a7-3bfa296886b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:08.246206 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab84bf-903b-4a43-82a7-3bfa296886b7 service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:08.261302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1339/2634] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:08.513065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069f0ae-8465-4d86-bf40-b2b1d1b66c2a None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:08.589429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069f0ae-8465-4d86-bf40-b2b1d1b66c2a None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:08.594069 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6c964-3187-4bea-9dfd-feea28037f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:08.594707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6c964-3187-4bea-9dfd-feea28037f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:08.594983 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6c964-3187-4bea-9dfd-feea28037f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:08.595446 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6c964-3187-4bea-9dfd-feea28037f33 admin admin] PATH_INFO: `/v3/users/5a723a2aa1f34519893cb7024cf3e87c` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:08.596554 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6c964-3187-4bea-9dfd-feea28037f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a723a2aa1f34519893cb7024cf3e87c)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:08.598528 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6c964-3187-4bea-9dfd-feea28037f33 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:08.783610 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-13f6c964-3187-4bea-9dfd-feea28037f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a723a2aa1f34519893cb7024cf3e87c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:08.784180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-13f6c964-3187-4bea-9dfd-feea28037f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a723a2aa1f34519893cb7024cf3e87c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:08.784882 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-13f6c964-3187-4bea-9dfd-feea28037f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a723a2aa1f34519893cb7024cf3e87c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:08.799175 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-13f6c964-3187-4bea-9dfd-feea28037f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a723a2aa1f34519893cb7024cf3e87c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:08.801553 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:08.810108 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-13f6c964-3187-4bea-9dfd-feea28037f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a723a2aa1f34519893cb7024cf3e87c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:08.912409 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1296/2635] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:06:08 2022] DELETE /identity/v3/users/5a723a2aa1f34519893cb7024cf3e87c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:08.917904 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bcf42-3fe0-4961-855d-3a656fc8de3e None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:08.918515 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bcf42-3fe0-4961-855d-3a656fc8de3e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:08.918790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bcf42-3fe0-4961-855d-3a656fc8de3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:08.939809 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-613bcf42-3fe0-4961-855d-3a656fc8de3e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:08.941116 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-613bcf42-3fe0-4961-855d-3a656fc8de3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:09.003777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1340/2636] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:09.015704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6c964-3187-4bea-9dfd-feea28037f33 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:09.017194 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-13f6c964-3187-4bea-9dfd-feea28037f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:09.099089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6c964-3187-4bea-9dfd-feea28037f33 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:09.102837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814e57d-e89d-4fad-a32f-8cead808dd34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:09.103523 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814e57d-e89d-4fad-a32f-8cead808dd34 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:09.104149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814e57d-e89d-4fad-a32f-8cead808dd34 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:09.104149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814e57d-e89d-4fad-a32f-8cead808dd34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:09.113417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814e57d-e89d-4fad-a32f-8cead808dd34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:09.114856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814e57d-e89d-4fad-a32f-8cead808dd34 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:09.125587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1297/2637] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:09.570144 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bcf42-3fe0-4961-855d-3a656fc8de3e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:09.574686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-613bcf42-3fe0-4961-855d-3a656fc8de3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:09.583892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814e57d-e89d-4fad-a32f-8cead808dd34 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:09.585983 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1814e57d-e89d-4fad-a32f-8cead808dd34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:09.602700 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bcf42-3fe0-4961-855d-3a656fc8de3e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:09.606134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814e57d-e89d-4fad-a32f-8cead808dd34 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:09.610941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56cce5-f645-4c0c-99fa-77ca5a09c402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:09.611228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1c415-3ef2-4a54-bc56-0b7d8ce0beae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:09.611803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56cce5-f645-4c0c-99fa-77ca5a09c402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:09.611969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1c415-3ef2-4a54-bc56-0b7d8ce0beae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:09.612083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56cce5-f645-4c0c-99fa-77ca5a09c402 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:09.612168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1c415-3ef2-4a54-bc56-0b7d8ce0beae admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:09.612385 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56cce5-f645-4c0c-99fa-77ca5a09c402 admin admin] PATH_INFO: `/v3/projects/3e0093036bd04509ab58ab44f6bc43eb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:09.612538 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1c415-3ef2-4a54-bc56-0b7d8ce0beae admin admin] PATH_INFO: `/v3/users/0a26933ef8694002bde69d7f9f15a3a5` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:09.613630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56cce5-f645-4c0c-99fa-77ca5a09c402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0093036bd04509ab58ab44f6bc43eb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:09.613771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1c415-3ef2-4a54-bc56-0b7d8ce0beae admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a26933ef8694002bde69d7f9f15a3a5)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:09.615682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1c415-3ef2-4a54-bc56-0b7d8ce0beae admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:09.616401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56cce5-f645-4c0c-99fa-77ca5a09c402 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:09.791633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1a56cce5-f645-4c0c-99fa-77ca5a09c402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0093036bd04509ab58ab44f6bc43eb', 'request_id': 'req-1a56cce5-f645-4c0c-99fa-77ca5a09c402'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:09.792862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a5b1c415-3ef2-4a54-bc56-0b7d8ce0beae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a26933ef8694002bde69d7f9f15a3a5'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:09.793562 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a5b1c415-3ef2-4a54-bc56-0b7d8ce0beae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a26933ef8694002bde69d7f9f15a3a5'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:09.794201 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a5b1c415-3ef2-4a54-bc56-0b7d8ce0beae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a26933ef8694002bde69d7f9f15a3a5'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:09.798360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1a56cce5-f645-4c0c-99fa-77ca5a09c402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0093036bd04509ab58ab44f6bc43eb', 'request_id': 'req-1a56cce5-f645-4c0c-99fa-77ca5a09c402'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:09.804390 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1a56cce5-f645-4c0c-99fa-77ca5a09c402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0093036bd04509ab58ab44f6bc43eb', 'request_id': 'req-1a56cce5-f645-4c0c-99fa-77ca5a09c402'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:09.808672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a5b1c415-3ef2-4a54-bc56-0b7d8ce0beae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a26933ef8694002bde69d7f9f15a3a5'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:09.815744 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-a5b1c415-3ef2-4a54-bc56-0b7d8ce0beae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a26933ef8694002bde69d7f9f15a3a5'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:09.885482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1a56cce5-f645-4c0c-99fa-77ca5a09c402 admin admin] The token cache is being invalidate because project 3e0093036bd04509ab58ab44f6bc43eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:06:09.885765 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1a56cce5-f645-4c0c-99fa-77ca5a09c402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:09.886431 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1a56cce5-f645-4c0c-99fa-77ca5a09c402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:09.887951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1341/2638] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:06:09 2022] DELETE /identity/v3/projects/3e0093036bd04509ab58ab44f6bc43eb => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:09.892851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c4e94-da6f-49aa-9856-310bd5ca2474 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:09.893139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c4e94-da6f-49aa-9856-310bd5ca2474 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:09.893416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c4e94-da6f-49aa-9856-310bd5ca2474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:09.913912 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-820c4e94-da6f-49aa-9856-310bd5ca2474 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:09.919233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-820c4e94-da6f-49aa-9856-310bd5ca2474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:09.929473 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:09.969184 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1298/2639] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:06:09 2022] DELETE /identity/v3/users/0a26933ef8694002bde69d7f9f15a3a5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:09.973918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77084c-9830-48aa-966e-7a8d6a1ffbae None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:09.974247 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77084c-9830-48aa-966e-7a8d6a1ffbae None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:09.974528 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77084c-9830-48aa-966e-7a8d6a1ffbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:09.983032 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1342/2640] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:09.990770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d214c86-8789-4405-b0fd-30565fea324e None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:09.991055 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d214c86-8789-4405-b0fd-30565fea324e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:09.991321 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d214c86-8789-4405-b0fd-30565fea324e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:09.996403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-4e77084c-9830-48aa-966e-7a8d6a1ffbae None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:09.997641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4e77084c-9830-48aa-966e-7a8d6a1ffbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:10.010931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-0d214c86-8789-4405-b0fd-30565fea324e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:10.012137 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-0d214c86-8789-4405-b0fd-30565fea324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:10.033835 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:10.062445 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1299/2641] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:10.071590 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77084c-9830-48aa-966e-7a8d6a1ffbae None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:10.073684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4e77084c-9830-48aa-966e-7a8d6a1ffbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:10.075533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1343/2642] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:10.079685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d214c86-8789-4405-b0fd-30565fea324e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:10.089716 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d214c86-8789-4405-b0fd-30565fea324e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:10.094547 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bffb5c-e4c2-42c1-b7ae-3d6d3a383498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:10.095164 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bffb5c-e4c2-42c1-b7ae-3d6d3a383498 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:10.095512 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bffb5c-e4c2-42c1-b7ae-3d6d3a383498 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:10.095764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bffb5c-e4c2-42c1-b7ae-3d6d3a383498 admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:10.096457 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bffb5c-e4c2-42c1-b7ae-3d6d3a383498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:06:10.096975 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bffb5c-e4c2-42c1-b7ae-3d6d3a383498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:10.098602 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bffb5c-e4c2-42c1-b7ae-3d6d3a383498 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:10.117836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1344/2643] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:06:10.122527 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bffb5c-e4c2-42c1-b7ae-3d6d3a383498 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:10.132866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bffb5c-e4c2-42c1-b7ae-3d6d3a383498 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:10.136549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77084c-9830-48aa-966e-7a8d6a1ffbae None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:10.138557 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d3fe9-eede-4a98-b982-2b65e7bb9c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:10.139163 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3fe9-eede-4a98-b982-2b65e7bb9c24 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:10.139571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3fe9-eede-4a98-b982-2b65e7bb9c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:10.139722 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3fe9-eede-4a98-b982-2b65e7bb9c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:10.140411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d3fe9-eede-4a98-b982-2b65e7bb9c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:10.140530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bcf1e-35a4-481c-add3-db3bdf4b8379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:10.141018 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bcf1e-35a4-481c-add3-db3bdf4b8379 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:10.141288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bcf1e-35a4-481c-add3-db3bdf4b8379 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:10.141557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bcf1e-35a4-481c-add3-db3bdf4b8379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:10.142307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d3fe9-eede-4a98-b982-2b65e7bb9c24 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:10.151664 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bcf1e-35a4-481c-add3-db3bdf4b8379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:10.153136 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bcf1e-35a4-481c-add3-db3bdf4b8379 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:10.163096 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1300/2644] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:06:10.243378 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1345/2645] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:10 2022] POST /identity/v3/projects => generated 407 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:06:10.247743 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bcf1e-35a4-481c-add3-db3bdf4b8379 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:10.257989 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bcf1e-35a4-481c-add3-db3bdf4b8379 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:10.315504 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae2585-e496-4968-8e4c-bb3f2005e2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:10.316025 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae2585-e496-4968-8e4c-bb3f2005e2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:10.316400 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae2585-e496-4968-8e4c-bb3f2005e2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:10.316604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae2585-e496-4968-8e4c-bb3f2005e2e5 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:10.317248 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae2585-e496-4968-8e4c-bb3f2005e2e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:10.319164 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae2585-e496-4968-8e4c-bb3f2005e2e5 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:10.442237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1301/2646] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:10 2022] POST /identity/v3/users => generated 304 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:10.448892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d3fe9-eede-4a98-b982-2b65e7bb9c24 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:10.459379 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d3fe9-eede-4a98-b982-2b65e7bb9c24 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:10.464164 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be9625-a367-48ca-920a-2e8fcb40c9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:10.464814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be9625-a367-48ca-920a-2e8fcb40c9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:10.465095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be9625-a367-48ca-920a-2e8fcb40c9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:10.465371 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be9625-a367-48ca-920a-2e8fcb40c9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:10.466023 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be9625-a367-48ca-920a-2e8fcb40c9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:10.467630 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be9625-a367-48ca-920a-2e8fcb40c9c1 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:10.479287 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1346/2647] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:10.483068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae2585-e496-4968-8e4c-bb3f2005e2e5 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:10.494541 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae2585-e496-4968-8e4c-bb3f2005e2e5 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:10.499448 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bc6ec-6121-43f1-8cc6-35df0415bcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:10.500067 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bc6ec-6121-43f1-8cc6-35df0415bcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:10.500435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bc6ec-6121-43f1-8cc6-35df0415bcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:10.500656 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bc6ec-6121-43f1-8cc6-35df0415bcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:10.501311 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bc6ec-6121-43f1-8cc6-35df0415bcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:10.502902 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bc6ec-6121-43f1-8cc6-35df0415bcf3 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:10.515317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1302/2648] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:10.519712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be9625-a367-48ca-920a-2e8fcb40c9c1 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:10.530364 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be9625-a367-48ca-920a-2e8fcb40c9c1 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:10.535095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601258c-9786-456b-b029-c165b8914963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:10.535761 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601258c-9786-456b-b029-c165b8914963 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:10.536043 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601258c-9786-456b-b029-c165b8914963 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:10.536357 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601258c-9786-456b-b029-c165b8914963 admin admin] PATH_INFO: `/v3/projects/332d497e30d4467487f7185f065d051d/users/0b01ee63cd4642e5849781e9a5a889c9/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:10.552790 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601258c-9786-456b-b029-c165b8914963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=332d497e30d4467487f7185f065d051d, user_id=0b01ee63cd4642e5849781e9a5a889c9, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:10.555535 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601258c-9786-456b-b029-c165b8914963 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:10.627186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1347/2649] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:10 2022] PUT /identity/v3/projects/332d497e30d4467487f7185f065d051d/users/0b01ee63cd4642e5849781e9a5a889c9/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:10.629383 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bc6ec-6121-43f1-8cc6-35df0415bcf3 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:10.630586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-768bc6ec-6121-43f1-8cc6-35df0415bcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:10.639368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb8872-083f-4a4a-baa7-4973fc9a5e9e None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:10.639771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb8872-083f-4a4a-baa7-4973fc9a5e9e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:10.640059 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb8872-083f-4a4a-baa7-4973fc9a5e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:10.646004 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bc6ec-6121-43f1-8cc6-35df0415bcf3 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:10.672424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-52eb8872-083f-4a4a-baa7-4973fc9a5e9e None None] MFA Rules not processed for user `0b01ee63cd4642e5849781e9a5a889c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:10.673797 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-52eb8872-083f-4a4a-baa7-4973fc9a5e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:10.707962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021407e-725f-46a4-973e-fb88877cb17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:10.708656 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021407e-725f-46a4-973e-fb88877cb17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:10.708935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021407e-725f-46a4-973e-fb88877cb17a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:10.709220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021407e-725f-46a4-973e-fb88877cb17a admin admin] PATH_INFO: `/v3/projects/576d6f0782b8448aa80592f1d49f7292` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:10.710356 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021407e-725f-46a4-973e-fb88877cb17a admin admin] RBAC: Authorizing `identity:delete_project(project_id=576d6f0782b8448aa80592f1d49f7292)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:10.710612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:10.712530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021407e-725f-46a4-973e-fb88877cb17a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:10.715676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:10.750537 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1348/2650] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:10 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:10.752368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb8872-083f-4a4a-baa7-4973fc9a5e9e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:10.766170 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb8872-083f-4a4a-baa7-4973fc9a5e9e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:10.771253 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260688c-b3e3-4df3-bc45-02ccadd81c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:10.773914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260688c-b3e3-4df3-bc45-02ccadd81c34 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:10.773914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260688c-b3e3-4df3-bc45-02ccadd81c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:10.773914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260688c-b3e3-4df3-bc45-02ccadd81c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:10.773914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260688c-b3e3-4df3-bc45-02ccadd81c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:10.775149 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260688c-b3e3-4df3-bc45-02ccadd81c34 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:10.892482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d021407e-725f-46a4-973e-fb88877cb17a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576d6f0782b8448aa80592f1d49f7292', 'request_id': 'req-d021407e-725f-46a4-973e-fb88877cb17a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:11.003444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1349/2651] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:10 2022] POST /identity/v3/projects => generated 409 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:06:11.004980 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260688c-b3e3-4df3-bc45-02ccadd81c34 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:11.006783 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d021407e-725f-46a4-973e-fb88877cb17a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576d6f0782b8448aa80592f1d49f7292', 'request_id': 'req-d021407e-725f-46a4-973e-fb88877cb17a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:11.020150 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d021407e-725f-46a4-973e-fb88877cb17a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576d6f0782b8448aa80592f1d49f7292', 'request_id': 'req-d021407e-725f-46a4-973e-fb88877cb17a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:11.036220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d021407e-725f-46a4-973e-fb88877cb17a admin admin] The token cache is being invalidate because project 576d6f0782b8448aa80592f1d49f7292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:06:11.036552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d021407e-725f-46a4-973e-fb88877cb17a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:11.037438 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-d021407e-725f-46a4-973e-fb88877cb17a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:11.040511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1303/2652] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:06:10 2022] DELETE /identity/v3/projects/576d6f0782b8448aa80592f1d49f7292 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:06:11.049633 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412d1fe-7e0c-4a51-be16-9f2e5b23fdfa None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.049953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412d1fe-7e0c-4a51-be16-9f2e5b23fdfa None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.050398 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412d1fe-7e0c-4a51-be16-9f2e5b23fdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.073859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-8412d1fe-7e0c-4a51-be16-9f2e5b23fdfa None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:11.075086 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8412d1fe-7e0c-4a51-be16-9f2e5b23fdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:11.095311 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260688c-b3e3-4df3-bc45-02ccadd81c34 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:11.099999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1882fc7-9680-4e6b-9bbc-1a1aa8a43a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:11.100636 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1882fc7-9680-4e6b-9bbc-1a1aa8a43a32 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.100998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1882fc7-9680-4e6b-9bbc-1a1aa8a43a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.101221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1882fc7-9680-4e6b-9bbc-1a1aa8a43a32 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.101847 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1882fc7-9680-4e6b-9bbc-1a1aa8a43a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:11.104490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1882fc7-9680-4e6b-9bbc-1a1aa8a43a32 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:11.140563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1304/2653] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:11.148386 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9d739-e91c-444a-ad47-9e8cc1e0f154 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.148608 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9d739-e91c-444a-ad47-9e8cc1e0f154 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.148883 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9d739-e91c-444a-ad47-9e8cc1e0f154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.168686 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-96d9d739-e91c-444a-ad47-9e8cc1e0f154 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:11.169917 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-96d9d739-e91c-444a-ad47-9e8cc1e0f154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:11.177859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1305/2654] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:11.182912 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9d739-e91c-444a-ad47-9e8cc1e0f154 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:11.191757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9d739-e91c-444a-ad47-9e8cc1e0f154 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:11.196469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ebb74-dda3-44fa-a303-616a072ca073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:11.201698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ebb74-dda3-44fa-a303-616a072ca073 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.201698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ebb74-dda3-44fa-a303-616a072ca073 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.201698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ebb74-dda3-44fa-a303-616a072ca073 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.201698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ebb74-dda3-44fa-a303-616a072ca073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:06:11.201698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ebb74-dda3-44fa-a303-616a072ca073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:11.201698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ebb74-dda3-44fa-a303-616a072ca073 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:11.211896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1306/2655] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:06:11.216806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ebb74-dda3-44fa-a303-616a072ca073 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:11.225653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1350/2656] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:11 2022] POST /identity/v3/users => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:11.226700 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ebb74-dda3-44fa-a303-616a072ca073 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:11.231590 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1882fc7-9680-4e6b-9bbc-1a1aa8a43a32 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:11.235992 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e698ae9-300b-4c26-83ef-339d420d91ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:11.236354 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-b1882fc7-9680-4e6b-9bbc-1a1aa8a43a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:11.236478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e698ae9-300b-4c26-83ef-339d420d91ba admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.236478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e698ae9-300b-4c26-83ef-339d420d91ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.236478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e698ae9-300b-4c26-83ef-339d420d91ba admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.236478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e698ae9-300b-4c26-83ef-339d420d91ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:11.237356 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e698ae9-300b-4c26-83ef-339d420d91ba admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:11.248465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1882fc7-9680-4e6b-9bbc-1a1aa8a43a32 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:11.255062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa917e4-53bc-4d3b-a5ed-c082f378b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:11.255724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa917e4-53bc-4d3b-a5ed-c082f378b7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.256006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa917e4-53bc-4d3b-a5ed-c082f378b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.256422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa917e4-53bc-4d3b-a5ed-c082f378b7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.259038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa917e4-53bc-4d3b-a5ed-c082f378b7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:11.259038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa917e4-53bc-4d3b-a5ed-c082f378b7e0 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:11.273934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1351/2657] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:11.276489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa917e4-53bc-4d3b-a5ed-c082f378b7e0 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:11.287771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa917e4-53bc-4d3b-a5ed-c082f378b7e0 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:11.293519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151528b-f2d6-42fa-b1f6-58e98a389de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:11.294185 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151528b-f2d6-42fa-b1f6-58e98a389de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.294471 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151528b-f2d6-42fa-b1f6-58e98a389de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.294781 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151528b-f2d6-42fa-b1f6-58e98a389de5 admin admin] PATH_INFO: `/v3/projects/ed843474010e4cfea5bf7dd095b66b7b/users/5d30246540894dd09e83638622ce6b1a/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.313215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1307/2658] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:11 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:06:11.317963 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e698ae9-300b-4c26-83ef-339d420d91ba admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:11.321229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151528b-f2d6-42fa-b1f6-58e98a389de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed843474010e4cfea5bf7dd095b66b7b, user_id=5d30246540894dd09e83638622ce6b1a, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:11.324426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151528b-f2d6-42fa-b1f6-58e98a389de5 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:11.370938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:11.382387 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e698ae9-300b-4c26-83ef-339d420d91ba admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:11.387398 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f028ade-3b72-4e5e-abe7-9dd19450582f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:11.387989 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f028ade-3b72-4e5e-abe7-9dd19450582f admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.388410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f028ade-3b72-4e5e-abe7-9dd19450582f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.388688 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f028ade-3b72-4e5e-abe7-9dd19450582f admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.389350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f028ade-3b72-4e5e-abe7-9dd19450582f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:11.391436 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f028ade-3b72-4e5e-abe7-9dd19450582f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:11.415345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1352/2659] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:11 2022] PUT /identity/v3/projects/ed843474010e4cfea5bf7dd095b66b7b/users/5d30246540894dd09e83638622ce6b1a/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:11.415345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151528b-f2d6-42fa-b1f6-58e98a389de5 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:11.476057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151528b-f2d6-42fa-b1f6-58e98a389de5 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:11.481787 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa8a8b-28dd-4b6a-8971-b8d34dc20348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:11.482390 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa8a8b-28dd-4b6a-8971-b8d34dc20348 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.482667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa8a8b-28dd-4b6a-8971-b8d34dc20348 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.482935 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa8a8b-28dd-4b6a-8971-b8d34dc20348 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.483570 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa8a8b-28dd-4b6a-8971-b8d34dc20348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:11.485261 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa8a8b-28dd-4b6a-8971-b8d34dc20348 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:11.500474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1353/2660] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:06:11.510353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa8a8b-28dd-4b6a-8971-b8d34dc20348 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:11.510485 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1308/2661] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:11 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:11.510585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:11.511304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f028ade-3b72-4e5e-abe7-9dd19450582f admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:11.512308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa8a8b-28dd-4b6a-8971-b8d34dc20348 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:11.517153 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4a273-3945-4264-b187-6a8e1deb69cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:11.518037 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4a273-3945-4264-b187-6a8e1deb69cf admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.518160 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4a273-3945-4264-b187-6a8e1deb69cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.518350 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4a273-3945-4264-b187-6a8e1deb69cf admin admin] PATH_INFO: `/v3/projects/ed843474010e4cfea5bf7dd095b66b7b/users/5d30246540894dd09e83638622ce6b1a/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.520423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4a273-3945-4264-b187-6a8e1deb69cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed843474010e4cfea5bf7dd095b66b7b, user_id=5d30246540894dd09e83638622ce6b1a, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:11.521810 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f028ade-3b72-4e5e-abe7-9dd19450582f admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:11.523097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4a273-3945-4264-b187-6a8e1deb69cf admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:11.527843 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10b806-bddf-40bd-b6ea-7e901161bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:11.528698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10b806-bddf-40bd-b6ea-7e901161bd31 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.529368 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10b806-bddf-40bd-b6ea-7e901161bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.529726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10b806-bddf-40bd-b6ea-7e901161bd31 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.530371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10b806-bddf-40bd-b6ea-7e901161bd31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:11.531974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10b806-bddf-40bd-b6ea-7e901161bd31 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:11.535161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1354/2662] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:11 2022] PUT /identity/v3/projects/ed843474010e4cfea5bf7dd095b66b7b/users/5d30246540894dd09e83638622ce6b1a/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:06:11.546138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1309/2663] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:11.547530 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4a273-3945-4264-b187-6a8e1deb69cf admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:11.552163 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116d669-2bc7-479b-bfa8-b8869cebdc54 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.552480 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116d669-2bc7-479b-bfa8-b8869cebdc54 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.552762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116d669-2bc7-479b-bfa8-b8869cebdc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.584507 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-b116d669-2bc7-479b-bfa8-b8869cebdc54 None None] MFA Rules not processed for user `5d30246540894dd09e83638622ce6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:11.585758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b116d669-2bc7-479b-bfa8-b8869cebdc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:11.617724 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4a273-3945-4264-b187-6a8e1deb69cf admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:11.623264 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df13e6-107e-4945-aad4-0b02add08e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:11.624381 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df13e6-107e-4945-aad4-0b02add08e1a admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.624381 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df13e6-107e-4945-aad4-0b02add08e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.624732 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df13e6-107e-4945-aad4-0b02add08e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.625534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df13e6-107e-4945-aad4-0b02add08e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:11.627151 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df13e6-107e-4945-aad4-0b02add08e1a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:11.638704 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1355/2664] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:11.642622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df13e6-107e-4945-aad4-0b02add08e1a admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:11.653342 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df13e6-107e-4945-aad4-0b02add08e1a admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:11.658360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7be1c-3838-40b0-9e61-88ed7df05d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:11.659044 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7be1c-3838-40b0-9e61-88ed7df05d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.659330 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7be1c-3838-40b0-9e61-88ed7df05d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.659644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7be1c-3838-40b0-9e61-88ed7df05d35 admin admin] PATH_INFO: `/v3/projects/f7de45ba5d124e2daf13d96cd1ec6c18/users/71c94932b7e2480c88103e141e46d004/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.664157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1310/2665] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:11 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:11.675740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116d669-2bc7-479b-bfa8-b8869cebdc54 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:11.679326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7be1c-3838-40b0-9e61-88ed7df05d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7de45ba5d124e2daf13d96cd1ec6c18, user_id=71c94932b7e2480c88103e141e46d004, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:11.679478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b116d669-2bc7-479b-bfa8-b8869cebdc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:11.679722 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7be1c-3838-40b0-9e61-88ed7df05d35 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:11.737762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116d669-2bc7-479b-bfa8-b8869cebdc54 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:11.741545 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf7931-9833-4725-b585-0f74a9b90065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:11.742198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf7931-9833-4725-b585-0f74a9b90065 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.742440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf7931-9833-4725-b585-0f74a9b90065 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.742708 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf7931-9833-4725-b585-0f74a9b90065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.752952 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf7931-9833-4725-b585-0f74a9b90065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:11.754983 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf7931-9833-4725-b585-0f74a9b90065 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:11.757276 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1356/2666] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:11 2022] PUT /identity/v3/projects/f7de45ba5d124e2daf13d96cd1ec6c18/users/71c94932b7e2480c88103e141e46d004/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:06:11.763150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b8556-4a3c-4581-998c-236f025bbcd4 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.763442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b8556-4a3c-4581-998c-236f025bbcd4 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.763723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b8556-4a3c-4581-998c-236f025bbcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.766777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1311/2667] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:11 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:06:11.784327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-c67b8556-4a3c-4581-998c-236f025bbcd4 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:11.785569 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c67b8556-4a3c-4581-998c-236f025bbcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:11.849992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1357/2668] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:11.861209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf7931-9833-4725-b585-0f74a9b90065 service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:11.862896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9ebf7931-9833-4725-b585-0f74a9b90065 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:11.923279 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf7931-9833-4725-b585-0f74a9b90065 service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:11.934522 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:11.977027 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700327c-6ee7-48fc-a6d9-883e0cc779ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:11.977641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700327c-6ee7-48fc-a6d9-883e0cc779ee service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:11.977921 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700327c-6ee7-48fc-a6d9-883e0cc779ee service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:11.978231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700327c-6ee7-48fc-a6d9-883e0cc779ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:11.987865 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700327c-6ee7-48fc-a6d9-883e0cc779ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:11.989279 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700327c-6ee7-48fc-a6d9-883e0cc779ee service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:12.001542 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1312/2669] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:12.176837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b8556-4a3c-4581-998c-236f025bbcd4 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:12.243307 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b8556-4a3c-4581-998c-236f025bbcd4 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:12.247727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4624eed-3b44-44fe-8082-d3731d494d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:12.248969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4624eed-3b44-44fe-8082-d3731d494d4d service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:12.248969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4624eed-3b44-44fe-8082-d3731d494d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:12.248969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4624eed-3b44-44fe-8082-d3731d494d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:12.250727 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f4624eed-3b44-44fe-8082-d3731d494d4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:12.268482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:12.309491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4624eed-3b44-44fe-8082-d3731d494d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:12.310961 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4624eed-3b44-44fe-8082-d3731d494d4d service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:12.321919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1358/2670] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:12 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:18.383520 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c5bd3-40b4-475f-9308-b44bf43d50ab None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:18.384081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c5bd3-40b4-475f-9308-b44bf43d50ab None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:18.384081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c5bd3-40b4-475f-9308-b44bf43d50ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:18.420850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-c77c5bd3-40b4-475f-9308-b44bf43d50ab None None] MFA Rules not processed for user `71c94932b7e2480c88103e141e46d004`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:18.423880 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c77c5bd3-40b4-475f-9308-b44bf43d50ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:18.511521 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1313/2671] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:18.516019 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4624eed-3b44-44fe-8082-d3731d494d4d service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:18.529739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4624eed-3b44-44fe-8082-d3731d494d4d service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:18.535767 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02d07c-701b-4743-9d32-f771bbd4fc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:18.536393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02d07c-701b-4743-9d32-f771bbd4fc1f admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:18.536772 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02d07c-701b-4743-9d32-f771bbd4fc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:18.537481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02d07c-701b-4743-9d32-f771bbd4fc1f admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:18.539258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02d07c-701b-4743-9d32-f771bbd4fc1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:18.541938 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02d07c-701b-4743-9d32-f771bbd4fc1f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:18.636232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1359/2672] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:18 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:18.640483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c5bd3-40b4-475f-9308-b44bf43d50ab None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:18.651733 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c5bd3-40b4-475f-9308-b44bf43d50ab None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:18.709493 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c08ce-4738-4776-b41f-36e228a80a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:18.710106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c08ce-4738-4776-b41f-36e228a80a3a admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:18.710390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c08ce-4738-4776-b41f-36e228a80a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:18.710666 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c08ce-4738-4776-b41f-36e228a80a3a admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:18.711316 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c08ce-4738-4776-b41f-36e228a80a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:18.714068 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c08ce-4738-4776-b41f-36e228a80a3a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:18.817466 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1314/2673] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:18 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:06:18.821869 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02d07c-701b-4743-9d32-f771bbd4fc1f admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:18.833174 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02d07c-701b-4743-9d32-f771bbd4fc1f admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:18.839561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69328516-4199-4922-85b5-33df4310f625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:18.840260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69328516-4199-4922-85b5-33df4310f625 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:18.840552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69328516-4199-4922-85b5-33df4310f625 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:18.840858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69328516-4199-4922-85b5-33df4310f625 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:18.841548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69328516-4199-4922-85b5-33df4310f625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:18.843193 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69328516-4199-4922-85b5-33df4310f625 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:18.857125 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1360/2674] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:06:18.861705 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c08ce-4738-4776-b41f-36e228a80a3a admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:18.873256 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c08ce-4738-4776-b41f-36e228a80a3a admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:18.878280 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e10c16-7476-461d-abe5-91bf7ebd1552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:18.878960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e10c16-7476-461d-abe5-91bf7ebd1552 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:18.879249 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e10c16-7476-461d-abe5-91bf7ebd1552 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:18.879533 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e10c16-7476-461d-abe5-91bf7ebd1552 admin admin] PATH_INFO: `/v3/projects/cbde6b2f485a47799e7d8216ac8f8431/users/819893e347ac40fc9548590416d20f8a/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:18.900595 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e10c16-7476-461d-abe5-91bf7ebd1552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbde6b2f485a47799e7d8216ac8f8431, user_id=819893e347ac40fc9548590416d20f8a, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:18.903519 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e10c16-7476-461d-abe5-91bf7ebd1552 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:18.984403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1315/2675] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:18 2022] PUT /identity/v3/projects/cbde6b2f485a47799e7d8216ac8f8431/users/819893e347ac40fc9548590416d20f8a/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:18.988408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69328516-4199-4922-85b5-33df4310f625 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:18.999172 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69328516-4199-4922-85b5-33df4310f625 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:19.059374 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f4685-0dbe-4873-8c84-f928071e30ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:19.059979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f4685-0dbe-4873-8c84-f928071e30ae admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:19.060295 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f4685-0dbe-4873-8c84-f928071e30ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:19.060578 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f4685-0dbe-4873-8c84-f928071e30ae admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:19.061243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f4685-0dbe-4873-8c84-f928071e30ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:19.062846 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f4685-0dbe-4873-8c84-f928071e30ae admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:19.077097 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1361/2676] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:19.081106 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e10c16-7476-461d-abe5-91bf7ebd1552 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:19.092581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e10c16-7476-461d-abe5-91bf7ebd1552 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:19.097610 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a13e69-a50a-4bf8-9044-6f4e705c7a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:19.102912 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13e69-a50a-4bf8-9044-6f4e705c7a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:19.102912 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13e69-a50a-4bf8-9044-6f4e705c7a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:19.102912 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13e69-a50a-4bf8-9044-6f4e705c7a4b admin admin] PATH_INFO: `/v3/projects/cbde6b2f485a47799e7d8216ac8f8431/users/819893e347ac40fc9548590416d20f8a/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:19.102912 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a13e69-a50a-4bf8-9044-6f4e705c7a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbde6b2f485a47799e7d8216ac8f8431, user_id=819893e347ac40fc9548590416d20f8a, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:19.104220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a13e69-a50a-4bf8-9044-6f4e705c7a4b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:19.112180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:19.118173 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1316/2677] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:19 2022] PUT /identity/v3/projects/cbde6b2f485a47799e7d8216ac8f8431/users/819893e347ac40fc9548590416d20f8a/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:06:19.828588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f4685-0dbe-4873-8c84-f928071e30ae admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:19.842576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f4685-0dbe-4873-8c84-f928071e30ae admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:19.922888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb3f90-f927-4934-8f35-a4eb1ba613e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:19.923798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb3f90-f927-4934-8f35-a4eb1ba613e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:19.924221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb3f90-f927-4934-8f35-a4eb1ba613e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:19.924572 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb3f90-f927-4934-8f35-a4eb1ba613e8 admin admin] PATH_INFO: `/v3/users/0b01ee63cd4642e5849781e9a5a889c9` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:19.929810 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb3f90-f927-4934-8f35-a4eb1ba613e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b01ee63cd4642e5849781e9a5a889c9)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:19.933775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb3f90-f927-4934-8f35-a4eb1ba613e8 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:19.973797 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:20.147533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-04bb3f90-f927-4934-8f35-a4eb1ba613e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b01ee63cd4642e5849781e9a5a889c9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:20.155329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-04bb3f90-f927-4934-8f35-a4eb1ba613e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b01ee63cd4642e5849781e9a5a889c9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:20.212128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-04bb3f90-f927-4934-8f35-a4eb1ba613e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b01ee63cd4642e5849781e9a5a889c9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:20.213667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-04bb3f90-f927-4934-8f35-a4eb1ba613e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b01ee63cd4642e5849781e9a5a889c9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:20.260076 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-04bb3f90-f927-4934-8f35-a4eb1ba613e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b01ee63cd4642e5849781e9a5a889c9'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:20.278340 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1362/2678] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:06:19 2022] DELETE /identity/v3/users/0b01ee63cd4642e5849781e9a5a889c9 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:20.280514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba19aad-9e7e-4f62-b08a-fa168a5de62e None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:20.280996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba19aad-9e7e-4f62-b08a-fa168a5de62e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:20.281122 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba19aad-9e7e-4f62-b08a-fa168a5de62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:20.316452 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-4ba19aad-9e7e-4f62-b08a-fa168a5de62e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:20.318487 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4ba19aad-9e7e-4f62-b08a-fa168a5de62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:20.394592 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1317/2679] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:20.404895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb3f90-f927-4934-8f35-a4eb1ba613e8 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:20.407516 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-04bb3f90-f927-4934-8f35-a4eb1ba613e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:20.476474 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb3f90-f927-4934-8f35-a4eb1ba613e8 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:20.481736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabeba5-6462-4ec4-a6a9-5ad8280abbc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:20.482363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabeba5-6462-4ec4-a6a9-5ad8280abbc3 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:20.482644 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabeba5-6462-4ec4-a6a9-5ad8280abbc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:20.482918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabeba5-6462-4ec4-a6a9-5ad8280abbc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:20.501704 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabeba5-6462-4ec4-a6a9-5ad8280abbc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:20.501704 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabeba5-6462-4ec4-a6a9-5ad8280abbc3 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:20.505845 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1363/2680] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:21.002823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba19aad-9e7e-4f62-b08a-fa168a5de62e None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:21.003973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-4ba19aad-9e7e-4f62-b08a-fa168a5de62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:21.016842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba19aad-9e7e-4f62-b08a-fa168a5de62e None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:21.022155 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6c33d-f364-41d2-921f-d30610edc9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:21.022872 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6c33d-f364-41d2-921f-d30610edc9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:21.023200 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6c33d-f364-41d2-921f-d30610edc9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:21.023501 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6c33d-f364-41d2-921f-d30610edc9a0 admin admin] PATH_INFO: `/v3/projects/332d497e30d4467487f7185f065d051d` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:21.024706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6c33d-f364-41d2-921f-d30610edc9a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=332d497e30d4467487f7185f065d051d)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:21.027076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6c33d-f364-41d2-921f-d30610edc9a0 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:21.197903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-55a6c33d-f364-41d2-921f-d30610edc9a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '332d497e30d4467487f7185f065d051d', 'request_id': 'req-55a6c33d-f364-41d2-921f-d30610edc9a0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:21.288413 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-55a6c33d-f364-41d2-921f-d30610edc9a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '332d497e30d4467487f7185f065d051d', 'request_id': 'req-55a6c33d-f364-41d2-921f-d30610edc9a0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:21.297950 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-55a6c33d-f364-41d2-921f-d30610edc9a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '332d497e30d4467487f7185f065d051d', 'request_id': 'req-55a6c33d-f364-41d2-921f-d30610edc9a0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:21.314394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-55a6c33d-f364-41d2-921f-d30610edc9a0 admin admin] The token cache is being invalidate because project 332d497e30d4467487f7185f065d051d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:06:21.315122 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-55a6c33d-f364-41d2-921f-d30610edc9a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:21.316151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-55a6c33d-f364-41d2-921f-d30610edc9a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:21.318642 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1318/2681] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:06:21 2022] DELETE /identity/v3/projects/332d497e30d4467487f7185f065d051d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:21.323318 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabeba5-6462-4ec4-a6a9-5ad8280abbc3 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:21.333658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabeba5-6462-4ec4-a6a9-5ad8280abbc3 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:21.425389 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1269c2-eb60-46e1-ba85-f0ab060c0889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:21.426919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1269c2-eb60-46e1-ba85-f0ab060c0889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:21.426919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1269c2-eb60-46e1-ba85-f0ab060c0889 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:21.427426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1269c2-eb60-46e1-ba85-f0ab060c0889 admin admin] PATH_INFO: `/v3/users/5d30246540894dd09e83638622ce6b1a` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:21.430595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1269c2-eb60-46e1-ba85-f0ab060c0889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d30246540894dd09e83638622ce6b1a)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:21.433301 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1269c2-eb60-46e1-ba85-f0ab060c0889 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:21.698138 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:21.722438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9f1269c2-eb60-46e1-ba85-f0ab060c0889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d30246540894dd09e83638622ce6b1a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:21.734420 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9f1269c2-eb60-46e1-ba85-f0ab060c0889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d30246540894dd09e83638622ce6b1a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:21.883690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9f1269c2-eb60-46e1-ba85-f0ab060c0889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d30246540894dd09e83638622ce6b1a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:21.883690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9f1269c2-eb60-46e1-ba85-f0ab060c0889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d30246540894dd09e83638622ce6b1a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:21.903816 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-9f1269c2-eb60-46e1-ba85-f0ab060c0889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d30246540894dd09e83638622ce6b1a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:21.918982 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1364/2682] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:06:21 2022] DELETE /identity/v3/users/5d30246540894dd09e83638622ce6b1a => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:22.453634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6c33d-f364-41d2-921f-d30610edc9a0 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:22.455236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-55a6c33d-f364-41d2-921f-d30610edc9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:22.477071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6c33d-f364-41d2-921f-d30610edc9a0 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:22.568690 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fbc18-3512-41f0-be4e-1e5c371383b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:22.569683 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fbc18-3512-41f0-be4e-1e5c371383b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:22.570304 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fbc18-3512-41f0-be4e-1e5c371383b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:22.570694 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fbc18-3512-41f0-be4e-1e5c371383b5 admin admin] PATH_INFO: `/v3/projects/ed843474010e4cfea5bf7dd095b66b7b` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:22.572980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fbc18-3512-41f0-be4e-1e5c371383b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed843474010e4cfea5bf7dd095b66b7b)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:22.576179 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fbc18-3512-41f0-be4e-1e5c371383b5 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:22.606164 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:22.727540 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b57fbc18-3512-41f0-be4e-1e5c371383b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed843474010e4cfea5bf7dd095b66b7b', 'request_id': 'req-b57fbc18-3512-41f0-be4e-1e5c371383b5'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:22.820715 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b57fbc18-3512-41f0-be4e-1e5c371383b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed843474010e4cfea5bf7dd095b66b7b', 'request_id': 'req-b57fbc18-3512-41f0-be4e-1e5c371383b5'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:22.835482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b57fbc18-3512-41f0-be4e-1e5c371383b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed843474010e4cfea5bf7dd095b66b7b', 'request_id': 'req-b57fbc18-3512-41f0-be4e-1e5c371383b5'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:22.851250 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b57fbc18-3512-41f0-be4e-1e5c371383b5 admin admin] The token cache is being invalidate because project ed843474010e4cfea5bf7dd095b66b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:06:22.851550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b57fbc18-3512-41f0-be4e-1e5c371383b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:22.852715 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b57fbc18-3512-41f0-be4e-1e5c371383b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:22.854514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1319/2683] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:06:22 2022] DELETE /identity/v3/projects/ed843474010e4cfea5bf7dd095b66b7b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:06:22.860312 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db9a07-cd56-476a-bd50-7cb3b80c23f6 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:22.861291 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db9a07-cd56-476a-bd50-7cb3b80c23f6 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:22.861643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db9a07-cd56-476a-bd50-7cb3b80c23f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:22.883776 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-60db9a07-cd56-476a-bd50-7cb3b80c23f6 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:22.885942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-60db9a07-cd56-476a-bd50-7cb3b80c23f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:23.004448 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1365/2684] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:23.012869 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786941e-2da2-4947-b2cb-04fa5c6fc50a None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:23.015895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786941e-2da2-4947-b2cb-04fa5c6fc50a None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:23.015895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786941e-2da2-4947-b2cb-04fa5c6fc50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:23.038994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-0786941e-2da2-4947-b2cb-04fa5c6fc50a None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:23.040442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0786941e-2da2-4947-b2cb-04fa5c6fc50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:23.049286 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1320/2685] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:23.053695 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db9a07-cd56-476a-bd50-7cb3b80c23f6 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:23.065251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db9a07-cd56-476a-bd50-7cb3b80c23f6 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:23.071326 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bc2af-f118-48ad-8b95-d0ed0eaefa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:23.073322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bc2af-f118-48ad-8b95-d0ed0eaefa80 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:23.078053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bc2af-f118-48ad-8b95-d0ed0eaefa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:23.078053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bc2af-f118-48ad-8b95-d0ed0eaefa80 admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:23.078053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bc2af-f118-48ad-8b95-d0ed0eaefa80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:06:23.078053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bc2af-f118-48ad-8b95-d0ed0eaefa80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:23.078053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bc2af-f118-48ad-8b95-d0ed0eaefa80 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:23.092114 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1366/2686] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:06:23.096571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786941e-2da2-4947-b2cb-04fa5c6fc50a None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:23.115004 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786941e-2da2-4947-b2cb-04fa5c6fc50a None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:23.128403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b513a5c-7510-422f-869b-ceeadb12a98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:23.129038 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b513a5c-7510-422f-869b-ceeadb12a98b admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:23.129321 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b513a5c-7510-422f-869b-ceeadb12a98b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:23.129605 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b513a5c-7510-422f-869b-ceeadb12a98b admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:23.130230 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b513a5c-7510-422f-869b-ceeadb12a98b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:23.132123 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b513a5c-7510-422f-869b-ceeadb12a98b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:23.233986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1321/2687] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:23 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:23.236529 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bc2af-f118-48ad-8b95-d0ed0eaefa80 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:23.248949 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bc2af-f118-48ad-8b95-d0ed0eaefa80 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:23.328556 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e299d-de9c-4a5d-88a4-62f51f94fb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:23.329537 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e299d-de9c-4a5d-88a4-62f51f94fb68 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:23.330038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e299d-de9c-4a5d-88a4-62f51f94fb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:23.330510 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e299d-de9c-4a5d-88a4-62f51f94fb68 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:23.331282 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e299d-de9c-4a5d-88a4-62f51f94fb68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:23.333850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e299d-de9c-4a5d-88a4-62f51f94fb68 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:23.450024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1367/2688] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:23 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:23.452942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b513a5c-7510-422f-869b-ceeadb12a98b admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:23.466499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b513a5c-7510-422f-869b-ceeadb12a98b admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:23.475195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811dd32-0ce7-445e-b8f0-dc11970bb128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:23.475836 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811dd32-0ce7-445e-b8f0-dc11970bb128 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:23.476118 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811dd32-0ce7-445e-b8f0-dc11970bb128 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:23.476625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811dd32-0ce7-445e-b8f0-dc11970bb128 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:23.477497 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811dd32-0ce7-445e-b8f0-dc11970bb128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:23.480227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811dd32-0ce7-445e-b8f0-dc11970bb128 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:23.494021 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1322/2689] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:23.497830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e299d-de9c-4a5d-88a4-62f51f94fb68 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:23.513797 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e299d-de9c-4a5d-88a4-62f51f94fb68 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:23.520620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d16e5-6b02-4191-be43-d8e0b2a904e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:23.521639 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d16e5-6b02-4191-be43-d8e0b2a904e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:23.526416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d16e5-6b02-4191-be43-d8e0b2a904e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:23.526416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d16e5-6b02-4191-be43-d8e0b2a904e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:23.526416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d16e5-6b02-4191-be43-d8e0b2a904e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:23.526416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d16e5-6b02-4191-be43-d8e0b2a904e6 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:23.547232 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1368/2690] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:23.549375 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811dd32-0ce7-445e-b8f0-dc11970bb128 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:23.565445 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811dd32-0ce7-445e-b8f0-dc11970bb128 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:23.577023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf3369-3403-4035-b9dc-dbaa181a19dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:23.577659 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf3369-3403-4035-b9dc-dbaa181a19dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:23.577926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf3369-3403-4035-b9dc-dbaa181a19dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:23.578201 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf3369-3403-4035-b9dc-dbaa181a19dd admin admin] PATH_INFO: `/v3/projects/9b70f334a23845cfaa1f46da493474a0/users/6bbf0d4ceea14947afbd7cc5aa704bbe/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:23.608151 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf3369-3403-4035-b9dc-dbaa181a19dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b70f334a23845cfaa1f46da493474a0, user_id=6bbf0d4ceea14947afbd7cc5aa704bbe, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:23.611648 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf3369-3403-4035-b9dc-dbaa181a19dd admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:23.685844 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1323/2691] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:23 2022] PUT /identity/v3/projects/9b70f334a23845cfaa1f46da493474a0/users/6bbf0d4ceea14947afbd7cc5aa704bbe/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:23.699216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e9c46-6ab6-45a7-a837-50a076455145 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:23.699611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e9c46-6ab6-45a7-a837-50a076455145 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:23.700297 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e9c46-6ab6-45a7-a837-50a076455145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:23.733001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-312e9c46-6ab6-45a7-a837-50a076455145 None None] MFA Rules not processed for user `6bbf0d4ceea14947afbd7cc5aa704bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:23.734242 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-312e9c46-6ab6-45a7-a837-50a076455145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:23.751673 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:23.802984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1369/2692] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:23.807794 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf3369-3403-4035-b9dc-dbaa181a19dd admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:23.900872 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf3369-3403-4035-b9dc-dbaa181a19dd admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:23.906112 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2ec9d-9b14-440f-b249-8fa625587eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:23.906664 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2ec9d-9b14-440f-b249-8fa625587eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:23.907069 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2ec9d-9b14-440f-b249-8fa625587eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:23.907411 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2ec9d-9b14-440f-b249-8fa625587eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:23.908371 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2ec9d-9b14-440f-b249-8fa625587eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:23.910477 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2ec9d-9b14-440f-b249-8fa625587eb7 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:24.039889 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1324/2693] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:23 2022] POST /identity/v3/projects => generated 379 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:24.043058 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e9c46-6ab6-45a7-a837-50a076455145 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:24.068015 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e9c46-6ab6-45a7-a837-50a076455145 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:24.148470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15924a5c-b49e-44c5-869e-09fb66fc9e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:24.149895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15924a5c-b49e-44c5-869e-09fb66fc9e62 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:24.150246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15924a5c-b49e-44c5-869e-09fb66fc9e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:24.150532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15924a5c-b49e-44c5-869e-09fb66fc9e62 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:24.151942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15924a5c-b49e-44c5-869e-09fb66fc9e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:24.154222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15924a5c-b49e-44c5-869e-09fb66fc9e62 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:24.255691 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1370/2694] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:24 2022] POST /identity/v3/users => generated 290 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:24.261174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2ec9d-9b14-440f-b249-8fa625587eb7 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:24.274081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2ec9d-9b14-440f-b249-8fa625587eb7 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:24.295733 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c085c0-426b-4997-adee-903f9f212147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:24.296531 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c085c0-426b-4997-adee-903f9f212147 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:24.296910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c085c0-426b-4997-adee-903f9f212147 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:24.297317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c085c0-426b-4997-adee-903f9f212147 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:24.298189 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c085c0-426b-4997-adee-903f9f212147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:24.299938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c085c0-426b-4997-adee-903f9f212147 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:24.324814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1325/2695] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:24.328867 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15924a5c-b49e-44c5-869e-09fb66fc9e62 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:24.344027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15924a5c-b49e-44c5-869e-09fb66fc9e62 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:24.363494 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98a7ef-7a09-4641-841e-03dc0aa6e940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:24.366689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98a7ef-7a09-4641-841e-03dc0aa6e940 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:24.366689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98a7ef-7a09-4641-841e-03dc0aa6e940 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:24.366689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98a7ef-7a09-4641-841e-03dc0aa6e940 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:24.366689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98a7ef-7a09-4641-841e-03dc0aa6e940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:24.367093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98a7ef-7a09-4641-841e-03dc0aa6e940 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:24.386779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1371/2696] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:24.391022 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c085c0-426b-4997-adee-903f9f212147 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:24.403956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c085c0-426b-4997-adee-903f9f212147 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:24.418859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a7cfd-a658-4430-8ca2-1e3108c9726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:24.419822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a7cfd-a658-4430-8ca2-1e3108c9726f admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:24.420323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a7cfd-a658-4430-8ca2-1e3108c9726f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:24.421228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a7cfd-a658-4430-8ca2-1e3108c9726f admin admin] PATH_INFO: `/v3/projects/8d68f716d4714b38812462fca4ec9b04/users/ad3698bd90414b64a4b4176244ce40d1/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:24.448830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a7cfd-a658-4430-8ca2-1e3108c9726f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d68f716d4714b38812462fca4ec9b04, user_id=ad3698bd90414b64a4b4176244ce40d1, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:24.450888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a7cfd-a658-4430-8ca2-1e3108c9726f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:24.545942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:24.552382 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1326/2697] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:24 2022] PUT /identity/v3/projects/8d68f716d4714b38812462fca4ec9b04/users/ad3698bd90414b64a4b4176244ce40d1/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:24.563798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3fd79-232c-4ca8-876f-7bc7f9d0b036 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:24.564099 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3fd79-232c-4ca8-876f-7bc7f9d0b036 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:24.564417 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3fd79-232c-4ca8-876f-7bc7f9d0b036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:24.607482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-1fb3fd79-232c-4ca8-876f-7bc7f9d0b036 None None] MFA Rules not processed for user `ad3698bd90414b64a4b4176244ce40d1`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:24.609166 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-1fb3fd79-232c-4ca8-876f-7bc7f9d0b036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:24.699518 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1372/2698] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:24.704279 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a7cfd-a658-4430-8ca2-1e3108c9726f admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:24.784168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a7cfd-a658-4430-8ca2-1e3108c9726f admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:24.789971 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cebce-4418-4c37-9edb-a1ea9c865c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:24.791150 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cebce-4418-4c37-9edb-a1ea9c865c2e admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:24.791789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cebce-4418-4c37-9edb-a1ea9c865c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:24.791789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cebce-4418-4c37-9edb-a1ea9c865c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:24.792483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2cebce-4418-4c37-9edb-a1ea9c865c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:24.794438 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2cebce-4418-4c37-9edb-a1ea9c865c2e admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:24.885721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1327/2699] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:24 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:06:24.890907 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3fd79-232c-4ca8-876f-7bc7f9d0b036 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:24.905146 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3fd79-232c-4ca8-876f-7bc7f9d0b036 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:25.069959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:25.109737 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca30e95-9f2f-426a-a54e-d3be8ba3f1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:25.110489 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca30e95-9f2f-426a-a54e-d3be8ba3f1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:25.110770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca30e95-9f2f-426a-a54e-d3be8ba3f1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:25.111046 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca30e95-9f2f-426a-a54e-d3be8ba3f1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:25.111732 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca30e95-9f2f-426a-a54e-d3be8ba3f1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:25.114064 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca30e95-9f2f-426a-a54e-d3be8ba3f1f9 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:25.195878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1373/2700] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:24 2022] POST /identity/v3/users => generated 294 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:25.202654 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cebce-4418-4c37-9edb-a1ea9c865c2e admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:25.214969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cebce-4418-4c37-9edb-a1ea9c865c2e admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:25.221729 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956727f-96f4-47c2-a22a-8e2307453d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:25.222372 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956727f-96f4-47c2-a22a-8e2307453d9c admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:25.222656 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956727f-96f4-47c2-a22a-8e2307453d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:25.222916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956727f-96f4-47c2-a22a-8e2307453d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:25.223732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956727f-96f4-47c2-a22a-8e2307453d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:25.225372 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956727f-96f4-47c2-a22a-8e2307453d9c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:25.253312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1328/2701] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:25.254591 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca30e95-9f2f-426a-a54e-d3be8ba3f1f9 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:25.271774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca30e95-9f2f-426a-a54e-d3be8ba3f1f9 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:25.276392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada7331-19c8-49e7-a06d-dce52411dc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:25.277175 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada7331-19c8-49e7-a06d-dce52411dc32 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:25.277478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada7331-19c8-49e7-a06d-dce52411dc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:25.277868 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada7331-19c8-49e7-a06d-dce52411dc32 admin admin] PATH_INFO: `/v3/projects/c104d3a3f0324246913037e2a9097a74/users/b690a4ed872543a9b88fe4ddcce7467f/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:25.297634 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada7331-19c8-49e7-a06d-dce52411dc32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c104d3a3f0324246913037e2a9097a74, user_id=b690a4ed872543a9b88fe4ddcce7467f, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:25.300408 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada7331-19c8-49e7-a06d-dce52411dc32 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:25.379893 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1374/2702] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:25 2022] PUT /identity/v3/projects/c104d3a3f0324246913037e2a9097a74/users/b690a4ed872543a9b88fe4ddcce7467f/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:25.384908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956727f-96f4-47c2-a22a-8e2307453d9c admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:25.408486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956727f-96f4-47c2-a22a-8e2307453d9c admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:25.445204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c773b54-6484-4d07-81d3-ea086dd1877e None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:25.445498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c773b54-6484-4d07-81d3-ea086dd1877e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:25.445778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c773b54-6484-4d07-81d3-ea086dd1877e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:25.484468 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-0c773b54-6484-4d07-81d3-ea086dd1877e None None] MFA Rules not processed for user `819893e347ac40fc9548590416d20f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:25.485711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-0c773b54-6484-4d07-81d3-ea086dd1877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:25.518772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe157263-6825-42f8-b4c5-1386c9c4006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:25.519672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe157263-6825-42f8-b4c5-1386c9c4006d admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:25.519835 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe157263-6825-42f8-b4c5-1386c9c4006d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:25.520046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe157263-6825-42f8-b4c5-1386c9c4006d admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:25.521709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe157263-6825-42f8-b4c5-1386c9c4006d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:25.526171 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe157263-6825-42f8-b4c5-1386c9c4006d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:25.546281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1329/2703] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:25.548020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe157263-6825-42f8-b4c5-1386c9c4006d admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:25.570946 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe157263-6825-42f8-b4c5-1386c9c4006d admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:25.580987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96165d-f4a0-45ec-aa04-02a1d76c351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:25.582065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96165d-f4a0-45ec-aa04-02a1d76c351c admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:25.582415 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96165d-f4a0-45ec-aa04-02a1d76c351c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:25.582762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96165d-f4a0-45ec-aa04-02a1d76c351c admin admin] PATH_INFO: `/v3/projects/c104d3a3f0324246913037e2a9097a74/users/b690a4ed872543a9b88fe4ddcce7467f/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:25.591377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1375/2704] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:25.591511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96165d-f4a0-45ec-aa04-02a1d76c351c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c104d3a3f0324246913037e2a9097a74, user_id=b690a4ed872543a9b88fe4ddcce7467f, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:25.592748 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96165d-f4a0-45ec-aa04-02a1d76c351c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:25.602010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c773b54-6484-4d07-81d3-ea086dd1877e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:25.604627 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-0c773b54-6484-4d07-81d3-ea086dd1877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:25.607135 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1330/2705] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:25 2022] PUT /identity/v3/projects/c104d3a3f0324246913037e2a9097a74/users/b690a4ed872543a9b88fe4ddcce7467f/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:25.617661 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276a8d6-5528-48ad-981b-7281e8df55dd None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:25.617865 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276a8d6-5528-48ad-981b-7281e8df55dd None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:25.618138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276a8d6-5528-48ad-981b-7281e8df55dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:25.647867 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-5276a8d6-5528-48ad-981b-7281e8df55dd None None] MFA Rules not processed for user `b690a4ed872543a9b88fe4ddcce7467f`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:25.649160 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5276a8d6-5528-48ad-981b-7281e8df55dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:25.670328 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c773b54-6484-4d07-81d3-ea086dd1877e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:25.701011 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:25.704224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:25.724322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfa1b9-0d8f-4565-a643-4d3b9811f4a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e72cc048a0418cac062d68b8df402f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:25.724939 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfa1b9-0d8f-4565-a643-4d3b9811f4a5 service glance] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:25.725220 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfa1b9-0d8f-4565-a643-4d3b9811f4a5 service glance] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:25.725493 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfa1b9-0d8f-4565-a643-4d3b9811f4a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:25.727758 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1331/2706] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:25.728000 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-eacfa1b9-0d8f-4565-a643-4d3b9811f4a5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:25.740238 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276a8d6-5528-48ad-981b-7281e8df55dd None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:25.742000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5276a8d6-5528-48ad-981b-7281e8df55dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:25.813813 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfa1b9-0d8f-4565-a643-4d3b9811f4a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:25.816836 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfa1b9-0d8f-4565-a643-4d3b9811f4a5 service glance] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:25.828587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1376/2707] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:06:25.831365 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276a8d6-5528-48ad-981b-7281e8df55dd None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:25.835735 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f9e0a-c21a-416c-97b0-0daed939f4b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:25.836389 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f9e0a-c21a-416c-97b0-0daed939f4b6 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:25.836672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f9e0a-c21a-416c-97b0-0daed939f4b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:25.836947 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f9e0a-c21a-416c-97b0-0daed939f4b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:25.848219 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f9e0a-c21a-416c-97b0-0daed939f4b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:25.849668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f9e0a-c21a-416c-97b0-0daed939f4b6 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:25.863704 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1332/2708] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:26.007770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfa1b9-0d8f-4565-a643-4d3b9811f4a5 service glance] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:26.010739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-eacfa1b9-0d8f-4565-a643-4d3b9811f4a5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:26.028479 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfa1b9-0d8f-4565-a643-4d3b9811f4a5 service glance] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:26.032763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c56293-a20b-4ff4-82da-2ae3b0c9b990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:26.033477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c56293-a20b-4ff4-82da-2ae3b0c9b990 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:26.033825 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c56293-a20b-4ff4-82da-2ae3b0c9b990 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:26.035084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c56293-a20b-4ff4-82da-2ae3b0c9b990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:26.110208 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c56293-a20b-4ff4-82da-2ae3b0c9b990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:26.111864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c56293-a20b-4ff4-82da-2ae3b0c9b990 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:26.123601 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1377/2709] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:26.144499 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e0217-3dad-4695-9dca-ab90651c74f0 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:26.144813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e0217-3dad-4695-9dca-ab90651c74f0 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:26.145089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e0217-3dad-4695-9dca-ab90651c74f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:26.179630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-5b5e0217-3dad-4695-9dca-ab90651c74f0 None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:26.181955 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5b5e0217-3dad-4695-9dca-ab90651c74f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:26.249196 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1333/2710] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Aug 29 23:06:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:26.406532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c56293-a20b-4ff4-82da-2ae3b0c9b990 service cinder] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:26.408384 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d6c56293-a20b-4ff4-82da-2ae3b0c9b990 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:26.497940 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c56293-a20b-4ff4-82da-2ae3b0c9b990 service cinder] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:26.505892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f7446-f5b9-4c96-93ba-7b554ab27147 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:26.506576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f7446-f5b9-4c96-93ba-7b554ab27147 service swift] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:26.506850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f7446-f5b9-4c96-93ba-7b554ab27147 service swift] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:26.507122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f7446-f5b9-4c96-93ba-7b554ab27147 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:26.516936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f7446-f5b9-4c96-93ba-7b554ab27147 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:26.518694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f7446-f5b9-4c96-93ba-7b554ab27147 service swift] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:26.528270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1378/2711] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 23:06:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:06:30.787814 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e0217-3dad-4695-9dca-ab90651c74f0 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:30.901298 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e0217-3dad-4695-9dca-ab90651c74f0 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:30.916598 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a2156-8ec1-4a4e-b49a-91e779de4bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:30.917328 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a2156-8ec1-4a4e-b49a-91e779de4bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:30.917717 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a2156-8ec1-4a4e-b49a-91e779de4bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:30.917857 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a2156-8ec1-4a4e-b49a-91e779de4bfb admin admin] PATH_INFO: `/v3/users/6bbf0d4ceea14947afbd7cc5aa704bbe` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:30.919260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a2156-8ec1-4a4e-b49a-91e779de4bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bbf0d4ceea14947afbd7cc5aa704bbe)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:30.921411 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a2156-8ec1-4a4e-b49a-91e779de4bfb admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:30.924410 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=100 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:31.183755 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fb6a2156-8ec1-4a4e-b49a-91e779de4bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bbf0d4ceea14947afbd7cc5aa704bbe'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:31.184486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fb6a2156-8ec1-4a4e-b49a-91e779de4bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bbf0d4ceea14947afbd7cc5aa704bbe'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:31.185117 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fb6a2156-8ec1-4a4e-b49a-91e779de4bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bbf0d4ceea14947afbd7cc5aa704bbe'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:31.204658 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fb6a2156-8ec1-4a4e-b49a-91e779de4bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bbf0d4ceea14947afbd7cc5aa704bbe'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:31.214937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-fb6a2156-8ec1-4a4e-b49a-91e779de4bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bbf0d4ceea14947afbd7cc5aa704bbe'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:31.298613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1334/2712] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:06:30 2022] DELETE /identity/v3/users/6bbf0d4ceea14947afbd7cc5aa704bbe => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:06:31.305306 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017a2c6-2d82-48b4-8b97-2c44f922eba5 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:31.306431 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017a2c6-2d82-48b4-8b97-2c44f922eba5 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:31.306952 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017a2c6-2d82-48b4-8b97-2c44f922eba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:31.329331 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-f017a2c6-2d82-48b4-8b97-2c44f922eba5 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:31.330854 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f017a2c6-2d82-48b4-8b97-2c44f922eba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:31.343641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:31.427010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1379/2713] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:31.438900 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a2156-8ec1-4a4e-b49a-91e779de4bfb admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:31.440355 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-fb6a2156-8ec1-4a4e-b49a-91e779de4bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:31.525288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a2156-8ec1-4a4e-b49a-91e779de4bfb admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:31.529318 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018e031-5ab9-4773-8612-73972bf1a3bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:31.529959 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018e031-5ab9-4773-8612-73972bf1a3bf service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:31.530246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018e031-5ab9-4773-8612-73972bf1a3bf service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:31.530525 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018e031-5ab9-4773-8612-73972bf1a3bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:31.543179 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018e031-5ab9-4773-8612-73972bf1a3bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:31.544684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018e031-5ab9-4773-8612-73972bf1a3bf service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:31.556928 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1335/2714] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:32.085683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017a2c6-2d82-48b4-8b97-2c44f922eba5 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:32.087309 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f017a2c6-2d82-48b4-8b97-2c44f922eba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:32.116062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017a2c6-2d82-48b4-8b97-2c44f922eba5 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:32.125382 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12246841-fb31-43d6-8301-5f083b21913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:32.126343 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12246841-fb31-43d6-8301-5f083b21913f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:32.126864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12246841-fb31-43d6-8301-5f083b21913f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:32.127465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12246841-fb31-43d6-8301-5f083b21913f admin admin] PATH_INFO: `/v3/projects/9b70f334a23845cfaa1f46da493474a0` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:32.128840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12246841-fb31-43d6-8301-5f083b21913f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b70f334a23845cfaa1f46da493474a0)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:32.130892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12246841-fb31-43d6-8301-5f083b21913f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:32.293822 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-12246841-fb31-43d6-8301-5f083b21913f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b70f334a23845cfaa1f46da493474a0', 'request_id': 'req-12246841-fb31-43d6-8301-5f083b21913f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:32.302500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-12246841-fb31-43d6-8301-5f083b21913f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b70f334a23845cfaa1f46da493474a0', 'request_id': 'req-12246841-fb31-43d6-8301-5f083b21913f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:32.309993 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-12246841-fb31-43d6-8301-5f083b21913f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b70f334a23845cfaa1f46da493474a0', 'request_id': 'req-12246841-fb31-43d6-8301-5f083b21913f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:32.376563 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-12246841-fb31-43d6-8301-5f083b21913f admin admin] The token cache is being invalidate because project 9b70f334a23845cfaa1f46da493474a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:06:32.376857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-12246841-fb31-43d6-8301-5f083b21913f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:32.378663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-12246841-fb31-43d6-8301-5f083b21913f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:32.379154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1380/2715] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:06:32 2022] DELETE /identity/v3/projects/9b70f334a23845cfaa1f46da493474a0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:06:32.383283 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018e031-5ab9-4773-8612-73972bf1a3bf service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:32.394762 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018e031-5ab9-4773-8612-73972bf1a3bf service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:32.481099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fd2d4-ee9a-4d60-abb0-d76b57abe35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:32.481789 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fd2d4-ee9a-4d60-abb0-d76b57abe35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:32.482139 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fd2d4-ee9a-4d60-abb0-d76b57abe35c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:32.482420 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fd2d4-ee9a-4d60-abb0-d76b57abe35c admin admin] PATH_INFO: `/v3/users/ad3698bd90414b64a4b4176244ce40d1` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:32.483998 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fd2d4-ee9a-4d60-abb0-d76b57abe35c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3698bd90414b64a4b4176244ce40d1)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:32.486011 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fd2d4-ee9a-4d60-abb0-d76b57abe35c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:32.523703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:32.748365 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-248fd2d4-ee9a-4d60-abb0-d76b57abe35c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3698bd90414b64a4b4176244ce40d1'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:32.749078 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-248fd2d4-ee9a-4d60-abb0-d76b57abe35c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3698bd90414b64a4b4176244ce40d1'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:32.749697 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-248fd2d4-ee9a-4d60-abb0-d76b57abe35c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3698bd90414b64a4b4176244ce40d1'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:32.766295 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-248fd2d4-ee9a-4d60-abb0-d76b57abe35c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3698bd90414b64a4b4176244ce40d1'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:32.774205 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-248fd2d4-ee9a-4d60-abb0-d76b57abe35c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3698bd90414b64a4b4176244ce40d1'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:33.276891 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1336/2716] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:06:32 2022] DELETE /identity/v3/users/ad3698bd90414b64a4b4176244ce40d1 => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:33.830825 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12246841-fb31-43d6-8301-5f083b21913f admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:33.832540 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-12246841-fb31-43d6-8301-5f083b21913f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:33.851577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12246841-fb31-43d6-8301-5f083b21913f admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:33.928257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df859ad7-b980-47d0-a160-27e402a7ff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:33.928257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df859ad7-b980-47d0-a160-27e402a7ff9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:33.928257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df859ad7-b980-47d0-a160-27e402a7ff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:33.928257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df859ad7-b980-47d0-a160-27e402a7ff9b admin admin] PATH_INFO: `/v3/projects/8d68f716d4714b38812462fca4ec9b04` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:33.929514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df859ad7-b980-47d0-a160-27e402a7ff9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d68f716d4714b38812462fca4ec9b04)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:33.932585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df859ad7-b980-47d0-a160-27e402a7ff9b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:34.071084 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:34.078443 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-df859ad7-b980-47d0-a160-27e402a7ff9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d68f716d4714b38812462fca4ec9b04', 'request_id': 'req-df859ad7-b980-47d0-a160-27e402a7ff9b'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:34.088902 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-df859ad7-b980-47d0-a160-27e402a7ff9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d68f716d4714b38812462fca4ec9b04', 'request_id': 'req-df859ad7-b980-47d0-a160-27e402a7ff9b'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:34.094941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-df859ad7-b980-47d0-a160-27e402a7ff9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d68f716d4714b38812462fca4ec9b04', 'request_id': 'req-df859ad7-b980-47d0-a160-27e402a7ff9b'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:34.161789 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-df859ad7-b980-47d0-a160-27e402a7ff9b admin admin] The token cache is being invalidate because project 8d68f716d4714b38812462fca4ec9b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:06:34.162163 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-df859ad7-b980-47d0-a160-27e402a7ff9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:34.163221 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-df859ad7-b980-47d0-a160-27e402a7ff9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:34.164858 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1381/2717] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:06:33 2022] DELETE /identity/v3/projects/8d68f716d4714b38812462fca4ec9b04 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:34.168996 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fd2d4-ee9a-4d60-abb0-d76b57abe35c admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:34.170512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-248fd2d4-ee9a-4d60-abb0-d76b57abe35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:34.187116 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fd2d4-ee9a-4d60-abb0-d76b57abe35c admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:34.266012 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21acbfe-88db-441d-8718-e149e3d556dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:34.266664 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21acbfe-88db-441d-8718-e149e3d556dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:34.266946 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21acbfe-88db-441d-8718-e149e3d556dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:34.267224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21acbfe-88db-441d-8718-e149e3d556dd admin admin] PATH_INFO: `/v3/users/b690a4ed872543a9b88fe4ddcce7467f` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:34.268554 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21acbfe-88db-441d-8718-e149e3d556dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b690a4ed872543a9b88fe4ddcce7467f)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:34.270498 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21acbfe-88db-441d-8718-e149e3d556dd admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:34.456987 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b21acbfe-88db-441d-8718-e149e3d556dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b690a4ed872543a9b88fe4ddcce7467f'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:34.463334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b21acbfe-88db-441d-8718-e149e3d556dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b690a4ed872543a9b88fe4ddcce7467f'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:34.465312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b21acbfe-88db-441d-8718-e149e3d556dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b690a4ed872543a9b88fe4ddcce7467f'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:34.490640 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b21acbfe-88db-441d-8718-e149e3d556dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b690a4ed872543a9b88fe4ddcce7467f'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:34.506123 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b21acbfe-88db-441d-8718-e149e3d556dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b690a4ed872543a9b88fe4ddcce7467f'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:34.608026 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1337/2718] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:06:34 2022] DELETE /identity/v3/users/b690a4ed872543a9b88fe4ddcce7467f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:35.159220 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df859ad7-b980-47d0-a160-27e402a7ff9b admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:35.161335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-df859ad7-b980-47d0-a160-27e402a7ff9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:35.186951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df859ad7-b980-47d0-a160-27e402a7ff9b admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:35.258770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ec50a-87da-44aa-acf3-93ed9d8131cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:35.260368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ec50a-87da-44aa-acf3-93ed9d8131cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:35.260368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ec50a-87da-44aa-acf3-93ed9d8131cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:35.260368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ec50a-87da-44aa-acf3-93ed9d8131cc admin admin] PATH_INFO: `/v3/projects/c104d3a3f0324246913037e2a9097a74` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:35.261762 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ec50a-87da-44aa-acf3-93ed9d8131cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c104d3a3f0324246913037e2a9097a74)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:35.263696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ec50a-87da-44aa-acf3-93ed9d8131cc admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:35.414864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b01ec50a-87da-44aa-acf3-93ed9d8131cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c104d3a3f0324246913037e2a9097a74', 'request_id': 'req-b01ec50a-87da-44aa-acf3-93ed9d8131cc'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:35.422496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b01ec50a-87da-44aa-acf3-93ed9d8131cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c104d3a3f0324246913037e2a9097a74', 'request_id': 'req-b01ec50a-87da-44aa-acf3-93ed9d8131cc'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:35.428947 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b01ec50a-87da-44aa-acf3-93ed9d8131cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c104d3a3f0324246913037e2a9097a74', 'request_id': 'req-b01ec50a-87da-44aa-acf3-93ed9d8131cc'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:35.524552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b01ec50a-87da-44aa-acf3-93ed9d8131cc admin admin] The token cache is being invalidate because project c104d3a3f0324246913037e2a9097a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:06:35.524888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b01ec50a-87da-44aa-acf3-93ed9d8131cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:35.525686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b01ec50a-87da-44aa-acf3-93ed9d8131cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:35.527216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1382/2719] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:06:35 2022] DELETE /identity/v3/projects/c104d3a3f0324246913037e2a9097a74 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:35.533414 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e06c2f-592a-4eab-a7d9-8e9301cd9ab3 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:35.537312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e06c2f-592a-4eab-a7d9-8e9301cd9ab3 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:35.537853 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e06c2f-592a-4eab-a7d9-8e9301cd9ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:35.563418 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-83e06c2f-592a-4eab-a7d9-8e9301cd9ab3 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:35.564702 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-83e06c2f-592a-4eab-a7d9-8e9301cd9ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:35.583063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:35.656543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1338/2720] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:35.666490 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1561c-d404-445a-9f0f-3a7d33680855 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:35.666862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1561c-d404-445a-9f0f-3a7d33680855 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:35.667058 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1561c-d404-445a-9f0f-3a7d33680855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:35.690365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-bfd1561c-d404-445a-9f0f-3a7d33680855 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:35.691602 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-bfd1561c-d404-445a-9f0f-3a7d33680855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:35.700648 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1383/2721] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:35.705569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e06c2f-592a-4eab-a7d9-8e9301cd9ab3 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:35.719928 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e06c2f-592a-4eab-a7d9-8e9301cd9ab3 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:35.725124 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac360a-287b-4c95-a637-378271e14011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:35.726079 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac360a-287b-4c95-a637-378271e14011 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:35.726440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac360a-287b-4c95-a637-378271e14011 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:35.726794 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac360a-287b-4c95-a637-378271e14011 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:35.727616 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac360a-287b-4c95-a637-378271e14011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:06:35.727995 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac360a-287b-4c95-a637-378271e14011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:35.729862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac360a-287b-4c95-a637-378271e14011 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:35.746062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1339/2722] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:06:35.750356 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1561c-d404-445a-9f0f-3a7d33680855 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:35.763874 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1561c-d404-445a-9f0f-3a7d33680855 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:35.769140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c9c0d-5d5b-493a-a74e-01df6583eb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:35.769826 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c9c0d-5d5b-493a-a74e-01df6583eb0f admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:35.770117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c9c0d-5d5b-493a-a74e-01df6583eb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:35.770418 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c9c0d-5d5b-493a-a74e-01df6583eb0f admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:35.771022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c9c0d-5d5b-493a-a74e-01df6583eb0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:35.772974 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c9c0d-5d5b-493a-a74e-01df6583eb0f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:35.877029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1384/2723] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:35 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:35.881897 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac360a-287b-4c95-a637-378271e14011 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:35.892984 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac360a-287b-4c95-a637-378271e14011 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:35.988548 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700bff7-67d0-408a-84a4-6b06a808e0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:35.989193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700bff7-67d0-408a-84a4-6b06a808e0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:35.989477 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700bff7-67d0-408a-84a4-6b06a808e0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:35.989757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700bff7-67d0-408a-84a4-6b06a808e0c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:35.990478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700bff7-67d0-408a-84a4-6b06a808e0c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:35.992557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700bff7-67d0-408a-84a4-6b06a808e0c6 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:36.080971 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1340/2724] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:35 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:36.085270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c9c0d-5d5b-493a-a74e-01df6583eb0f admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:36.097932 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c9c0d-5d5b-493a-a74e-01df6583eb0f admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:36.103712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e9936-1dd0-4457-aadb-c7653951c310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:36.104367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e9936-1dd0-4457-aadb-c7653951c310 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:36.104652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e9936-1dd0-4457-aadb-c7653951c310 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:36.104947 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e9936-1dd0-4457-aadb-c7653951c310 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:36.105587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e9936-1dd0-4457-aadb-c7653951c310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:36.107200 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e9936-1dd0-4457-aadb-c7653951c310 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:36.122367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1385/2725] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:36.127761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700bff7-67d0-408a-84a4-6b06a808e0c6 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:36.140442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700bff7-67d0-408a-84a4-6b06a808e0c6 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:36.145284 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f10859-db97-4406-9318-3014b267ae90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:36.145897 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f10859-db97-4406-9318-3014b267ae90 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:36.146174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f10859-db97-4406-9318-3014b267ae90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:36.146449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f10859-db97-4406-9318-3014b267ae90 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:36.147089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f10859-db97-4406-9318-3014b267ae90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:36.148720 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f10859-db97-4406-9318-3014b267ae90 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:36.162784 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1341/2726] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:36.168588 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e9936-1dd0-4457-aadb-c7653951c310 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:36.182138 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e9936-1dd0-4457-aadb-c7653951c310 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:36.188289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540558b-ac2e-42fb-93ae-812153a1ec63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:36.189154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540558b-ac2e-42fb-93ae-812153a1ec63 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:36.189463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540558b-ac2e-42fb-93ae-812153a1ec63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:36.189777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540558b-ac2e-42fb-93ae-812153a1ec63 admin admin] PATH_INFO: `/v3/projects/645f4f8025474ab29ef5d7ebdb263372/users/53382c2406694a4eb927491291fed2ee/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:36.208929 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540558b-ac2e-42fb-93ae-812153a1ec63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=645f4f8025474ab29ef5d7ebdb263372, user_id=53382c2406694a4eb927491291fed2ee, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:36.212367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540558b-ac2e-42fb-93ae-812153a1ec63 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:36.216991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:36.481534 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1386/2727] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:36 2022] PUT /identity/v3/projects/645f4f8025474ab29ef5d7ebdb263372/users/53382c2406694a4eb927491291fed2ee/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:36.494273 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a866a9-5aea-457d-a31c-bb64eb2a2e48 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:36.494663 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a866a9-5aea-457d-a31c-bb64eb2a2e48 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:36.494949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a866a9-5aea-457d-a31c-bb64eb2a2e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:36.525873 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-a0a866a9-5aea-457d-a31c-bb64eb2a2e48 None None] MFA Rules not processed for user `53382c2406694a4eb927491291fed2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:36.532324 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-a0a866a9-5aea-457d-a31c-bb64eb2a2e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:36.592051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1342/2728] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:36.596918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540558b-ac2e-42fb-93ae-812153a1ec63 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:36.689877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540558b-ac2e-42fb-93ae-812153a1ec63 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:36.700150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f79a9a-f175-4825-9d6e-3523a11290c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:36.701345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f79a9a-f175-4825-9d6e-3523a11290c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:36.701956 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f79a9a-f175-4825-9d6e-3523a11290c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:36.702536 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f79a9a-f175-4825-9d6e-3523a11290c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:36.703859 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f79a9a-f175-4825-9d6e-3523a11290c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:36.707730 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f79a9a-f175-4825-9d6e-3523a11290c6 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:36.842991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1387/2729] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:36 2022] POST /identity/v3/projects => generated 383 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:36.846903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a866a9-5aea-457d-a31c-bb64eb2a2e48 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:36.859938 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a866a9-5aea-457d-a31c-bb64eb2a2e48 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:36.879535 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:36.945141 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616c91a-2f9b-46b0-b585-fdc6549c80e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:36.945969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616c91a-2f9b-46b0-b585-fdc6549c80e4 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:36.946358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616c91a-2f9b-46b0-b585-fdc6549c80e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:36.946731 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616c91a-2f9b-46b0-b585-fdc6549c80e4 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:36.947650 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616c91a-2f9b-46b0-b585-fdc6549c80e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:36.950612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616c91a-2f9b-46b0-b585-fdc6549c80e4 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:37.085736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1343/2730] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:36 2022] POST /identity/v3/users => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:37.090582 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f79a9a-f175-4825-9d6e-3523a11290c6 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:37.105655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f79a9a-f175-4825-9d6e-3523a11290c6 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:37.107197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da02bf-7e2f-47c6-85ee-b4d0a9a4f309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:37.107896 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da02bf-7e2f-47c6-85ee-b4d0a9a4f309 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:37.108303 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da02bf-7e2f-47c6-85ee-b4d0a9a4f309 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:37.108598 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da02bf-7e2f-47c6-85ee-b4d0a9a4f309 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:37.109235 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da02bf-7e2f-47c6-85ee-b4d0a9a4f309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:37.110840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da02bf-7e2f-47c6-85ee-b4d0a9a4f309 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:37.126053 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1388/2731] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:37.127301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616c91a-2f9b-46b0-b585-fdc6549c80e4 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:37.138594 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616c91a-2f9b-46b0-b585-fdc6549c80e4 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:37.143468 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785b773-08fc-4642-85f7-4e0f5124951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:37.144157 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785b773-08fc-4642-85f7-4e0f5124951d admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:37.144477 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785b773-08fc-4642-85f7-4e0f5124951d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:37.144756 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785b773-08fc-4642-85f7-4e0f5124951d admin admin] PATH_INFO: `/v3/projects/81be01b18465456c9a68da69548667f5/users/99a963c477bf4fc79c2242f4906186d1/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:37.168241 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785b773-08fc-4642-85f7-4e0f5124951d admin admin] RBAC: Authorizing `identity:create_grant(project_id=81be01b18465456c9a68da69548667f5, user_id=99a963c477bf4fc79c2242f4906186d1, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:37.172175 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785b773-08fc-4642-85f7-4e0f5124951d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:37.246055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1344/2732] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:37 2022] PUT /identity/v3/projects/81be01b18465456c9a68da69548667f5/users/99a963c477bf4fc79c2242f4906186d1/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:37.250418 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da02bf-7e2f-47c6-85ee-b4d0a9a4f309 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:37.262771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da02bf-7e2f-47c6-85ee-b4d0a9a4f309 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:37.331824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb0f82-e0c3-4026-b181-55ef1c5b1e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:37.332472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb0f82-e0c3-4026-b181-55ef1c5b1e55 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:37.332748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb0f82-e0c3-4026-b181-55ef1c5b1e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:37.333020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb0f82-e0c3-4026-b181-55ef1c5b1e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:37.333671 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb0f82-e0c3-4026-b181-55ef1c5b1e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:37.335257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb0f82-e0c3-4026-b181-55ef1c5b1e55 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:37.346566 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1389/2733] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:06:37.350879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785b773-08fc-4642-85f7-4e0f5124951d admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:37.362825 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785b773-08fc-4642-85f7-4e0f5124951d admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:37.367618 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c8093-2739-4672-a493-8b2a316685f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:37.368318 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c8093-2739-4672-a493-8b2a316685f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:37.369301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c8093-2739-4672-a493-8b2a316685f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:37.369301 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c8093-2739-4672-a493-8b2a316685f5 admin admin] PATH_INFO: `/v3/projects/81be01b18465456c9a68da69548667f5/users/99a963c477bf4fc79c2242f4906186d1/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:37.371554 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c8093-2739-4672-a493-8b2a316685f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81be01b18465456c9a68da69548667f5, user_id=99a963c477bf4fc79c2242f4906186d1, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:37.374253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c8093-2739-4672-a493-8b2a316685f5 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:37.386244 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1345/2734] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:37 2022] PUT /identity/v3/projects/81be01b18465456c9a68da69548667f5/users/99a963c477bf4fc79c2242f4906186d1/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:37.398434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b053-c281-445b-9ad0-c63099f7d32a None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:37.398731 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b053-c281-445b-9ad0-c63099f7d32a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:37.399010 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b053-c281-445b-9ad0-c63099f7d32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:37.434590 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-dec3b053-c281-445b-9ad0-c63099f7d32a None None] MFA Rules not processed for user `99a963c477bf4fc79c2242f4906186d1`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:37.436268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-dec3b053-c281-445b-9ad0-c63099f7d32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:37.491568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:37.509548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1390/2735] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:37.522013 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c8093-2739-4672-a493-8b2a316685f5 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:37.523718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-521c8093-2739-4672-a493-8b2a316685f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:37.587926 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c8093-2739-4672-a493-8b2a316685f5 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:37.592525 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439264bc-9bad-4284-b555-a92a7fdf0d82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:37.593248 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439264bc-9bad-4284-b555-a92a7fdf0d82 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:37.593460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439264bc-9bad-4284-b555-a92a7fdf0d82 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:37.593737 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439264bc-9bad-4284-b555-a92a7fdf0d82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:37.605240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439264bc-9bad-4284-b555-a92a7fdf0d82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:37.610602 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439264bc-9bad-4284-b555-a92a7fdf0d82 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:37.618034 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1346/2736] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:37.622919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8fa65-04e4-4216-a6e1-54e14b79cf1f None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:37.623216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8fa65-04e4-4216-a6e1-54e14b79cf1f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:37.623496 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8fa65-04e4-4216-a6e1-54e14b79cf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:37.644095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-44a8fa65-04e4-4216-a6e1-54e14b79cf1f None None] MFA Rules not processed for user `71c94932b7e2480c88103e141e46d004`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:37.652314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-44a8fa65-04e4-4216-a6e1-54e14b79cf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:37.704298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1391/2737] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:37.755004 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439264bc-9bad-4284-b555-a92a7fdf0d82 service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:37.765063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439264bc-9bad-4284-b555-a92a7fdf0d82 service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:37.769222 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65be07-5fcc-4e74-87ed-20173520d82a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:37.769839 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65be07-5fcc-4e74-87ed-20173520d82a service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:37.771550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65be07-5fcc-4e74-87ed-20173520d82a service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:37.771550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65be07-5fcc-4e74-87ed-20173520d82a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:37.831337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65be07-5fcc-4e74-87ed-20173520d82a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:37.832807 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65be07-5fcc-4e74-87ed-20173520d82a service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:37.843563 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1347/2738] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:38.494885 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8fa65-04e4-4216-a6e1-54e14b79cf1f None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:38.566532 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8fa65-04e4-4216-a6e1-54e14b79cf1f None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:38.571186 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c405af9-e978-4f6f-a1ea-d3d54aca4f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:38.571819 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c405af9-e978-4f6f-a1ea-d3d54aca4f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:38.572104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c405af9-e978-4f6f-a1ea-d3d54aca4f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:38.572416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c405af9-e978-4f6f-a1ea-d3d54aca4f95 admin admin] PATH_INFO: `/v3/users/53382c2406694a4eb927491291fed2ee` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:38.574215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c405af9-e978-4f6f-a1ea-d3d54aca4f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53382c2406694a4eb927491291fed2ee)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:38.576519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c405af9-e978-4f6f-a1ea-d3d54aca4f95 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:38.757068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7c405af9-e978-4f6f-a1ea-d3d54aca4f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53382c2406694a4eb927491291fed2ee'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:38.765016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7c405af9-e978-4f6f-a1ea-d3d54aca4f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53382c2406694a4eb927491291fed2ee'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:38.882117 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7c405af9-e978-4f6f-a1ea-d3d54aca4f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53382c2406694a4eb927491291fed2ee'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:38.886559 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7c405af9-e978-4f6f-a1ea-d3d54aca4f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53382c2406694a4eb927491291fed2ee'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:38.898003 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7c405af9-e978-4f6f-a1ea-d3d54aca4f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53382c2406694a4eb927491291fed2ee'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:38.905032 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1392/2739] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:06:38 2022] DELETE /identity/v3/users/53382c2406694a4eb927491291fed2ee => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:38.909612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de35505-6525-4e48-9fda-c152e32a30fe None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:38.910436 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de35505-6525-4e48-9fda-c152e32a30fe None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:38.910436 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de35505-6525-4e48-9fda-c152e32a30fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:38.930163 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-8de35505-6525-4e48-9fda-c152e32a30fe None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:38.931404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8de35505-6525-4e48-9fda-c152e32a30fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:38.936341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:38.996495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1348/2740] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:39.007095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c405af9-e978-4f6f-a1ea-d3d54aca4f95 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:39.008620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-7c405af9-e978-4f6f-a1ea-d3d54aca4f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:39.033057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:39.072556 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c405af9-e978-4f6f-a1ea-d3d54aca4f95 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:39.077123 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a2051-f178-4122-94ed-0353a2a4c891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:39.077747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a2051-f178-4122-94ed-0353a2a4c891 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:39.078057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a2051-f178-4122-94ed-0353a2a4c891 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:39.078329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a2051-f178-4122-94ed-0353a2a4c891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:39.088170 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a2051-f178-4122-94ed-0353a2a4c891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:39.089738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a2051-f178-4122-94ed-0353a2a4c891 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:39.099929 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1393/2741] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:39.561261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de35505-6525-4e48-9fda-c152e32a30fe None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:39.563198 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-8de35505-6525-4e48-9fda-c152e32a30fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:39.576753 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de35505-6525-4e48-9fda-c152e32a30fe None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:39.581628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:39.582513 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:39.582962 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:39.583396 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0 admin admin] PATH_INFO: `/v3/projects/645f4f8025474ab29ef5d7ebdb263372` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:39.584754 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=645f4f8025474ab29ef5d7ebdb263372)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:39.586960 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:39.736370 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645f4f8025474ab29ef5d7ebdb263372', 'request_id': 'req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:39.826565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645f4f8025474ab29ef5d7ebdb263372', 'request_id': 'req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:39.833594 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645f4f8025474ab29ef5d7ebdb263372', 'request_id': 'req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:39.844495 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0 admin admin] The token cache is being invalidate because project 645f4f8025474ab29ef5d7ebdb263372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:06:39.844791 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:39.845440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:39.846935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1349/2742] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:06:39 2022] DELETE /identity/v3/projects/645f4f8025474ab29ef5d7ebdb263372 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:39.850984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a2051-f178-4122-94ed-0353a2a4c891 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:39.860960 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a2051-f178-4122-94ed-0353a2a4c891 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:39.919979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e5885-6f3f-4916-ac97-d6585e21967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:39.920673 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e5885-6f3f-4916-ac97-d6585e21967e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:39.920959 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e5885-6f3f-4916-ac97-d6585e21967e admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:39.921236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e5885-6f3f-4916-ac97-d6585e21967e admin admin] PATH_INFO: `/v3/users/99a963c477bf4fc79c2242f4906186d1` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:39.922436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e5885-6f3f-4916-ac97-d6585e21967e admin admin] RBAC: Authorizing `identity:delete_user(user_id=99a963c477bf4fc79c2242f4906186d1)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:39.924395 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e5885-6f3f-4916-ac97-d6585e21967e admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:40.154873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7a8e5885-6f3f-4916-ac97-d6585e21967e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99a963c477bf4fc79c2242f4906186d1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:40.162819 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7a8e5885-6f3f-4916-ac97-d6585e21967e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99a963c477bf4fc79c2242f4906186d1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:40.259177 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7a8e5885-6f3f-4916-ac97-d6585e21967e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99a963c477bf4fc79c2242f4906186d1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:40.259841 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7a8e5885-6f3f-4916-ac97-d6585e21967e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99a963c477bf4fc79c2242f4906186d1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:40.273226 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7a8e5885-6f3f-4916-ac97-d6585e21967e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99a963c477bf4fc79c2242f4906186d1'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:40.279575 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1394/2743] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:06:39 2022] DELETE /identity/v3/users/99a963c477bf4fc79c2242f4906186d1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:40.804261 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:40.805730 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:40.820662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc28fd-7bf4-4efe-a382-c9d1edfb9ca0 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:40.893032 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a967e-945c-40ca-9f9b-b0d879527321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:40.894535 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a967e-945c-40ca-9f9b-b0d879527321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:40.895265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a967e-945c-40ca-9f9b-b0d879527321 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:40.895771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a967e-945c-40ca-9f9b-b0d879527321 admin admin] PATH_INFO: `/v3/projects/81be01b18465456c9a68da69548667f5` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:40.897895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a967e-945c-40ca-9f9b-b0d879527321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81be01b18465456c9a68da69548667f5)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:40.902406 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a967e-945c-40ca-9f9b-b0d879527321 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:41.016956 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:41.027689 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5a0a967e-945c-40ca-9f9b-b0d879527321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81be01b18465456c9a68da69548667f5', 'request_id': 'req-5a0a967e-945c-40ca-9f9b-b0d879527321'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:41.139031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5a0a967e-945c-40ca-9f9b-b0d879527321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81be01b18465456c9a68da69548667f5', 'request_id': 'req-5a0a967e-945c-40ca-9f9b-b0d879527321'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:41.145722 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5a0a967e-945c-40ca-9f9b-b0d879527321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81be01b18465456c9a68da69548667f5', 'request_id': 'req-5a0a967e-945c-40ca-9f9b-b0d879527321'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:41.156884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5a0a967e-945c-40ca-9f9b-b0d879527321 admin admin] The token cache is being invalidate because project 81be01b18465456c9a68da69548667f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:06:41.157169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5a0a967e-945c-40ca-9f9b-b0d879527321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:41.157801 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-5a0a967e-945c-40ca-9f9b-b0d879527321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:41.159309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1350/2744] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:06:40 2022] DELETE /identity/v3/projects/81be01b18465456c9a68da69548667f5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:41.164222 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea19e3-b499-48a4-a7a3-9ef7f32394ce None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:41.164708 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea19e3-b499-48a4-a7a3-9ef7f32394ce None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:41.164810 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea19e3-b499-48a4-a7a3-9ef7f32394ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:41.185749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-2eea19e3-b499-48a4-a7a3-9ef7f32394ce None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:41.187093 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-2eea19e3-b499-48a4-a7a3-9ef7f32394ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:41.220813 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:41.247554 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1395/2745] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:41.255277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fa717-ed4f-43a4-87c8-bf8f9f2235e8 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:41.255559 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fa717-ed4f-43a4-87c8-bf8f9f2235e8 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:41.255830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fa717-ed4f-43a4-87c8-bf8f9f2235e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:41.278432 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-356fa717-ed4f-43a4-87c8-bf8f9f2235e8 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:41.279838 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-356fa717-ed4f-43a4-87c8-bf8f9f2235e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:41.288039 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1351/2746] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:41.292339 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea19e3-b499-48a4-a7a3-9ef7f32394ce None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:41.302387 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea19e3-b499-48a4-a7a3-9ef7f32394ce None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:41.308610 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd86b8-0f1b-4f5e-8da4-11bb1ca143ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:41.309624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd86b8-0f1b-4f5e-8da4-11bb1ca143ed admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:41.309624 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd86b8-0f1b-4f5e-8da4-11bb1ca143ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:41.309918 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd86b8-0f1b-4f5e-8da4-11bb1ca143ed admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:41.310405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd86b8-0f1b-4f5e-8da4-11bb1ca143ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:06:41.310711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd86b8-0f1b-4f5e-8da4-11bb1ca143ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:41.312350 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd86b8-0f1b-4f5e-8da4-11bb1ca143ed admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:41.328620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1396/2747] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:06:41.332712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fa717-ed4f-43a4-87c8-bf8f9f2235e8 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:41.343086 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fa717-ed4f-43a4-87c8-bf8f9f2235e8 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:41.347979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd16ad-b3b7-4173-ab19-267c0b52cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:41.358655 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd16ad-b3b7-4173-ab19-267c0b52cb54 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:41.358655 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd16ad-b3b7-4173-ab19-267c0b52cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:41.358655 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd16ad-b3b7-4173-ab19-267c0b52cb54 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:41.358655 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd16ad-b3b7-4173-ab19-267c0b52cb54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:41.358655 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd16ad-b3b7-4173-ab19-267c0b52cb54 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:41.472878 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1352/2748] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:41 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:41.477189 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd86b8-0f1b-4f5e-8da4-11bb1ca143ed admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:41.488075 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd86b8-0f1b-4f5e-8da4-11bb1ca143ed admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:41.562632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744314e-8fd9-4763-a30a-2a2cc1192de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:41.563257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744314e-8fd9-4763-a30a-2a2cc1192de1 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:41.563537 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744314e-8fd9-4763-a30a-2a2cc1192de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:41.563811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744314e-8fd9-4763-a30a-2a2cc1192de1 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:41.564537 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744314e-8fd9-4763-a30a-2a2cc1192de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:41.566604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744314e-8fd9-4763-a30a-2a2cc1192de1 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:41.648553 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1397/2749] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:41 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:41.653010 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd16ad-b3b7-4173-ab19-267c0b52cb54 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:41.664002 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd16ad-b3b7-4173-ab19-267c0b52cb54 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:41.669366 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c4ca7-0d76-4181-9ccc-de6c1468b0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:41.669933 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c4ca7-0d76-4181-9ccc-de6c1468b0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:41.670315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c4ca7-0d76-4181-9ccc-de6c1468b0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:41.670504 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c4ca7-0d76-4181-9ccc-de6c1468b0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:41.671154 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c4ca7-0d76-4181-9ccc-de6c1468b0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:41.672752 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c4ca7-0d76-4181-9ccc-de6c1468b0c9 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:41.687388 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1353/2750] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:06:41.690612 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744314e-8fd9-4763-a30a-2a2cc1192de1 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:41.702268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744314e-8fd9-4763-a30a-2a2cc1192de1 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:41.708115 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121237b-ef2c-4409-8322-32ed21aadfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:41.708774 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121237b-ef2c-4409-8322-32ed21aadfdf admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:41.709057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121237b-ef2c-4409-8322-32ed21aadfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:41.709334 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121237b-ef2c-4409-8322-32ed21aadfdf admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:41.709984 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121237b-ef2c-4409-8322-32ed21aadfdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:41.712233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121237b-ef2c-4409-8322-32ed21aadfdf admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:41.730338 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1398/2751] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:06:41.734430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c4ca7-0d76-4181-9ccc-de6c1468b0c9 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:41.745914 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c4ca7-0d76-4181-9ccc-de6c1468b0c9 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:41.752676 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20d82e-9dea-4baf-a5b3-c9522829cbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:41.753140 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20d82e-9dea-4baf-a5b3-c9522829cbe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:41.753491 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20d82e-9dea-4baf-a5b3-c9522829cbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:41.753955 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20d82e-9dea-4baf-a5b3-c9522829cbe5 admin admin] PATH_INFO: `/v3/projects/ab0e5bd4ccfb409ca55c7196158736ee/users/8c9f9155334f46879e23cba2d9e67d52/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:41.775573 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20d82e-9dea-4baf-a5b3-c9522829cbe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0e5bd4ccfb409ca55c7196158736ee, user_id=8c9f9155334f46879e23cba2d9e67d52, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:41.778721 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20d82e-9dea-4baf-a5b3-c9522829cbe5 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:41.906477 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1354/2752] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:41 2022] PUT /identity/v3/projects/ab0e5bd4ccfb409ca55c7196158736ee/users/8c9f9155334f46879e23cba2d9e67d52/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:06:41.917329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920c390-182f-4836-98c7-0f405672a836 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:41.917604 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920c390-182f-4836-98c7-0f405672a836 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:41.917877 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920c390-182f-4836-98c7-0f405672a836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:41.950036 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-8920c390-182f-4836-98c7-0f405672a836 None None] MFA Rules not processed for user `8c9f9155334f46879e23cba2d9e67d52`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:41.951258 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8920c390-182f-4836-98c7-0f405672a836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:42.032880 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1399/2753] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:42.049411 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20d82e-9dea-4baf-a5b3-c9522829cbe5 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:42.049411 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7f20d82e-9dea-4baf-a5b3-c9522829cbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:42.058477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b76e20-03bc-4cbc-9c04-2a1cbcfe9a6d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:42.058771 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b76e20-03bc-4cbc-9c04-2a1cbcfe9a6d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:42.059054 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b76e20-03bc-4cbc-9c04-2a1cbcfe9a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:42.097802 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-75b76e20-03bc-4cbc-9c04-2a1cbcfe9a6d None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:42.099765 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-75b76e20-03bc-4cbc-9c04-2a1cbcfe9a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:42.138450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:42.152526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20d82e-9dea-4baf-a5b3-c9522829cbe5 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:42.158450 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1db06-265a-4be1-a835-20738c87093d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:42.159074 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1db06-265a-4be1-a835-20738c87093d service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:42.159355 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1db06-265a-4be1-a835-20738c87093d service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:42.159636 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1db06-265a-4be1-a835-20738c87093d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:42.175362 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1400/2754] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Aug 29 23:06:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:42.178508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1db06-265a-4be1-a835-20738c87093d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:42.180099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1db06-265a-4be1-a835-20738c87093d service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:42.191360 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1355/2755] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:06:42.193729 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b76e20-03bc-4cbc-9c04-2a1cbcfe9a6d None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:42.195220 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-75b76e20-03bc-4cbc-9c04-2a1cbcfe9a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:42.214040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1db06-265a-4be1-a835-20738c87093d service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:42.301313 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b76e20-03bc-4cbc-9c04-2a1cbcfe9a6d None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:42.307384 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccddd8d-d2c6-45e1-8061-8d144ac901cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:42.308089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccddd8d-d2c6-45e1-8061-8d144ac901cb service swift] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:42.308493 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccddd8d-d2c6-45e1-8061-8d144ac901cb service swift] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:42.308837 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccddd8d-d2c6-45e1-8061-8d144ac901cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:42.316550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1db06-265a-4be1-a835-20738c87093d service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:42.318035 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccddd8d-d2c6-45e1-8061-8d144ac901cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:42.319643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccddd8d-d2c6-45e1-8061-8d144ac901cb service swift] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:42.326582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7319f-dabd-423a-812a-63c6da9e2ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:42.326582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7319f-dabd-423a-812a-63c6da9e2ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:42.326582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7319f-dabd-423a-812a-63c6da9e2ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:42.326582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7319f-dabd-423a-812a-63c6da9e2ca4 admin admin] PATH_INFO: `/v3/users/8c9f9155334f46879e23cba2d9e67d52` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:42.326976 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7319f-dabd-423a-812a-63c6da9e2ca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c9f9155334f46879e23cba2d9e67d52)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:42.327288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7319f-dabd-423a-812a-63c6da9e2ca4 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:42.329954 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1401/2756] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 23:06:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:06:42.330741 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:42.567005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-1cb7319f-dabd-423a-812a-63c6da9e2ca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c9f9155334f46879e23cba2d9e67d52'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:42.568696 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-1cb7319f-dabd-423a-812a-63c6da9e2ca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c9f9155334f46879e23cba2d9e67d52'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:42.574215 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-1cb7319f-dabd-423a-812a-63c6da9e2ca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c9f9155334f46879e23cba2d9e67d52'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:42.612014 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-1cb7319f-dabd-423a-812a-63c6da9e2ca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c9f9155334f46879e23cba2d9e67d52'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:42.627952 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-1cb7319f-dabd-423a-812a-63c6da9e2ca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c9f9155334f46879e23cba2d9e67d52'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:42.754661 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1356/2757] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:06:42 2022] DELETE /identity/v3/users/8c9f9155334f46879e23cba2d9e67d52 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:42.759243 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f441f6-1f7e-44de-8f8c-13f3c3e443b5 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:42.759668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f441f6-1f7e-44de-8f8c-13f3c3e443b5 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:42.760360 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f441f6-1f7e-44de-8f8c-13f3c3e443b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:42.811857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-11f441f6-1f7e-44de-8f8c-13f3c3e443b5 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:42.815179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-11f441f6-1f7e-44de-8f8c-13f3c3e443b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:42.932429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1402/2758] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:42.940100 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7319f-dabd-423a-812a-63c6da9e2ca4 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:42.942013 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-1cb7319f-dabd-423a-812a-63c6da9e2ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:43.022250 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7319f-dabd-423a-812a-63c6da9e2ca4 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:43.028231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c2d1c-6686-46a3-9053-07de600c3ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:43.029231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c2d1c-6686-46a3-9053-07de600c3ddd service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:43.030826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c2d1c-6686-46a3-9053-07de600c3ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:43.030826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c2d1c-6686-46a3-9053-07de600c3ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:43.043381 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c2d1c-6686-46a3-9053-07de600c3ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:43.045174 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c2d1c-6686-46a3-9053-07de600c3ddd service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:43.064445 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1357/2759] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:43.691670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f441f6-1f7e-44de-8f8c-13f3c3e443b5 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:43.694348 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-11f441f6-1f7e-44de-8f8c-13f3c3e443b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:43.720813 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f441f6-1f7e-44de-8f8c-13f3c3e443b5 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:43.728006 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795bd27-8d3d-447f-a4af-e026bb88d3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:43.732867 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795bd27-8d3d-447f-a4af-e026bb88d3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:43.732867 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795bd27-8d3d-447f-a4af-e026bb88d3da admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:43.732867 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795bd27-8d3d-447f-a4af-e026bb88d3da admin admin] PATH_INFO: `/v3/projects/ab0e5bd4ccfb409ca55c7196158736ee` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:43.732867 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795bd27-8d3d-447f-a4af-e026bb88d3da admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0e5bd4ccfb409ca55c7196158736ee)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:43.745708 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795bd27-8d3d-447f-a4af-e026bb88d3da admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:43.926037 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8795bd27-8d3d-447f-a4af-e026bb88d3da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0e5bd4ccfb409ca55c7196158736ee', 'request_id': 'req-8795bd27-8d3d-447f-a4af-e026bb88d3da'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:43.933934 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8795bd27-8d3d-447f-a4af-e026bb88d3da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0e5bd4ccfb409ca55c7196158736ee', 'request_id': 'req-8795bd27-8d3d-447f-a4af-e026bb88d3da'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:43.940800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8795bd27-8d3d-447f-a4af-e026bb88d3da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0e5bd4ccfb409ca55c7196158736ee', 'request_id': 'req-8795bd27-8d3d-447f-a4af-e026bb88d3da'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:43.942905 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:44.016184 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8795bd27-8d3d-447f-a4af-e026bb88d3da admin admin] The token cache is being invalidate because project ab0e5bd4ccfb409ca55c7196158736ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:06:44.016595 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8795bd27-8d3d-447f-a4af-e026bb88d3da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:44.017332 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-8795bd27-8d3d-447f-a4af-e026bb88d3da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:44.019482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1403/2760] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:06:43 2022] DELETE /identity/v3/projects/ab0e5bd4ccfb409ca55c7196158736ee => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:44.029360 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c02b2c-4562-4adf-b1e9-a7f561da245e None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:44.029961 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c02b2c-4562-4adf-b1e9-a7f561da245e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:44.030078 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c02b2c-4562-4adf-b1e9-a7f561da245e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:44.060507 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795bd27-8d3d-447f-a4af-e026bb88d3da admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:44.062576 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8795bd27-8d3d-447f-a4af-e026bb88d3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:44.085327 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-10c02b2c-4562-4adf-b1e9-a7f561da245e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:44.086572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-10c02b2c-4562-4adf-b1e9-a7f561da245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:44.158580 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795bd27-8d3d-447f-a4af-e026bb88d3da admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:44.164533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd008e-9376-4906-bc9f-7a3303dc7023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:44.165418 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd008e-9376-4906-bc9f-7a3303dc7023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:44.165892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd008e-9376-4906-bc9f-7a3303dc7023 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:44.166215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd008e-9376-4906-bc9f-7a3303dc7023 admin admin] PATH_INFO: `/v3/users/b62ed204eb7c48af8622b41abcbfa646` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:44.169778 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd008e-9376-4906-bc9f-7a3303dc7023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62ed204eb7c48af8622b41abcbfa646)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:44.171735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd008e-9376-4906-bc9f-7a3303dc7023 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:44.172973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1358/2761] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:44.184264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c26e32-f43d-40e4-97a1-83f7912e5cce None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:44.185208 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c26e32-f43d-40e4-97a1-83f7912e5cce None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:44.185846 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c26e32-f43d-40e4-97a1-83f7912e5cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:44.241835 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-51c26e32-f43d-40e4-97a1-83f7912e5cce None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:44.245361 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-51c26e32-f43d-40e4-97a1-83f7912e5cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:44.263797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1359/2762] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:06:44.270030 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c26e32-f43d-40e4-97a1-83f7912e5cce None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:44.292908 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c26e32-f43d-40e4-97a1-83f7912e5cce None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:44.299233 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d84293-85a0-4cb4-9be5-010405795a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:44.299976 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d84293-85a0-4cb4-9be5-010405795a00 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:44.300360 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d84293-85a0-4cb4-9be5-010405795a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:44.300639 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d84293-85a0-4cb4-9be5-010405795a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:44.301609 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d84293-85a0-4cb4-9be5-010405795a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:06:44.301965 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d84293-85a0-4cb4-9be5-010405795a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:44.304290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d84293-85a0-4cb4-9be5-010405795a00 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:44.334668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1360/2763] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:06:44.338256 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d84293-85a0-4cb4-9be5-010405795a00 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:44.345443 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:44.349541 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d84293-85a0-4cb4-9be5-010405795a00 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:44.354774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b13bd5-34a9-4a77-bc1e-428677ee4da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:44.355446 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b13bd5-34a9-4a77-bc1e-428677ee4da9 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:44.355725 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b13bd5-34a9-4a77-bc1e-428677ee4da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:44.356000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b13bd5-34a9-4a77-bc1e-428677ee4da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:44.356829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b13bd5-34a9-4a77-bc1e-428677ee4da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:44.358660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b13bd5-34a9-4a77-bc1e-428677ee4da9 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:44.414363 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a2bd008e-9376-4906-bc9f-7a3303dc7023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62ed204eb7c48af8622b41abcbfa646'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:44.436696 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a2bd008e-9376-4906-bc9f-7a3303dc7023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62ed204eb7c48af8622b41abcbfa646'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:44.457115 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1361/2764] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:44 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:06:44.458265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b13bd5-34a9-4a77-bc1e-428677ee4da9 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:44.531262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a2bd008e-9376-4906-bc9f-7a3303dc7023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62ed204eb7c48af8622b41abcbfa646'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:44.532441 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a2bd008e-9376-4906-bc9f-7a3303dc7023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62ed204eb7c48af8622b41abcbfa646'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:44.559633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-a2bd008e-9376-4906-bc9f-7a3303dc7023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62ed204eb7c48af8622b41abcbfa646'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:44.575250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1404/2765] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:06:44 2022] DELETE /identity/v3/users/b62ed204eb7c48af8622b41abcbfa646 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:06:44.581508 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c124f-7adf-4dc2-af81-5875363535f5 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:44.581796 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c124f-7adf-4dc2-af81-5875363535f5 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:44.582074 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c124f-7adf-4dc2-af81-5875363535f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:44.590849 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b13bd5-34a9-4a77-bc1e-428677ee4da9 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:44.612015 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-8d2c124f-7adf-4dc2-af81-5875363535f5 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:44.613296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8d2c124f-7adf-4dc2-af81-5875363535f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:44.704169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1405/2766] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:44.715375 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c124f-7adf-4dc2-af81-5875363535f5 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:44.717358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8d2c124f-7adf-4dc2-af81-5875363535f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:44.735453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:44.746692 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4ad2a-21ae-49d7-b7d3-a422a6683ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:44.749015 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4ad2a-21ae-49d7-b7d3-a422a6683ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:44.749612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4ad2a-21ae-49d7-b7d3-a422a6683ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:44.750259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4ad2a-21ae-49d7-b7d3-a422a6683ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:44.751806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4ad2a-21ae-49d7-b7d3-a422a6683ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:44.754299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4ad2a-21ae-49d7-b7d3-a422a6683ed6 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:44.802738 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c124f-7adf-4dc2-af81-5875363535f5 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:44.806870 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f030e-9ecb-481e-b55d-f5d7c0b9ed78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:44.807686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f030e-9ecb-481e-b55d-f5d7c0b9ed78 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:44.808120 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f030e-9ecb-481e-b55d-f5d7c0b9ed78 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:44.808628 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f030e-9ecb-481e-b55d-f5d7c0b9ed78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:44.820770 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f030e-9ecb-481e-b55d-f5d7c0b9ed78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:44.823491 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f030e-9ecb-481e-b55d-f5d7c0b9ed78 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:44.837824 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1406/2767] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:06:44.877285 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1362/2768] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:44 2022] POST /identity/v3/users => generated 289 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:06:44.881815 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f030e-9ecb-481e-b55d-f5d7c0b9ed78 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:44.883890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ec0f030e-9ecb-481e-b55d-f5d7c0b9ed78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:44.912976 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f030e-9ecb-481e-b55d-f5d7c0b9ed78 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:44.920150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002b9f1-8363-48cb-af74-a0e28260055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:44.921311 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002b9f1-8363-48cb-af74-a0e28260055b admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:44.921803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002b9f1-8363-48cb-af74-a0e28260055b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:44.922429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002b9f1-8363-48cb-af74-a0e28260055b admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:44.923678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002b9f1-8363-48cb-af74-a0e28260055b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:44.926691 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002b9f1-8363-48cb-af74-a0e28260055b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:44.940548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1407/2769] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:44.944985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4ad2a-21ae-49d7-b7d3-a422a6683ed6 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:44.968949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4ad2a-21ae-49d7-b7d3-a422a6683ed6 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:44.977774 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb23552-117c-46aa-b8fd-04a3eb2be7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:44.978724 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb23552-117c-46aa-b8fd-04a3eb2be7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:44.979560 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb23552-117c-46aa-b8fd-04a3eb2be7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:44.980107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb23552-117c-46aa-b8fd-04a3eb2be7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:44.981146 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb23552-117c-46aa-b8fd-04a3eb2be7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:44.987220 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb23552-117c-46aa-b8fd-04a3eb2be7d9 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:45.004414 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1363/2770] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:45.009109 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002b9f1-8363-48cb-af74-a0e28260055b admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:45.025359 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002b9f1-8363-48cb-af74-a0e28260055b admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:45.037136 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e7ffe-4381-4709-a55c-98430e6a9f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:45.038215 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e7ffe-4381-4709-a55c-98430e6a9f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:45.038709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e7ffe-4381-4709-a55c-98430e6a9f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:45.039056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e7ffe-4381-4709-a55c-98430e6a9f00 admin admin] PATH_INFO: `/v3/projects/b594632e0791489abddba7e707635cb8/users/0b1df89fbec74dabbc39528b6fe8d875/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:45.068649 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e7ffe-4381-4709-a55c-98430e6a9f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b594632e0791489abddba7e707635cb8, user_id=0b1df89fbec74dabbc39528b6fe8d875, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:45.075029 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e7ffe-4381-4709-a55c-98430e6a9f00 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:45.175464 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1408/2771] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:45 2022] PUT /identity/v3/projects/b594632e0791489abddba7e707635cb8/users/0b1df89fbec74dabbc39528b6fe8d875/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:45.188546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983442c0-6986-4833-8182-2531995f1352 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:45.189083 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983442c0-6986-4833-8182-2531995f1352 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:45.189196 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983442c0-6986-4833-8182-2531995f1352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:45.248853 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-983442c0-6986-4833-8182-2531995f1352 None None] MFA Rules not processed for user `0b1df89fbec74dabbc39528b6fe8d875`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:45.252267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-983442c0-6986-4833-8182-2531995f1352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:45.347691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:45.355805 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1364/2772] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:45.371103 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e7ffe-4381-4709-a55c-98430e6a9f00 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:45.373077 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-ba2e7ffe-4381-4709-a55c-98430e6a9f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:45.375983 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983442c0-6986-4833-8182-2531995f1352 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:45.390465 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-983442c0-6986-4833-8182-2531995f1352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:45.510877 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983442c0-6986-4833-8182-2531995f1352 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:45.513643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e7ffe-4381-4709-a55c-98430e6a9f00 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:45.515438 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a69a8-a9af-4203-ae21-8c463ac2e83f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:45.516355 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a69a8-a9af-4203-ae21-8c463ac2e83f service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:45.516853 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a69a8-a9af-4203-ae21-8c463ac2e83f service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:45.517200 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a69a8-a9af-4203-ae21-8c463ac2e83f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:45.518786 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a77313-e2a1-4967-8c1b-d344d08e9581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:45.519498 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a77313-e2a1-4967-8c1b-d344d08e9581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:45.519874 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a77313-e2a1-4967-8c1b-d344d08e9581 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:45.520156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a77313-e2a1-4967-8c1b-d344d08e9581 admin admin] PATH_INFO: `/v3/projects/908cf04e004947ba8f656cdd0199a129` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:45.521384 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a77313-e2a1-4967-8c1b-d344d08e9581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=908cf04e004947ba8f656cdd0199a129)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:45.523773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a77313-e2a1-4967-8c1b-d344d08e9581 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:45.530268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a69a8-a9af-4203-ae21-8c463ac2e83f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:45.532229 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a69a8-a9af-4203-ae21-8c463ac2e83f service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:45.546593 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1365/2773] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:45.737606 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-74a77313-e2a1-4967-8c1b-d344d08e9581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908cf04e004947ba8f656cdd0199a129', 'request_id': 'req-74a77313-e2a1-4967-8c1b-d344d08e9581'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:45.758265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-74a77313-e2a1-4967-8c1b-d344d08e9581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908cf04e004947ba8f656cdd0199a129', 'request_id': 'req-74a77313-e2a1-4967-8c1b-d344d08e9581'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:45.772583 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-74a77313-e2a1-4967-8c1b-d344d08e9581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908cf04e004947ba8f656cdd0199a129', 'request_id': 'req-74a77313-e2a1-4967-8c1b-d344d08e9581'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:45.882748 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-74a77313-e2a1-4967-8c1b-d344d08e9581 admin admin] The token cache is being invalidate because project 908cf04e004947ba8f656cdd0199a129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:06:45.883122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-74a77313-e2a1-4967-8c1b-d344d08e9581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:45.884443 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-74a77313-e2a1-4967-8c1b-d344d08e9581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:45.890405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1409/2774] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:06:45 2022] DELETE /identity/v3/projects/908cf04e004947ba8f656cdd0199a129 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:06:45.891628 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a69a8-a9af-4203-ae21-8c463ac2e83f service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:45.906778 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a69a8-a9af-4203-ae21-8c463ac2e83f service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:45.992046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4f045-a421-42fb-97fb-19e6e8f4ab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:45.992825 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4f045-a421-42fb-97fb-19e6e8f4ab52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:45.993177 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4f045-a421-42fb-97fb-19e6e8f4ab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:45.993532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4f045-a421-42fb-97fb-19e6e8f4ab52 admin admin] PATH_INFO: `/v3/users/d906b51ddac04fe48be7259b31ef7311` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:45.994810 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4f045-a421-42fb-97fb-19e6e8f4ab52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d906b51ddac04fe48be7259b31ef7311)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:45.997306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4f045-a421-42fb-97fb-19e6e8f4ab52 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:46.195281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-56b4f045-a421-42fb-97fb-19e6e8f4ab52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd906b51ddac04fe48be7259b31ef7311'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:46.195963 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-56b4f045-a421-42fb-97fb-19e6e8f4ab52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd906b51ddac04fe48be7259b31ef7311'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:46.196581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-56b4f045-a421-42fb-97fb-19e6e8f4ab52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd906b51ddac04fe48be7259b31ef7311'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:46.209433 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-56b4f045-a421-42fb-97fb-19e6e8f4ab52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd906b51ddac04fe48be7259b31ef7311'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:46.217003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-56b4f045-a421-42fb-97fb-19e6e8f4ab52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd906b51ddac04fe48be7259b31ef7311'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:46.296476 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1366/2775] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:06:45 2022] DELETE /identity/v3/users/d906b51ddac04fe48be7259b31ef7311 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:46.804475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a77313-e2a1-4967-8c1b-d344d08e9581 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:46.807469 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-74a77313-e2a1-4967-8c1b-d344d08e9581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:46.835559 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a77313-e2a1-4967-8c1b-d344d08e9581 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:46.844783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:46.931757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2080633-652e-48c0-af31-a70b5ad0f7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:46.932542 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2080633-652e-48c0-af31-a70b5ad0f7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:46.932840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2080633-652e-48c0-af31-a70b5ad0f7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:46.933216 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2080633-652e-48c0-af31-a70b5ad0f7f0 admin admin] PATH_INFO: `/v3/projects/aea2b11370274093afba1f0e149b6d01` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:46.934463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2080633-652e-48c0-af31-a70b5ad0f7f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea2b11370274093afba1f0e149b6d01)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:46.936692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2080633-652e-48c0-af31-a70b5ad0f7f0 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:47.165502 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d2080633-652e-48c0-af31-a70b5ad0f7f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea2b11370274093afba1f0e149b6d01', 'request_id': 'req-d2080633-652e-48c0-af31-a70b5ad0f7f0'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:47.175200 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d2080633-652e-48c0-af31-a70b5ad0f7f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea2b11370274093afba1f0e149b6d01', 'request_id': 'req-d2080633-652e-48c0-af31-a70b5ad0f7f0'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:47.184550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d2080633-652e-48c0-af31-a70b5ad0f7f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea2b11370274093afba1f0e149b6d01', 'request_id': 'req-d2080633-652e-48c0-af31-a70b5ad0f7f0'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:47.266655 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d2080633-652e-48c0-af31-a70b5ad0f7f0 admin admin] The token cache is being invalidate because project aea2b11370274093afba1f0e149b6d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:06:47.267173 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d2080633-652e-48c0-af31-a70b5ad0f7f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:47.267900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d2080633-652e-48c0-af31-a70b5ad0f7f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:06:47.269722 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1410/2776] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:06:46 2022] DELETE /identity/v3/projects/aea2b11370274093afba1f0e149b6d01 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:47.274809 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f426a05-54d4-4283-96ff-966c978deeac None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:47.275428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f426a05-54d4-4283-96ff-966c978deeac None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:47.275428 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f426a05-54d4-4283-96ff-966c978deeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:47.299448 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-9f426a05-54d4-4283-96ff-966c978deeac None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:47.300799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9f426a05-54d4-4283-96ff-966c978deeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:47.317572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:47.371481 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1367/2777] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:47.379923 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51219bf4-985f-42e7-9cbd-f29da81366f0 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:47.381880 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51219bf4-985f-42e7-9cbd-f29da81366f0 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:47.382223 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51219bf4-985f-42e7-9cbd-f29da81366f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:47.406864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-51219bf4-985f-42e7-9cbd-f29da81366f0 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:47.408291 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-51219bf4-985f-42e7-9cbd-f29da81366f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:47.419672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1411/2778] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:47.423135 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f426a05-54d4-4283-96ff-966c978deeac None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:47.435745 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f426a05-54d4-4283-96ff-966c978deeac None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:47.443809 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc67a5-910f-484d-83dc-45b2f147b416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:47.444891 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc67a5-910f-484d-83dc-45b2f147b416 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:47.445378 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc67a5-910f-484d-83dc-45b2f147b416 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:47.445860 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc67a5-910f-484d-83dc-45b2f147b416 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:47.447083 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc67a5-910f-484d-83dc-45b2f147b416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:06:47.447747 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc67a5-910f-484d-83dc-45b2f147b416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:47.451625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc67a5-910f-484d-83dc-45b2f147b416 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:47.476236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1368/2779] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:06:47.477910 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51219bf4-985f-42e7-9cbd-f29da81366f0 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:47.490152 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51219bf4-985f-42e7-9cbd-f29da81366f0 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:47.497486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910dda-cac6-46fc-ab73-06c0b9379d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:47.498113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910dda-cac6-46fc-ab73-06c0b9379d46 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:47.498401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910dda-cac6-46fc-ab73-06c0b9379d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:47.498669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910dda-cac6-46fc-ab73-06c0b9379d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:47.499355 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d910dda-cac6-46fc-ab73-06c0b9379d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:47.501292 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d910dda-cac6-46fc-ab73-06c0b9379d46 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:47.658800 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1412/2780] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:47 2022] POST /identity/v3/projects => generated 357 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:47.663533 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc67a5-910f-484d-83dc-45b2f147b416 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:47.675612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc67a5-910f-484d-83dc-45b2f147b416 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:47.753550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f7fa9-1e41-4339-b3ed-b39df351ddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:47.754183 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f7fa9-1e41-4339-b3ed-b39df351ddce admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:47.754442 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f7fa9-1e41-4339-b3ed-b39df351ddce admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:47.754716 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f7fa9-1e41-4339-b3ed-b39df351ddce admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:47.755364 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f7fa9-1e41-4339-b3ed-b39df351ddce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:47.757317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f7fa9-1e41-4339-b3ed-b39df351ddce admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:47.843842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1369/2781] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:47 2022] POST /identity/v3/users => generated 279 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:06:47.848048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910dda-cac6-46fc-ab73-06c0b9379d46 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:47.860351 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910dda-cac6-46fc-ab73-06c0b9379d46 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:47.887599 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acf1f4-650c-4f12-bf07-fd937ddd4cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:48.095250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acf1f4-650c-4f12-bf07-fd937ddd4cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:48.095250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acf1f4-650c-4f12-bf07-fd937ddd4cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:48.095250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acf1f4-650c-4f12-bf07-fd937ddd4cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:48.095250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acf1f4-650c-4f12-bf07-fd937ddd4cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:48.095250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acf1f4-650c-4f12-bf07-fd937ddd4cd7 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:48.095250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1413/2782] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:48.095978 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f7fa9-1e41-4339-b3ed-b39df351ddce admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:48.095978 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f7fa9-1e41-4339-b3ed-b39df351ddce admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:48.095978 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd26fe-6bc5-428a-9058-af31ff77a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:48.095978 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd26fe-6bc5-428a-9058-af31ff77a1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:48.096385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd26fe-6bc5-428a-9058-af31ff77a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:48.096385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd26fe-6bc5-428a-9058-af31ff77a1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:48.096385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd26fe-6bc5-428a-9058-af31ff77a1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:48.096385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd26fe-6bc5-428a-9058-af31ff77a1d7 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:48.096385 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1370/2783] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:48.096814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acf1f4-650c-4f12-bf07-fd937ddd4cd7 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:48.096814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acf1f4-650c-4f12-bf07-fd937ddd4cd7 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:48.096814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ab6d6-dc48-4ede-87df-7a3921f4e074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:48.096814 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ab6d6-dc48-4ede-87df-7a3921f4e074 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:48.097153 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ab6d6-dc48-4ede-87df-7a3921f4e074 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:48.097153 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ab6d6-dc48-4ede-87df-7a3921f4e074 admin admin] PATH_INFO: `/v3/projects/79ff93ed4fc049d0b0c449766c87bf11/users/49e6feb4c5754a8abed97a4bafe5c438/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:48.097153 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ab6d6-dc48-4ede-87df-7a3921f4e074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ff93ed4fc049d0b0c449766c87bf11, user_id=49e6feb4c5754a8abed97a4bafe5c438, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:48.097153 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ab6d6-dc48-4ede-87df-7a3921f4e074 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:48.621973 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1414/2784] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:47 2022] PUT /identity/v3/projects/79ff93ed4fc049d0b0c449766c87bf11/users/49e6feb4c5754a8abed97a4bafe5c438/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:48.641282 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e052904-928d-4ade-81ee-865bb70d1ce4 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:48.641282 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e052904-928d-4ade-81ee-865bb70d1ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:48.641282 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e052904-928d-4ade-81ee-865bb70d1ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:48.692512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-9e052904-928d-4ade-81ee-865bb70d1ce4 None None] MFA Rules not processed for user `49e6feb4c5754a8abed97a4bafe5c438`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:48.694777 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-9e052904-928d-4ade-81ee-865bb70d1ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:48.795829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1371/2785] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:48.801268 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ab6d6-dc48-4ede-87df-7a3921f4e074 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:48.847422 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:48.892573 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ab6d6-dc48-4ede-87df-7a3921f4e074 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:48.897369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d76d4-89a6-4203-abde-dff756a43f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:48.897983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d76d4-89a6-4203-abde-dff756a43f45 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:48.898273 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d76d4-89a6-4203-abde-dff756a43f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:48.898544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d76d4-89a6-4203-abde-dff756a43f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:48.899266 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d76d4-89a6-4203-abde-dff756a43f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:48.902288 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d76d4-89a6-4203-abde-dff756a43f45 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:49.048257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1415/2786] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:06:48 2022] POST /identity/v3/projects => generated 357 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:06:49.052415 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e052904-928d-4ade-81ee-865bb70d1ce4 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:49.070963 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e052904-928d-4ade-81ee-865bb70d1ce4 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:49.084733 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:49.139315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4457a-5c09-4982-b66a-76abe2aac873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:49.140259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4457a-5c09-4982-b66a-76abe2aac873 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:49.140925 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4457a-5c09-4982-b66a-76abe2aac873 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:49.141256 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4457a-5c09-4982-b66a-76abe2aac873 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:49.142034 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4457a-5c09-4982-b66a-76abe2aac873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:49.147042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4457a-5c09-4982-b66a-76abe2aac873 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:49.238648 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1372/2787] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:06:49 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:06:49.243337 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d76d4-89a6-4203-abde-dff756a43f45 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:49.255042 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d76d4-89a6-4203-abde-dff756a43f45 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:49.261019 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab864243-da28-44a9-b2a2-d892b574bc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:49.261917 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab864243-da28-44a9-b2a2-d892b574bc7b admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:49.262369 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab864243-da28-44a9-b2a2-d892b574bc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:49.262811 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab864243-da28-44a9-b2a2-d892b574bc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:49.263652 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab864243-da28-44a9-b2a2-d892b574bc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:49.265509 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab864243-da28-44a9-b2a2-d892b574bc7b admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:49.279421 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1416/2788] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:49.283919 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4457a-5c09-4982-b66a-76abe2aac873 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:49.300556 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4457a-5c09-4982-b66a-76abe2aac873 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:49.307724 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6dd44-8620-44e2-9f86-25abaf2ed46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:49.308441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6dd44-8620-44e2-9f86-25abaf2ed46d admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:49.308724 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6dd44-8620-44e2-9f86-25abaf2ed46d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:49.308997 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6dd44-8620-44e2-9f86-25abaf2ed46d admin admin] PATH_INFO: `/v3/projects/616e3c3801db4be486f89684486eb3ca/users/5d41055bed964c459d7591110087abdb/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:49.331169 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6dd44-8620-44e2-9f86-25abaf2ed46d admin admin] RBAC: Authorizing `identity:create_grant(project_id=616e3c3801db4be486f89684486eb3ca, user_id=5d41055bed964c459d7591110087abdb, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:49.335586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6dd44-8620-44e2-9f86-25abaf2ed46d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:49.420889 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1373/2789] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:49 2022] PUT /identity/v3/projects/616e3c3801db4be486f89684486eb3ca/users/5d41055bed964c459d7591110087abdb/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:49.425024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab864243-da28-44a9-b2a2-d892b574bc7b admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:49.446398 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab864243-da28-44a9-b2a2-d892b574bc7b admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:49.549309 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29f8e0-43a5-499b-8984-0d2361bc0b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:49.549925 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29f8e0-43a5-499b-8984-0d2361bc0b5c admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:49.552600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29f8e0-43a5-499b-8984-0d2361bc0b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:49.553094 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29f8e0-43a5-499b-8984-0d2361bc0b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:49.554055 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29f8e0-43a5-499b-8984-0d2361bc0b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:49.556066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29f8e0-43a5-499b-8984-0d2361bc0b5c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:49.576900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1417/2790] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:06:49.580819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6dd44-8620-44e2-9f86-25abaf2ed46d admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:49.599672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6dd44-8620-44e2-9f86-25abaf2ed46d admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:49.608717 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cfe12-fc8a-404d-a716-c5a96865c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:49.609395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cfe12-fc8a-404d-a716-c5a96865c00c admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:49.609675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cfe12-fc8a-404d-a716-c5a96865c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:49.609949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cfe12-fc8a-404d-a716-c5a96865c00c admin admin] PATH_INFO: `/v3/projects/616e3c3801db4be486f89684486eb3ca/users/5d41055bed964c459d7591110087abdb/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:49.612094 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cfe12-fc8a-404d-a716-c5a96865c00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=616e3c3801db4be486f89684486eb3ca, user_id=5d41055bed964c459d7591110087abdb, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:49.614980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cfe12-fc8a-404d-a716-c5a96865c00c admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:49.639678 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1374/2791] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:06:49 2022] PUT /identity/v3/projects/616e3c3801db4be486f89684486eb3ca/users/5d41055bed964c459d7591110087abdb/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:06:49.653627 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1b252-01fc-40a2-b6f4-e372af5eef64 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:49.654022 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1b252-01fc-40a2-b6f4-e372af5eef64 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:49.654399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1b252-01fc-40a2-b6f4-e372af5eef64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:49.690998 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-a0e1b252-01fc-40a2-b6f4-e372af5eef64 None None] MFA Rules not processed for user `5d41055bed964c459d7591110087abdb`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:06:49.692987 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-a0e1b252-01fc-40a2-b6f4-e372af5eef64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:49.810699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1418/2792] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:06:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:06:49.824213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cfe12-fc8a-404d-a716-c5a96865c00c admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:49.826799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f26cfe12-fc8a-404d-a716-c5a96865c00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:06:49.900119 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cfe12-fc8a-404d-a716-c5a96865c00c admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:49.913846 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653fc29-2151-46d3-8398-f7734438feef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:49.915219 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653fc29-2151-46d3-8398-f7734438feef service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:49.916757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653fc29-2151-46d3-8398-f7734438feef service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:49.917340 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653fc29-2151-46d3-8398-f7734438feef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:49.929980 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653fc29-2151-46d3-8398-f7734438feef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:49.931813 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653fc29-2151-46d3-8398-f7734438feef service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:49.953809 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1375/2793] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:06:50.229550 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1b252-01fc-40a2-b6f4-e372af5eef64 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:06:50.241999 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1b252-01fc-40a2-b6f4-e372af5eef64 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:06:50.246315 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16072f-5a31-4bb4-9462-708841d1bd28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:06:50.247061 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16072f-5a31-4bb4-9462-708841d1bd28 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:06:50.247403 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16072f-5a31-4bb4-9462-708841d1bd28 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:06:50.247749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16072f-5a31-4bb4-9462-708841d1bd28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:06:50.279528 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:50.310428 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16072f-5a31-4bb4-9462-708841d1bd28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:06:50.311930 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16072f-5a31-4bb4-9462-708841d1bd28 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:06:50.321247 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1419/2794] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:06:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:06:59.939459 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=63,keystone:INSERT=5 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:00.438994 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=14 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:03.759080 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653fc29-2151-46d3-8398-f7734438feef service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:03.760576 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f653fc29-2151-46d3-8398-f7734438feef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:03.826641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653fc29-2151-46d3-8398-f7734438feef service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:03.831212 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345b848-b087-4d2c-a2d0-c1f2631e4cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:03.831840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345b848-b087-4d2c-a2d0-c1f2631e4cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:03.832116 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345b848-b087-4d2c-a2d0-c1f2631e4cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:03.832417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345b848-b087-4d2c-a2d0-c1f2631e4cd3 admin admin] PATH_INFO: `/v3/users/0b1df89fbec74dabbc39528b6fe8d875` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:03.833672 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345b848-b087-4d2c-a2d0-c1f2631e4cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1df89fbec74dabbc39528b6fe8d875)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:03.835641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345b848-b087-4d2c-a2d0-c1f2631e4cd3 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:04.088416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6345b848-b087-4d2c-a2d0-c1f2631e4cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1df89fbec74dabbc39528b6fe8d875'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:04.089124 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6345b848-b087-4d2c-a2d0-c1f2631e4cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1df89fbec74dabbc39528b6fe8d875'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:04.090013 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6345b848-b087-4d2c-a2d0-c1f2631e4cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1df89fbec74dabbc39528b6fe8d875'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:04.107191 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6345b848-b087-4d2c-a2d0-c1f2631e4cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1df89fbec74dabbc39528b6fe8d875'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:04.120050 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-6345b848-b087-4d2c-a2d0-c1f2631e4cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1df89fbec74dabbc39528b6fe8d875'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:04.224501 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1376/2795] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:07:03 2022] DELETE /identity/v3/users/0b1df89fbec74dabbc39528b6fe8d875 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:04.230779 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0751e-c2ad-4f88-814d-ec7ed7c2aedd None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:04.231711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0751e-c2ad-4f88-814d-ec7ed7c2aedd None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:04.232494 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0751e-c2ad-4f88-814d-ec7ed7c2aedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:04.265579 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-34f0751e-c2ad-4f88-814d-ec7ed7c2aedd None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:04.266967 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-34f0751e-c2ad-4f88-814d-ec7ed7c2aedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:04.334350 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1420/2796] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:04.343990 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345b848-b087-4d2c-a2d0-c1f2631e4cd3 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:04.345586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-6345b848-b087-4d2c-a2d0-c1f2631e4cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:04.431608 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345b848-b087-4d2c-a2d0-c1f2631e4cd3 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:04.436411 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516752a-6e5a-43c1-af6f-3885bad04777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:04.445357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516752a-6e5a-43c1-af6f-3885bad04777 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:04.445357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516752a-6e5a-43c1-af6f-3885bad04777 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:04.445357 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516752a-6e5a-43c1-af6f-3885bad04777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:04.455269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516752a-6e5a-43c1-af6f-3885bad04777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:04.456822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516752a-6e5a-43c1-af6f-3885bad04777 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:04.467596 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1377/2797] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:07:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:07:04.952463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0751e-c2ad-4f88-814d-ec7ed7c2aedd None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:04.962442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0751e-c2ad-4f88-814d-ec7ed7c2aedd None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:04.966862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a042fd3-7c39-40a7-b01c-4c06b0661676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:04.967472 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a042fd3-7c39-40a7-b01c-4c06b0661676 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:04.967754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a042fd3-7c39-40a7-b01c-4c06b0661676 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:04.968030 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a042fd3-7c39-40a7-b01c-4c06b0661676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:04.969832 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-4a042fd3-7c39-40a7-b01c-4c06b0661676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:04.994968 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516752a-6e5a-43c1-af6f-3885bad04777 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:04.996549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-a516752a-6e5a-43c1-af6f-3885bad04777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:05.010227 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516752a-6e5a-43c1-af6f-3885bad04777 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:05.016447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1b244-8345-4419-bd47-23bf0c3baf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:05.017313 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1b244-8345-4419-bd47-23bf0c3baf38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:05.017769 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1b244-8345-4419-bd47-23bf0c3baf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:05.018053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1b244-8345-4419-bd47-23bf0c3baf38 admin admin] PATH_INFO: `/v3/projects/b594632e0791489abddba7e707635cb8` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:05.019381 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1b244-8345-4419-bd47-23bf0c3baf38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b594632e0791489abddba7e707635cb8)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:05.021412 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1b244-8345-4419-bd47-23bf0c3baf38 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:05.041466 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:05.044265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a042fd3-7c39-40a7-b01c-4c06b0661676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:05.045914 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a042fd3-7c39-40a7-b01c-4c06b0661676 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:05.057233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1421/2798] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:07:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:07:05.136283 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-61f1b244-8345-4419-bd47-23bf0c3baf38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b594632e0791489abddba7e707635cb8', 'request_id': 'req-61f1b244-8345-4419-bd47-23bf0c3baf38'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:05.239192 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-61f1b244-8345-4419-bd47-23bf0c3baf38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b594632e0791489abddba7e707635cb8', 'request_id': 'req-61f1b244-8345-4419-bd47-23bf0c3baf38'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:05.251472 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-61f1b244-8345-4419-bd47-23bf0c3baf38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b594632e0791489abddba7e707635cb8', 'request_id': 'req-61f1b244-8345-4419-bd47-23bf0c3baf38'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:05.269017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-61f1b244-8345-4419-bd47-23bf0c3baf38 admin admin] The token cache is being invalidate because project b594632e0791489abddba7e707635cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:07:05.269311 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-61f1b244-8345-4419-bd47-23bf0c3baf38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:05.269982 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-61f1b244-8345-4419-bd47-23bf0c3baf38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:05.271599 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1378/2799] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:07:04 2022] DELETE /identity/v3/projects/b594632e0791489abddba7e707635cb8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:07:05.276794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf6354-a9e7-4d00-a176-59e49ef343a5 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:05.277336 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf6354-a9e7-4d00-a176-59e49ef343a5 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:05.277336 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf6354-a9e7-4d00-a176-59e49ef343a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:05.297895 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-8cdf6354-a9e7-4d00-a176-59e49ef343a5 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:05.299378 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-8cdf6354-a9e7-4d00-a176-59e49ef343a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:05.366066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1422/2800] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:05.374729 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9555441-a648-440e-a784-1e6e69b6461e None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:05.377822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9555441-a648-440e-a784-1e6e69b6461e None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:05.377822 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9555441-a648-440e-a784-1e6e69b6461e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:05.399684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-f9555441-a648-440e-a784-1e6e69b6461e None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:05.401001 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f9555441-a648-440e-a784-1e6e69b6461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:05.410062 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1379/2801] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:05.414331 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf6354-a9e7-4d00-a176-59e49ef343a5 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:05.428619 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf6354-a9e7-4d00-a176-59e49ef343a5 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:05.434289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d02e62-3d48-4aee-b7c2-dbb96a48450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:05.435009 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d02e62-3d48-4aee-b7c2-dbb96a48450f admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:05.435351 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d02e62-3d48-4aee-b7c2-dbb96a48450f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:05.435686 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d02e62-3d48-4aee-b7c2-dbb96a48450f admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:05.436460 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d02e62-3d48-4aee-b7c2-dbb96a48450f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:07:05.436828 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d02e62-3d48-4aee-b7c2-dbb96a48450f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:05.438484 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d02e62-3d48-4aee-b7c2-dbb96a48450f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:05.452546 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1423/2802] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:07:05.456907 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9555441-a648-440e-a784-1e6e69b6461e None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:05.467748 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9555441-a648-440e-a784-1e6e69b6461e None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:05.474465 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb933f-b9f0-483e-938e-2418edca5b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:05.475253 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb933f-b9f0-483e-938e-2418edca5b23 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:05.475532 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb933f-b9f0-483e-938e-2418edca5b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:05.476419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb933f-b9f0-483e-938e-2418edca5b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:05.476567 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb933f-b9f0-483e-938e-2418edca5b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:05.478440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb933f-b9f0-483e-938e-2418edca5b23 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:05.564735 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1380/2803] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:07:05 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:07:05.568442 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d02e62-3d48-4aee-b7c2-dbb96a48450f admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:05.579454 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d02e62-3d48-4aee-b7c2-dbb96a48450f admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:05.604428 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=100 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:05.648435 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edf136-460a-443d-b70d-eb7779b2fb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:05.649129 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edf136-460a-443d-b70d-eb7779b2fb1a admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:05.649332 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edf136-460a-443d-b70d-eb7779b2fb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:05.649602 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edf136-460a-443d-b70d-eb7779b2fb1a admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:05.650255 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edf136-460a-443d-b70d-eb7779b2fb1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:05.652254 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edf136-460a-443d-b70d-eb7779b2fb1a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:05.760756 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1424/2804] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:07:05 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:07:05.765343 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb933f-b9f0-483e-938e-2418edca5b23 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:05.778419 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb933f-b9f0-483e-938e-2418edca5b23 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:05.787870 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18421fa-18c7-4330-9097-adc516afbd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:05.788761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18421fa-18c7-4330-9097-adc516afbd67 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:05.793323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18421fa-18c7-4330-9097-adc516afbd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:05.793323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18421fa-18c7-4330-9097-adc516afbd67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:05.793323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18421fa-18c7-4330-9097-adc516afbd67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:05.793323 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18421fa-18c7-4330-9097-adc516afbd67 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:05.808399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1381/2805] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:07:05.811106 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edf136-460a-443d-b70d-eb7779b2fb1a admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:05.822912 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edf136-460a-443d-b70d-eb7779b2fb1a admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:05.829000 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477f48c-5c2b-47d6-b8ff-4533771cb8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:05.830203 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477f48c-5c2b-47d6-b8ff-4533771cb8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:05.830203 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477f48c-5c2b-47d6-b8ff-4533771cb8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:05.830203 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477f48c-5c2b-47d6-b8ff-4533771cb8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:05.830820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477f48c-5c2b-47d6-b8ff-4533771cb8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:05.832543 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477f48c-5c2b-47d6-b8ff-4533771cb8c7 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:05.845864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1425/2806] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:07:05.851582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18421fa-18c7-4330-9097-adc516afbd67 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:05.862917 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18421fa-18c7-4330-9097-adc516afbd67 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:05.868306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409045c-0a64-41f5-91d0-fc3484f96df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:05.869006 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409045c-0a64-41f5-91d0-fc3484f96df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:05.869290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409045c-0a64-41f5-91d0-fc3484f96df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:05.869571 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409045c-0a64-41f5-91d0-fc3484f96df4 admin admin] PATH_INFO: `/v3/projects/ef31e60248144d64941e529177efdf9a/users/808feb9e50b1499d863647cd4f07725d/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:05.888477 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409045c-0a64-41f5-91d0-fc3484f96df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef31e60248144d64941e529177efdf9a, user_id=808feb9e50b1499d863647cd4f07725d, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:05.891699 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409045c-0a64-41f5-91d0-fc3484f96df4 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:05.970886 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1382/2807] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:07:05 2022] PUT /identity/v3/projects/ef31e60248144d64941e529177efdf9a/users/808feb9e50b1499d863647cd4f07725d/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:07:05.983423 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da276442-9204-4923-8717-e9a64901327a None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:05.983709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da276442-9204-4923-8717-e9a64901327a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:05.983985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da276442-9204-4923-8717-e9a64901327a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:06.015816 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-da276442-9204-4923-8717-e9a64901327a None None] MFA Rules not processed for user `808feb9e50b1499d863647cd4f07725d`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:06.017096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-da276442-9204-4923-8717-e9a64901327a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:06.085163 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1426/2808] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:06.097330 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409045c-0a64-41f5-91d0-fc3484f96df4 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:06.099210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7409045c-0a64-41f5-91d0-fc3484f96df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:06.169035 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409045c-0a64-41f5-91d0-fc3484f96df4 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:06.172915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e9d2a-458f-45a7-ad97-6211c9ab5244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:06.173612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e9d2a-458f-45a7-ad97-6211c9ab5244 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:06.173892 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e9d2a-458f-45a7-ad97-6211c9ab5244 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:06.174168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e9d2a-458f-45a7-ad97-6211c9ab5244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:06.183331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e9d2a-458f-45a7-ad97-6211c9ab5244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:06.184890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e9d2a-458f-45a7-ad97-6211c9ab5244 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:06.193887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1383/2809] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:07:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:07:09.313178 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da276442-9204-4923-8717-e9a64901327a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:09.408753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da276442-9204-4923-8717-e9a64901327a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:09.413632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf4224-7649-4ff2-9d44-158af9d76542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:09.414288 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf4224-7649-4ff2-9d44-158af9d76542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:09.414600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf4224-7649-4ff2-9d44-158af9d76542 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:09.414875 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf4224-7649-4ff2-9d44-158af9d76542 admin admin] PATH_INFO: `/v3/users/808feb9e50b1499d863647cd4f07725d` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:09.416061 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf4224-7649-4ff2-9d44-158af9d76542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=808feb9e50b1499d863647cd4f07725d)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:09.418820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf4224-7649-4ff2-9d44-158af9d76542 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:09.609685 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:09.622617 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-76cf4224-7649-4ff2-9d44-158af9d76542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '808feb9e50b1499d863647cd4f07725d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:09.630568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-76cf4224-7649-4ff2-9d44-158af9d76542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '808feb9e50b1499d863647cd4f07725d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:09.710584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-76cf4224-7649-4ff2-9d44-158af9d76542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '808feb9e50b1499d863647cd4f07725d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:09.711224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-76cf4224-7649-4ff2-9d44-158af9d76542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '808feb9e50b1499d863647cd4f07725d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:09.725195 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-76cf4224-7649-4ff2-9d44-158af9d76542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '808feb9e50b1499d863647cd4f07725d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:09.731260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1427/2810] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:07:09 2022] DELETE /identity/v3/users/808feb9e50b1499d863647cd4f07725d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:09.736270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf272395-d4f5-4503-8b10-7d110354d4aa None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:09.736798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf272395-d4f5-4503-8b10-7d110354d4aa None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:09.736798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf272395-d4f5-4503-8b10-7d110354d4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:09.763032 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-bf272395-d4f5-4503-8b10-7d110354d4aa None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:09.764368 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-bf272395-d4f5-4503-8b10-7d110354d4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:09.814899 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:09.833386 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1384/2811] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:09.843653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf4224-7649-4ff2-9d44-158af9d76542 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:09.845124 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-76cf4224-7649-4ff2-9d44-158af9d76542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:09.910810 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf4224-7649-4ff2-9d44-158af9d76542 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:09.914584 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d1fad-a958-4b9c-b0d8-a9de31ad59ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:09.915353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d1fad-a958-4b9c-b0d8-a9de31ad59ac service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:09.921568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d1fad-a958-4b9c-b0d8-a9de31ad59ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:09.921568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d1fad-a958-4b9c-b0d8-a9de31ad59ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:09.929106 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d1fad-a958-4b9c-b0d8-a9de31ad59ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:09.930589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d1fad-a958-4b9c-b0d8-a9de31ad59ac service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:09.944585 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1428/2812] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:07:10.327667 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf272395-d4f5-4503-8b10-7d110354d4aa None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:10.329132 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-bf272395-d4f5-4503-8b10-7d110354d4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:10.341176 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf272395-d4f5-4503-8b10-7d110354d4aa None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:10.345890 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2264a67-1929-4ddf-b15e-2b3ef2654a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:10.346522 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2264a67-1929-4ddf-b15e-2b3ef2654a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:10.346802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2264a67-1929-4ddf-b15e-2b3ef2654a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:10.347073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2264a67-1929-4ddf-b15e-2b3ef2654a7b admin admin] PATH_INFO: `/v3/users/49e6feb4c5754a8abed97a4bafe5c438` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:10.348185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2264a67-1929-4ddf-b15e-2b3ef2654a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=49e6feb4c5754a8abed97a4bafe5c438)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:10.350254 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2264a67-1929-4ddf-b15e-2b3ef2654a7b admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:10.538585 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e2264a67-1929-4ddf-b15e-2b3ef2654a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49e6feb4c5754a8abed97a4bafe5c438'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:10.539303 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e2264a67-1929-4ddf-b15e-2b3ef2654a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49e6feb4c5754a8abed97a4bafe5c438'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:10.540003 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e2264a67-1929-4ddf-b15e-2b3ef2654a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49e6feb4c5754a8abed97a4bafe5c438'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:10.555156 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e2264a67-1929-4ddf-b15e-2b3ef2654a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49e6feb4c5754a8abed97a4bafe5c438'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:10.564894 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-e2264a67-1929-4ddf-b15e-2b3ef2654a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49e6feb4c5754a8abed97a4bafe5c438'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:10.571001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d1fad-a958-4b9c-b0d8-a9de31ad59ac service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:10.573096 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f73d1fad-a958-4b9c-b0d8-a9de31ad59ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:10.595719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d1fad-a958-4b9c-b0d8-a9de31ad59ac service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:10.599487 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dad9df-51f8-4780-85af-5e20b73ab385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:10.600401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dad9df-51f8-4780-85af-5e20b73ab385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:10.600684 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dad9df-51f8-4780-85af-5e20b73ab385 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:10.600957 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dad9df-51f8-4780-85af-5e20b73ab385 admin admin] PATH_INFO: `/v3/projects/ef31e60248144d64941e529177efdf9a` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:10.602231 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dad9df-51f8-4780-85af-5e20b73ab385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef31e60248144d64941e529177efdf9a)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:10.605127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dad9df-51f8-4780-85af-5e20b73ab385 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:10.719841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1385/2813] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:07:10 2022] DELETE /identity/v3/users/49e6feb4c5754a8abed97a4bafe5c438 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:10.724319 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381e53b-8456-4bbb-8044-f71f48cb3b44 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:10.724684 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381e53b-8456-4bbb-8044-f71f48cb3b44 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:10.725025 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381e53b-8456-4bbb-8044-f71f48cb3b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:10.746620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-0381e53b-8456-4bbb-8044-f71f48cb3b44 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:10.747875 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0381e53b-8456-4bbb-8044-f71f48cb3b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:10.766900 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d9dad9df-51f8-4780-85af-5e20b73ab385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef31e60248144d64941e529177efdf9a', 'request_id': 'req-d9dad9df-51f8-4780-85af-5e20b73ab385'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:10.774367 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d9dad9df-51f8-4780-85af-5e20b73ab385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef31e60248144d64941e529177efdf9a', 'request_id': 'req-d9dad9df-51f8-4780-85af-5e20b73ab385'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:10.781828 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d9dad9df-51f8-4780-85af-5e20b73ab385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef31e60248144d64941e529177efdf9a', 'request_id': 'req-d9dad9df-51f8-4780-85af-5e20b73ab385'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:10.814320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1386/2814] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:07:10.824976 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381e53b-8456-4bbb-8044-f71f48cb3b44 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:10.826728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0381e53b-8456-4bbb-8044-f71f48cb3b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:10.863294 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d9dad9df-51f8-4780-85af-5e20b73ab385 admin admin] The token cache is being invalidate because project ef31e60248144d64941e529177efdf9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:07:10.864314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d9dad9df-51f8-4780-85af-5e20b73ab385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:10.864675 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-d9dad9df-51f8-4780-85af-5e20b73ab385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:10.867137 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1429/2815] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:07:10 2022] DELETE /identity/v3/projects/ef31e60248144d64941e529177efdf9a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:10.902326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381e53b-8456-4bbb-8044-f71f48cb3b44 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:10.916726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:10.987256 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbb4e8-985b-4beb-b369-95336b460cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:10.988836 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbb4e8-985b-4beb-b369-95336b460cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:10.989335 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbb4e8-985b-4beb-b369-95336b460cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:10.989799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbb4e8-985b-4beb-b369-95336b460cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:10.992317 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-16bbb4e8-985b-4beb-b369-95336b460cf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:11.100408 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbb4e8-985b-4beb-b369-95336b460cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:11.102549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbb4e8-985b-4beb-b369-95336b460cf2 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:11.115718 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1387/2816] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:07:11.730456 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dad9df-51f8-4780-85af-5e20b73ab385 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:11.732251 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d9dad9df-51f8-4780-85af-5e20b73ab385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:11.745996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dad9df-51f8-4780-85af-5e20b73ab385 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:11.757240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b673fff-3d43-4a14-a054-6075b6a70d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:11.757240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b673fff-3d43-4a14-a054-6075b6a70d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:11.757240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b673fff-3d43-4a14-a054-6075b6a70d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:11.757240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b673fff-3d43-4a14-a054-6075b6a70d7d admin admin] PATH_INFO: `/v3/projects/79ff93ed4fc049d0b0c449766c87bf11` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:11.757884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b673fff-3d43-4a14-a054-6075b6a70d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ff93ed4fc049d0b0c449766c87bf11)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:11.757884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b673fff-3d43-4a14-a054-6075b6a70d7d admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:11.890542 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:11.906145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-6b673fff-3d43-4a14-a054-6075b6a70d7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ff93ed4fc049d0b0c449766c87bf11', 'request_id': 'req-6b673fff-3d43-4a14-a054-6075b6a70d7d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:11.913619 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-6b673fff-3d43-4a14-a054-6075b6a70d7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ff93ed4fc049d0b0c449766c87bf11', 'request_id': 'req-6b673fff-3d43-4a14-a054-6075b6a70d7d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:11.920664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-6b673fff-3d43-4a14-a054-6075b6a70d7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ff93ed4fc049d0b0c449766c87bf11', 'request_id': 'req-6b673fff-3d43-4a14-a054-6075b6a70d7d'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:11.984683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-6b673fff-3d43-4a14-a054-6075b6a70d7d admin admin] The token cache is being invalidate because project 79ff93ed4fc049d0b0c449766c87bf11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:07:11.984983 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-6b673fff-3d43-4a14-a054-6075b6a70d7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:11.985623 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-6b673fff-3d43-4a14-a054-6075b6a70d7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:11.987126 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1430/2817] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:07:11 2022] DELETE /identity/v3/projects/79ff93ed4fc049d0b0c449766c87bf11 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:11.991363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbb4e8-985b-4beb-b369-95336b460cf2 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:12.002768 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbb4e8-985b-4beb-b369-95336b460cf2 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:12.061148 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b8103-cf2b-423c-88e3-4c4a105aa2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:12.062055 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b8103-cf2b-423c-88e3-4c4a105aa2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:12.062337 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b8103-cf2b-423c-88e3-4c4a105aa2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:12.062611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b8103-cf2b-423c-88e3-4c4a105aa2aa admin admin] PATH_INFO: `/v3/users/5d41055bed964c459d7591110087abdb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:12.063740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b8103-cf2b-423c-88e3-4c4a105aa2aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d41055bed964c459d7591110087abdb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:12.065764 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b8103-cf2b-423c-88e3-4c4a105aa2aa admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:12.280530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-514b8103-cf2b-423c-88e3-4c4a105aa2aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d41055bed964c459d7591110087abdb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:12.281128 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-514b8103-cf2b-423c-88e3-4c4a105aa2aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d41055bed964c459d7591110087abdb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:12.281740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-514b8103-cf2b-423c-88e3-4c4a105aa2aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d41055bed964c459d7591110087abdb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:12.294306 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-514b8103-cf2b-423c-88e3-4c4a105aa2aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d41055bed964c459d7591110087abdb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:12.295554 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:12.301866 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-514b8103-cf2b-423c-88e3-4c4a105aa2aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d41055bed964c459d7591110087abdb'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:12.384773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1388/2818] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:07:11 2022] DELETE /identity/v3/users/5d41055bed964c459d7591110087abdb => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:12.803712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b673fff-3d43-4a14-a054-6075b6a70d7d admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:12.805299 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-6b673fff-3d43-4a14-a054-6075b6a70d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:12.822070 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b673fff-3d43-4a14-a054-6075b6a70d7d admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:12.885055 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbbfab-39f0-4150-a242-e84835d7a1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:12.885699 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbbfab-39f0-4150-a242-e84835d7a1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:12.885979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbbfab-39f0-4150-a242-e84835d7a1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:12.886260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbbfab-39f0-4150-a242-e84835d7a1b2 admin admin] PATH_INFO: `/v3/projects/616e3c3801db4be486f89684486eb3ca` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:12.887444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbbfab-39f0-4150-a242-e84835d7a1b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=616e3c3801db4be486f89684486eb3ca)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:12.889473 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbbfab-39f0-4150-a242-e84835d7a1b2 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:12.986122 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1adbbfab-39f0-4150-a242-e84835d7a1b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616e3c3801db4be486f89684486eb3ca', 'request_id': 'req-1adbbfab-39f0-4150-a242-e84835d7a1b2'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:12.993785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1adbbfab-39f0-4150-a242-e84835d7a1b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616e3c3801db4be486f89684486eb3ca', 'request_id': 'req-1adbbfab-39f0-4150-a242-e84835d7a1b2'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:13.000140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1adbbfab-39f0-4150-a242-e84835d7a1b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616e3c3801db4be486f89684486eb3ca', 'request_id': 'req-1adbbfab-39f0-4150-a242-e84835d7a1b2'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:13.083033 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1adbbfab-39f0-4150-a242-e84835d7a1b2 admin admin] The token cache is being invalidate because project 616e3c3801db4be486f89684486eb3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:07:13.083247 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1adbbfab-39f0-4150-a242-e84835d7a1b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:13.083904 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1adbbfab-39f0-4150-a242-e84835d7a1b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:13.085483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1431/2819] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:07:12 2022] DELETE /identity/v3/projects/616e3c3801db4be486f89684486eb3ca => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:07:13.090368 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d1b52-cfc3-4079-813b-2c9979aba68d None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:13.090830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d1b52-cfc3-4079-813b-2c9979aba68d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:13.090928 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d1b52-cfc3-4079-813b-2c9979aba68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:13.111812 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-626d1b52-cfc3-4079-813b-2c9979aba68d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:13.113080 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-626d1b52-cfc3-4079-813b-2c9979aba68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:13.175224 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1389/2820] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:13.183401 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452f024-2a3e-49e2-85d8-856dad0536d5 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:13.183703 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452f024-2a3e-49e2-85d8-856dad0536d5 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:13.183979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452f024-2a3e-49e2-85d8-856dad0536d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:13.204157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-9452f024-2a3e-49e2-85d8-856dad0536d5 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:13.205384 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-9452f024-2a3e-49e2-85d8-856dad0536d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:13.213764 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1432/2821] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:13.218982 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d1b52-cfc3-4079-813b-2c9979aba68d None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:13.228566 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d1b52-cfc3-4079-813b-2c9979aba68d None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:13.233267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81bdff-39eb-4ed2-9695-9221cb7ffac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:13.233902 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81bdff-39eb-4ed2-9695-9221cb7ffac1 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:13.234182 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81bdff-39eb-4ed2-9695-9221cb7ffac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:13.234447 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81bdff-39eb-4ed2-9695-9221cb7ffac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:13.235095 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81bdff-39eb-4ed2-9695-9221cb7ffac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:07:13.235394 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81bdff-39eb-4ed2-9695-9221cb7ffac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:13.237065 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81bdff-39eb-4ed2-9695-9221cb7ffac1 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:13.248533 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1390/2822] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:07:13.252879 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452f024-2a3e-49e2-85d8-856dad0536d5 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:13.262416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452f024-2a3e-49e2-85d8-856dad0536d5 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:13.267769 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7e8f7-5f0e-4fa7-ab40-58c7177e2daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:13.268399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7e8f7-5f0e-4fa7-ab40-58c7177e2daf admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:13.268678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7e8f7-5f0e-4fa7-ab40-58c7177e2daf admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:13.268950 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7e8f7-5f0e-4fa7-ab40-58c7177e2daf admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:13.269583 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7e8f7-5f0e-4fa7-ab40-58c7177e2daf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:13.271501 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7e8f7-5f0e-4fa7-ab40-58c7177e2daf admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:13.360830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1433/2823] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:07:13 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:07:13.364905 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81bdff-39eb-4ed2-9695-9221cb7ffac1 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:13.375722 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81bdff-39eb-4ed2-9695-9221cb7ffac1 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:13.437772 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a48bb-0769-435a-874a-9669ffcd8a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:13.438386 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a48bb-0769-435a-874a-9669ffcd8a1d admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:13.438666 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a48bb-0769-435a-874a-9669ffcd8a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:13.438940 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a48bb-0769-435a-874a-9669ffcd8a1d admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:13.439615 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a48bb-0769-435a-874a-9669ffcd8a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:13.441555 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a48bb-0769-435a-874a-9669ffcd8a1d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:13.533029 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1391/2824] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:07:13 2022] POST /identity/v3/users => generated 283 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:07:13.537183 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7e8f7-5f0e-4fa7-ab40-58c7177e2daf admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:13.548823 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7e8f7-5f0e-4fa7-ab40-58c7177e2daf admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:13.553874 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69af4d-87f0-443c-b8ed-913d7865ccdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:13.554481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69af4d-87f0-443c-b8ed-913d7865ccdb admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:13.554766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69af4d-87f0-443c-b8ed-913d7865ccdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:13.555039 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69af4d-87f0-443c-b8ed-913d7865ccdb admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:13.555690 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69af4d-87f0-443c-b8ed-913d7865ccdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:13.557625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69af4d-87f0-443c-b8ed-913d7865ccdb admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:13.569968 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1434/2825] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:07:13.573916 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a48bb-0769-435a-874a-9669ffcd8a1d admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:13.585945 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a48bb-0769-435a-874a-9669ffcd8a1d admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:13.590847 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85b2ac-84b5-4de1-8c16-a3425ef202fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:13.591457 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85b2ac-84b5-4de1-8c16-a3425ef202fb admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:13.591746 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85b2ac-84b5-4de1-8c16-a3425ef202fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:13.591984 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85b2ac-84b5-4de1-8c16-a3425ef202fb admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:13.592773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85b2ac-84b5-4de1-8c16-a3425ef202fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:13.594355 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85b2ac-84b5-4de1-8c16-a3425ef202fb admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:13.605677 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1392/2826] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:07:13.610383 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69af4d-87f0-443c-b8ed-913d7865ccdb admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:13.620621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69af4d-87f0-443c-b8ed-913d7865ccdb admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:13.629510 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd32c38-dc63-4e42-92d1-8763122e5f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:13.630188 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd32c38-dc63-4e42-92d1-8763122e5f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:13.630465 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd32c38-dc63-4e42-92d1-8763122e5f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:13.630736 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd32c38-dc63-4e42-92d1-8763122e5f5f admin admin] PATH_INFO: `/v3/projects/56be7894881243a7930a04e9f63f64a1/users/ddeb7486ac4a4615a4d37a7dc50322bf/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:13.634428 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:13.647131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd32c38-dc63-4e42-92d1-8763122e5f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56be7894881243a7930a04e9f63f64a1, user_id=ddeb7486ac4a4615a4d37a7dc50322bf, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:13.649972 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd32c38-dc63-4e42-92d1-8763122e5f5f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:13.739633 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1435/2827] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:07:13 2022] PUT /identity/v3/projects/56be7894881243a7930a04e9f63f64a1/users/ddeb7486ac4a4615a4d37a7dc50322bf/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:13.751986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7fdb6-a81a-43be-89c8-60a3c3f62b41 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:13.752315 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7fdb6-a81a-43be-89c8-60a3c3f62b41 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:13.752599 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7fdb6-a81a-43be-89c8-60a3c3f62b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:13.779990 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-c8f7fdb6-a81a-43be-89c8-60a3c3f62b41 None None] MFA Rules not processed for user `ddeb7486ac4a4615a4d37a7dc50322bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:13.781277 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c8f7fdb6-a81a-43be-89c8-60a3c3f62b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:13.820840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:13.846613 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1393/2828] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:13.851393 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd32c38-dc63-4e42-92d1-8763122e5f5f admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:13.916001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd32c38-dc63-4e42-92d1-8763122e5f5f admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:13.921499 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac1013-5804-4ad8-abdb-9e4c46b930b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:13.922168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac1013-5804-4ad8-abdb-9e4c46b930b9 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:13.925057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac1013-5804-4ad8-abdb-9e4c46b930b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:13.925057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac1013-5804-4ad8-abdb-9e4c46b930b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:13.925057 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac1013-5804-4ad8-abdb-9e4c46b930b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:13.925353 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac1013-5804-4ad8-abdb-9e4c46b930b9 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:14.008977 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1436/2829] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:07:13 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:07:14.012903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7fdb6-a81a-43be-89c8-60a3c3f62b41 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:14.023572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7fdb6-a81a-43be-89c8-60a3c3f62b41 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:14.082860 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe96eea-a5e7-4e7d-be9d-9035bcd93a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:14.083566 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe96eea-a5e7-4e7d-be9d-9035bcd93a12 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:14.083889 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe96eea-a5e7-4e7d-be9d-9035bcd93a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:14.084246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe96eea-a5e7-4e7d-be9d-9035bcd93a12 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:14.084969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe96eea-a5e7-4e7d-be9d-9035bcd93a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:14.087162 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe96eea-a5e7-4e7d-be9d-9035bcd93a12 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:14.168076 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1394/2830] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:07:14 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:07:14.172885 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac1013-5804-4ad8-abdb-9e4c46b930b9 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:14.184298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac1013-5804-4ad8-abdb-9e4c46b930b9 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:14.189637 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebf2c0-c90f-4c2e-9411-8ea5579e94c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:14.190257 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebf2c0-c90f-4c2e-9411-8ea5579e94c0 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:14.190542 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebf2c0-c90f-4c2e-9411-8ea5579e94c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:14.190819 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebf2c0-c90f-4c2e-9411-8ea5579e94c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:14.191478 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebf2c0-c90f-4c2e-9411-8ea5579e94c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:14.193145 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebf2c0-c90f-4c2e-9411-8ea5579e94c0 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:14.204759 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1437/2831] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:07:14.209094 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe96eea-a5e7-4e7d-be9d-9035bcd93a12 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:14.220269 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe96eea-a5e7-4e7d-be9d-9035bcd93a12 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:14.224979 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d16f19-812c-405c-99b3-6fac940d8ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:14.225639 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d16f19-812c-405c-99b3-6fac940d8ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:14.225918 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d16f19-812c-405c-99b3-6fac940d8ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:14.226191 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d16f19-812c-405c-99b3-6fac940d8ef0 admin admin] PATH_INFO: `/v3/projects/56a16d7eea72475e80296cbd67e5a82e/users/98217fe82b8c4380b0303d98db7b554e/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:14.242343 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d16f19-812c-405c-99b3-6fac940d8ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a16d7eea72475e80296cbd67e5a82e, user_id=98217fe82b8c4380b0303d98db7b554e, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:14.245130 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d16f19-812c-405c-99b3-6fac940d8ef0 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:14.370647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1395/2832] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:07:14 2022] PUT /identity/v3/projects/56a16d7eea72475e80296cbd67e5a82e/users/98217fe82b8c4380b0303d98db7b554e/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:14.374937 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebf2c0-c90f-4c2e-9411-8ea5579e94c0 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:14.385217 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebf2c0-c90f-4c2e-9411-8ea5579e94c0 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:14.443237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a07cad-8b12-4b9e-a059-6d9021cd68af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:14.443857 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a07cad-8b12-4b9e-a059-6d9021cd68af admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:14.444138 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a07cad-8b12-4b9e-a059-6d9021cd68af admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:14.444444 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a07cad-8b12-4b9e-a059-6d9021cd68af admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:14.445104 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a07cad-8b12-4b9e-a059-6d9021cd68af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:14.446731 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a07cad-8b12-4b9e-a059-6d9021cd68af admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:14.458229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1438/2833] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:07:14.462755 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d16f19-812c-405c-99b3-6fac940d8ef0 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:14.474182 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d16f19-812c-405c-99b3-6fac940d8ef0 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:14.478825 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d34991-c6e9-4095-9693-1c99ffad1f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:14.479478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d34991-c6e9-4095-9693-1c99ffad1f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:14.479757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d34991-c6e9-4095-9693-1c99ffad1f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:14.480031 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d34991-c6e9-4095-9693-1c99ffad1f38 admin admin] PATH_INFO: `/v3/projects/56a16d7eea72475e80296cbd67e5a82e/users/98217fe82b8c4380b0303d98db7b554e/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:14.481993 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d34991-c6e9-4095-9693-1c99ffad1f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a16d7eea72475e80296cbd67e5a82e, user_id=98217fe82b8c4380b0303d98db7b554e, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:14.484729 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d34991-c6e9-4095-9693-1c99ffad1f38 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:14.495209 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1396/2834] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:07:14 2022] PUT /identity/v3/projects/56a16d7eea72475e80296cbd67e5a82e/users/98217fe82b8c4380b0303d98db7b554e/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:14.505702 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30897e42-3025-4c95-a7e3-a5259833653e None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:14.505988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30897e42-3025-4c95-a7e3-a5259833653e None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:14.506260 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30897e42-3025-4c95-a7e3-a5259833653e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:14.537189 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-30897e42-3025-4c95-a7e3-a5259833653e None None] MFA Rules not processed for user `98217fe82b8c4380b0303d98db7b554e`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:14.538413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-30897e42-3025-4c95-a7e3-a5259833653e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:14.581365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:14.605709 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1439/2835] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:14.617420 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d34991-c6e9-4095-9693-1c99ffad1f38 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:14.619156 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-f0d34991-c6e9-4095-9693-1c99ffad1f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:14.678666 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d34991-c6e9-4095-9693-1c99ffad1f38 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:14.682484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dc109-e35d-4426-8eb6-25178d77ce15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:14.683090 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dc109-e35d-4426-8eb6-25178d77ce15 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:14.683393 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dc109-e35d-4426-8eb6-25178d77ce15 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:14.683667 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dc109-e35d-4426-8eb6-25178d77ce15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:14.693287 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3dc109-e35d-4426-8eb6-25178d77ce15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:14.694744 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3dc109-e35d-4426-8eb6-25178d77ce15 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:14.708508 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1397/2836] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:07:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:07:14.907988 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30897e42-3025-4c95-a7e3-a5259833653e None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:14.917873 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30897e42-3025-4c95-a7e3-a5259833653e None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:14.922081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642aea7-1025-4f87-9518-58ae5fd1d666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:14.922712 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642aea7-1025-4f87-9518-58ae5fd1d666 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:14.922996 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642aea7-1025-4f87-9518-58ae5fd1d666 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:14.923273 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642aea7-1025-4f87-9518-58ae5fd1d666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:14.983128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642aea7-1025-4f87-9518-58ae5fd1d666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:14.984775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642aea7-1025-4f87-9518-58ae5fd1d666 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:14.994094 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1440/2837] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:07:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:07:18.620685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dc109-e35d-4426-8eb6-25178d77ce15 service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:18.663195 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:18.715358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dc109-e35d-4426-8eb6-25178d77ce15 service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:18.721239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402e385-3966-49bd-9e16-c46cc4348fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:18.721893 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402e385-3966-49bd-9e16-c46cc4348fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:18.722175 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402e385-3966-49bd-9e16-c46cc4348fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:18.722455 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402e385-3966-49bd-9e16-c46cc4348fc1 admin admin] PATH_INFO: `/v3/users/ddeb7486ac4a4615a4d37a7dc50322bf` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:18.723627 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402e385-3966-49bd-9e16-c46cc4348fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddeb7486ac4a4615a4d37a7dc50322bf)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:18.725707 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402e385-3966-49bd-9e16-c46cc4348fc1 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:18.967592 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3402e385-3966-49bd-9e16-c46cc4348fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddeb7486ac4a4615a4d37a7dc50322bf'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:18.968196 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3402e385-3966-49bd-9e16-c46cc4348fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddeb7486ac4a4615a4d37a7dc50322bf'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:18.968826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3402e385-3966-49bd-9e16-c46cc4348fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddeb7486ac4a4615a4d37a7dc50322bf'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:18.982329 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3402e385-3966-49bd-9e16-c46cc4348fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddeb7486ac4a4615a4d37a7dc50322bf'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:18.989791 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3402e385-3966-49bd-9e16-c46cc4348fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddeb7486ac4a4615a4d37a7dc50322bf'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:19.067761 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1398/2838] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:07:18 2022] DELETE /identity/v3/users/ddeb7486ac4a4615a4d37a7dc50322bf => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:07:19.072471 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2595e-c4e7-4c62-8917-85c9d4a4adb0 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:19.072997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2595e-c4e7-4c62-8917-85c9d4a4adb0 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:19.072997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2595e-c4e7-4c62-8917-85c9d4a4adb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:19.094825 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-37c2595e-c4e7-4c62-8917-85c9d4a4adb0 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:19.096131 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-37c2595e-c4e7-4c62-8917-85c9d4a4adb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:19.162702 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1441/2839] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:19.172927 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402e385-3966-49bd-9e16-c46cc4348fc1 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:19.174569 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-3402e385-3966-49bd-9e16-c46cc4348fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:19.235969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402e385-3966-49bd-9e16-c46cc4348fc1 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:19.239457 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673ac1-ea81-4c5b-aa2e-dc7d3e3c9576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:19.240071 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673ac1-ea81-4c5b-aa2e-dc7d3e3c9576 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:19.240379 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673ac1-ea81-4c5b-aa2e-dc7d3e3c9576 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:19.240649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673ac1-ea81-4c5b-aa2e-dc7d3e3c9576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:19.250256 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45673ac1-ea81-4c5b-aa2e-dc7d3e3c9576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:19.251697 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45673ac1-ea81-4c5b-aa2e-dc7d3e3c9576 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:19.261806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1399/2840] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:07:19.898290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2595e-c4e7-4c62-8917-85c9d4a4adb0 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:19.899951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-37c2595e-c4e7-4c62-8917-85c9d4a4adb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:19.913737 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2595e-c4e7-4c62-8917-85c9d4a4adb0 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:19.918322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09960381-4b8c-459d-96f3-85587540b473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:19.921037 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09960381-4b8c-459d-96f3-85587540b473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:19.921037 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09960381-4b8c-459d-96f3-85587540b473 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:19.921037 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09960381-4b8c-459d-96f3-85587540b473 admin admin] PATH_INFO: `/v3/projects/56be7894881243a7930a04e9f63f64a1` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:19.921399 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09960381-4b8c-459d-96f3-85587540b473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56be7894881243a7930a04e9f63f64a1)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:19.923495 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09960381-4b8c-459d-96f3-85587540b473 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:20.022889 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-09960381-4b8c-459d-96f3-85587540b473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56be7894881243a7930a04e9f63f64a1', 'request_id': 'req-09960381-4b8c-459d-96f3-85587540b473'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:20.030583 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-09960381-4b8c-459d-96f3-85587540b473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56be7894881243a7930a04e9f63f64a1', 'request_id': 'req-09960381-4b8c-459d-96f3-85587540b473'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:20.036762 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-09960381-4b8c-459d-96f3-85587540b473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56be7894881243a7930a04e9f63f64a1', 'request_id': 'req-09960381-4b8c-459d-96f3-85587540b473'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:20.138316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-09960381-4b8c-459d-96f3-85587540b473 admin admin] The token cache is being invalidate because project 56be7894881243a7930a04e9f63f64a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:07:20.139203 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-09960381-4b8c-459d-96f3-85587540b473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:20.139336 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-09960381-4b8c-459d-96f3-85587540b473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:20.140821 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1442/2841] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:07:19 2022] DELETE /identity/v3/projects/56be7894881243a7930a04e9f63f64a1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:07:20.144970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673ac1-ea81-4c5b-aa2e-dc7d3e3c9576 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:20.155670 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673ac1-ea81-4c5b-aa2e-dc7d3e3c9576 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:20.209823 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:20.217482 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c2b96-b21c-4687-bbe6-540b2c081127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:20.218165 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c2b96-b21c-4687-bbe6-540b2c081127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:20.218431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c2b96-b21c-4687-bbe6-540b2c081127 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:20.218706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c2b96-b21c-4687-bbe6-540b2c081127 admin admin] PATH_INFO: `/v3/users/98217fe82b8c4380b0303d98db7b554e` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:20.219957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c2b96-b21c-4687-bbe6-540b2c081127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98217fe82b8c4380b0303d98db7b554e)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:20.222023 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c2b96-b21c-4687-bbe6-540b2c081127 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:20.571121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3e0c2b96-b21c-4687-bbe6-540b2c081127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98217fe82b8c4380b0303d98db7b554e'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:20.572270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3e0c2b96-b21c-4687-bbe6-540b2c081127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98217fe82b8c4380b0303d98db7b554e'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:20.573292 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3e0c2b96-b21c-4687-bbe6-540b2c081127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98217fe82b8c4380b0303d98db7b554e'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:20.596149 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3e0c2b96-b21c-4687-bbe6-540b2c081127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98217fe82b8c4380b0303d98db7b554e'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:20.609951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-3e0c2b96-b21c-4687-bbe6-540b2c081127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98217fe82b8c4380b0303d98db7b554e'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:20.682662 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1400/2842] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:07:20 2022] DELETE /identity/v3/users/98217fe82b8c4380b0303d98db7b554e => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:21.169102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09960381-4b8c-459d-96f3-85587540b473 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:21.171847 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-09960381-4b8c-459d-96f3-85587540b473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:21.181302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:21.187450 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09960381-4b8c-459d-96f3-85587540b473 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:21.253864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb980e6-2b5c-4aa3-96a3-b33e9e13226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:21.257514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb980e6-2b5c-4aa3-96a3-b33e9e13226f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:21.257514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb980e6-2b5c-4aa3-96a3-b33e9e13226f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:21.257514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb980e6-2b5c-4aa3-96a3-b33e9e13226f admin admin] PATH_INFO: `/v3/projects/56a16d7eea72475e80296cbd67e5a82e` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:21.257514 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb980e6-2b5c-4aa3-96a3-b33e9e13226f admin admin] RBAC: Authorizing `identity:delete_project(project_id=56a16d7eea72475e80296cbd67e5a82e)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:21.258250 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb980e6-2b5c-4aa3-96a3-b33e9e13226f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:21.387073 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7fb980e6-2b5c-4aa3-96a3-b33e9e13226f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a16d7eea72475e80296cbd67e5a82e', 'request_id': 'req-7fb980e6-2b5c-4aa3-96a3-b33e9e13226f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:21.394048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7fb980e6-2b5c-4aa3-96a3-b33e9e13226f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a16d7eea72475e80296cbd67e5a82e', 'request_id': 'req-7fb980e6-2b5c-4aa3-96a3-b33e9e13226f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:21.400263 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7fb980e6-2b5c-4aa3-96a3-b33e9e13226f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a16d7eea72475e80296cbd67e5a82e', 'request_id': 'req-7fb980e6-2b5c-4aa3-96a3-b33e9e13226f'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:21.475617 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7fb980e6-2b5c-4aa3-96a3-b33e9e13226f admin admin] The token cache is being invalidate because project 56a16d7eea72475e80296cbd67e5a82e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:07:21.475919 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7fb980e6-2b5c-4aa3-96a3-b33e9e13226f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:21.476587 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-7fb980e6-2b5c-4aa3-96a3-b33e9e13226f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:21.478146 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1443/2843] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:07:21 2022] DELETE /identity/v3/projects/56a16d7eea72475e80296cbd67e5a82e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:07:21.485409 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20da7b5-70f7-48b4-b356-d67d75ec84ee None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:21.490020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20da7b5-70f7-48b4-b356-d67d75ec84ee None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:21.490020 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20da7b5-70f7-48b4-b356-d67d75ec84ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:21.508611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-b20da7b5-70f7-48b4-b356-d67d75ec84ee None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:21.509768 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b20da7b5-70f7-48b4-b356-d67d75ec84ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:21.576535 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1401/2844] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:21.586548 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27b568-ddd6-4f8f-8a02-6c371efe7c8f None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:21.586840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27b568-ddd6-4f8f-8a02-6c371efe7c8f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:21.587127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27b568-ddd6-4f8f-8a02-6c371efe7c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:21.608951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-bc27b568-ddd6-4f8f-8a02-6c371efe7c8f None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:21.610181 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-bc27b568-ddd6-4f8f-8a02-6c371efe7c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:21.618347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1444/2845] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:21.623770 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20da7b5-70f7-48b4-b356-d67d75ec84ee None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:21.634249 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20da7b5-70f7-48b4-b356-d67d75ec84ee None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:21.640264 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669634e1-9ce0-4503-b302-d227c91696d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:21.640896 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669634e1-9ce0-4503-b302-d227c91696d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:21.641180 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669634e1-9ce0-4503-b302-d227c91696d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:21.641465 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669634e1-9ce0-4503-b302-d227c91696d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:21.642128 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669634e1-9ce0-4503-b302-d227c91696d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:07:21.642440 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669634e1-9ce0-4503-b302-d227c91696d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:21.644099 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669634e1-9ce0-4503-b302-d227c91696d0 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:21.657612 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1402/2846] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:07:21.662079 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27b568-ddd6-4f8f-8a02-6c371efe7c8f None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:21.673081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27b568-ddd6-4f8f-8a02-6c371efe7c8f None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:21.677928 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e46b6-9d38-4aec-83bd-b593a391d8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:21.678558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e46b6-9d38-4aec-83bd-b593a391d8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:21.678838 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e46b6-9d38-4aec-83bd-b593a391d8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:21.679111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e46b6-9d38-4aec-83bd-b593a391d8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:21.679754 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e46b6-9d38-4aec-83bd-b593a391d8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:21.682017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e46b6-9d38-4aec-83bd-b593a391d8f6 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:21.797193 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1445/2847] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:07:21 2022] POST /identity/v3/projects => generated 399 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:07:21.801619 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669634e1-9ce0-4503-b302-d227c91696d0 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:21.813437 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669634e1-9ce0-4503-b302-d227c91696d0 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:21.879197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71b963-5f09-4679-8e99-3bc92c3340ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:21.879819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71b963-5f09-4679-8e99-3bc92c3340ba admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:21.880107 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71b963-5f09-4679-8e99-3bc92c3340ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:21.880430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71b963-5f09-4679-8e99-3bc92c3340ba admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:21.881082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71b963-5f09-4679-8e99-3bc92c3340ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:21.883053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71b963-5f09-4679-8e99-3bc92c3340ba admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:21.893554 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:21.991053 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1403/2848] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:07:21 2022] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:07:21.995529 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e46b6-9d38-4aec-83bd-b593a391d8f6 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:22.008775 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e46b6-9d38-4aec-83bd-b593a391d8f6 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:22.014078 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a4ef5-60ef-4512-bd2d-5573627c8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:22.014707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a4ef5-60ef-4512-bd2d-5573627c8e81 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:22.014991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a4ef5-60ef-4512-bd2d-5573627c8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:22.015265 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a4ef5-60ef-4512-bd2d-5573627c8e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:22.015966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a4ef5-60ef-4512-bd2d-5573627c8e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:22.017664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a4ef5-60ef-4512-bd2d-5573627c8e81 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:22.033269 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1446/2849] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:07:22.037893 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71b963-5f09-4679-8e99-3bc92c3340ba admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:22.050543 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71b963-5f09-4679-8e99-3bc92c3340ba admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:22.056401 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a52ade-95d1-410b-b095-abc1f46450b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:22.057105 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52ade-95d1-410b-b095-abc1f46450b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:22.057443 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52ade-95d1-410b-b095-abc1f46450b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:22.058040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52ade-95d1-410b-b095-abc1f46450b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:22.058645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a52ade-95d1-410b-b095-abc1f46450b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:22.061434 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a52ade-95d1-410b-b095-abc1f46450b4 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:22.072507 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1404/2850] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:07:22.078475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a4ef5-60ef-4512-bd2d-5573627c8e81 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:22.094322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a4ef5-60ef-4512-bd2d-5573627c8e81 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:22.099298 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e9a67-d1ab-4faa-8b2b-7aa1239ba090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:22.099969 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e9a67-d1ab-4faa-8b2b-7aa1239ba090 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:22.100278 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e9a67-d1ab-4faa-8b2b-7aa1239ba090 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:22.100554 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e9a67-d1ab-4faa-8b2b-7aa1239ba090 admin admin] PATH_INFO: `/v3/projects/70110fbaf4a2486fa8d8f55435a5cc4a/users/72fbb6fe99cb4fe080b2e444c2786ed6/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:22.117755 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e9a67-d1ab-4faa-8b2b-7aa1239ba090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70110fbaf4a2486fa8d8f55435a5cc4a, user_id=72fbb6fe99cb4fe080b2e444c2786ed6, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:22.120663 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e9a67-d1ab-4faa-8b2b-7aa1239ba090 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:22.264757 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1447/2851] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:07:22 2022] PUT /identity/v3/projects/70110fbaf4a2486fa8d8f55435a5cc4a/users/72fbb6fe99cb4fe080b2e444c2786ed6/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:22.282864 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c754c6-3a05-4c33-b18d-a2f698ddeb75 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:22.283154 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c754c6-3a05-4c33-b18d-a2f698ddeb75 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:22.283435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c754c6-3a05-4c33-b18d-a2f698ddeb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:22.314268 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-45c754c6-3a05-4c33-b18d-a2f698ddeb75 None None] MFA Rules not processed for user `72fbb6fe99cb4fe080b2e444c2786ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:22.315393 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-45c754c6-3a05-4c33-b18d-a2f698ddeb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:22.386311 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1405/2852] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:22 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:22.391470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e9a67-d1ab-4faa-8b2b-7aa1239ba090 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:22.426991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:22.462066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e9a67-d1ab-4faa-8b2b-7aa1239ba090 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:22.469483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739e664-c81c-46c5-adb1-0ed71b8d080f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:22.470197 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e664-c81c-46c5-adb1-0ed71b8d080f admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:22.470481 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e664-c81c-46c5-adb1-0ed71b8d080f admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:22.470756 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e664-c81c-46c5-adb1-0ed71b8d080f admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:22.471607 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739e664-c81c-46c5-adb1-0ed71b8d080f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:22.473574 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739e664-c81c-46c5-adb1-0ed71b8d080f admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:22.618209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1448/2853] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:07:22 2022] POST /identity/v3/projects => generated 401 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:07:22.622109 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c754c6-3a05-4c33-b18d-a2f698ddeb75 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:22.633568 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c754c6-3a05-4c33-b18d-a2f698ddeb75 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:22.714942 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a5894-6f72-47dc-b8ce-e0ace39931fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:22.715572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a5894-6f72-47dc-b8ce-e0ace39931fb admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:22.715847 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a5894-6f72-47dc-b8ce-e0ace39931fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:22.716154 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a5894-6f72-47dc-b8ce-e0ace39931fb admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:22.717381 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a5894-6f72-47dc-b8ce-e0ace39931fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:22.719299 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a5894-6f72-47dc-b8ce-e0ace39931fb admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:22.799275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1406/2854] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:07:22 2022] POST /identity/v3/users => generated 307 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:07:22.803335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739e664-c81c-46c5-adb1-0ed71b8d080f admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:22.814304 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739e664-c81c-46c5-adb1-0ed71b8d080f admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:22.819004 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136ddbe-10bd-4e9c-9271-f2e69614550e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:22.819611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136ddbe-10bd-4e9c-9271-f2e69614550e admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:22.819888 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136ddbe-10bd-4e9c-9271-f2e69614550e admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:22.820157 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136ddbe-10bd-4e9c-9271-f2e69614550e admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:22.820827 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136ddbe-10bd-4e9c-9271-f2e69614550e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:22.822415 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136ddbe-10bd-4e9c-9271-f2e69614550e admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:22.833862 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1449/2855] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:07:22.838191 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a5894-6f72-47dc-b8ce-e0ace39931fb admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:22.849479 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a5894-6f72-47dc-b8ce-e0ace39931fb admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:22.854389 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d89a78-4dfa-4658-a44c-f1be7ca45c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:22.855049 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d89a78-4dfa-4658-a44c-f1be7ca45c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:22.855331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d89a78-4dfa-4658-a44c-f1be7ca45c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:22.855607 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d89a78-4dfa-4658-a44c-f1be7ca45c53 admin admin] PATH_INFO: `/v3/projects/bf0115b7b2a147ea9158f860089c6329/users/b39f4db481e649ed85348ab7a0981b7c/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:22.871730 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d89a78-4dfa-4658-a44c-f1be7ca45c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0115b7b2a147ea9158f860089c6329, user_id=b39f4db481e649ed85348ab7a0981b7c, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:22.874550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d89a78-4dfa-4658-a44c-f1be7ca45c53 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:23.002691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1407/2856] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:07:22 2022] PUT /identity/v3/projects/bf0115b7b2a147ea9158f860089c6329/users/b39f4db481e649ed85348ab7a0981b7c/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:23.006744 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136ddbe-10bd-4e9c-9271-f2e69614550e admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:23.018027 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136ddbe-10bd-4e9c-9271-f2e69614550e admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:23.097154 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389b24c-94e2-471a-9559-1a4f3140d91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:23.097784 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389b24c-94e2-471a-9559-1a4f3140d91a admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:23.098071 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389b24c-94e2-471a-9559-1a4f3140d91a admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:23.098347 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389b24c-94e2-471a-9559-1a4f3140d91a admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:23.099011 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389b24c-94e2-471a-9559-1a4f3140d91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:23.100760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389b24c-94e2-471a-9559-1a4f3140d91a admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:23.112753 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1450/2857] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:07:23.117297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d89a78-4dfa-4658-a44c-f1be7ca45c53 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:23.129486 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d89a78-4dfa-4658-a44c-f1be7ca45c53 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:23.135278 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cd1ec-b24f-4590-9197-4d00e18f499f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:23.136225 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cd1ec-b24f-4590-9197-4d00e18f499f admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:23.136633 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cd1ec-b24f-4590-9197-4d00e18f499f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:23.137075 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cd1ec-b24f-4590-9197-4d00e18f499f admin admin] PATH_INFO: `/v3/projects/bf0115b7b2a147ea9158f860089c6329/users/b39f4db481e649ed85348ab7a0981b7c/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:23.139830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cd1ec-b24f-4590-9197-4d00e18f499f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0115b7b2a147ea9158f860089c6329, user_id=b39f4db481e649ed85348ab7a0981b7c, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:23.142732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cd1ec-b24f-4590-9197-4d00e18f499f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:23.154776 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1408/2858] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:07:23 2022] PUT /identity/v3/projects/bf0115b7b2a147ea9158f860089c6329/users/b39f4db481e649ed85348ab7a0981b7c/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:23.165843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985dee8-0676-4ee2-83bc-92e845c8853f None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:23.166123 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985dee8-0676-4ee2-83bc-92e845c8853f None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:23.166407 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985dee8-0676-4ee2-83bc-92e845c8853f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:23.199760 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-c985dee8-0676-4ee2-83bc-92e845c8853f None None] MFA Rules not processed for user `b39f4db481e649ed85348ab7a0981b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:23.201882 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-c985dee8-0676-4ee2-83bc-92e845c8853f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:23.279439 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1451/2859] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:23 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:23.290510 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cd1ec-b24f-4590-9197-4d00e18f499f admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:23.292297 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-a76cd1ec-b24f-4590-9197-4d00e18f499f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:23.320755 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:23.356046 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cd1ec-b24f-4590-9197-4d00e18f499f admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:23.360345 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8393d-af62-4ba2-8def-d5e4dd8d69df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:23.360966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8393d-af62-4ba2-8def-d5e4dd8d69df service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:23.361246 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8393d-af62-4ba2-8def-d5e4dd8d69df service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:23.361518 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8393d-af62-4ba2-8def-d5e4dd8d69df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:23.371969 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8393d-af62-4ba2-8def-d5e4dd8d69df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:23.374390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8393d-af62-4ba2-8def-d5e4dd8d69df service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:23.385872 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1409/2860] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:07:23 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:07:23.608743 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985dee8-0676-4ee2-83bc-92e845c8853f None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:23.618723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985dee8-0676-4ee2-83bc-92e845c8853f None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:23.622383 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851365b-b4a1-4bbe-951f-543bce3cb288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:23.623052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851365b-b4a1-4bbe-951f-543bce3cb288 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:23.623331 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851365b-b4a1-4bbe-951f-543bce3cb288 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:23.623601 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851365b-b4a1-4bbe-951f-543bce3cb288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:23.645979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:23.687113 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851365b-b4a1-4bbe-951f-543bce3cb288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:23.688768 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851365b-b4a1-4bbe-951f-543bce3cb288 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:23.699426 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1452/2861] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:07:23 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:07:28.906804 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8393d-af62-4ba2-8def-d5e4dd8d69df service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:28.975994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8393d-af62-4ba2-8def-d5e4dd8d69df service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:28.981497 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e25b7-81b2-44ef-baf0-1959a51bfa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:28.982703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e25b7-81b2-44ef-baf0-1959a51bfa3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:28.982703 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e25b7-81b2-44ef-baf0-1959a51bfa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:28.983329 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e25b7-81b2-44ef-baf0-1959a51bfa3f admin admin] PATH_INFO: `/v3/users/72fbb6fe99cb4fe080b2e444c2786ed6` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:28.984539 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e25b7-81b2-44ef-baf0-1959a51bfa3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=72fbb6fe99cb4fe080b2e444c2786ed6)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:28.986446 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e25b7-81b2-44ef-baf0-1959a51bfa3f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:29.188094 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-169e25b7-81b2-44ef-baf0-1959a51bfa3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72fbb6fe99cb4fe080b2e444c2786ed6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:29.188791 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-169e25b7-81b2-44ef-baf0-1959a51bfa3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72fbb6fe99cb4fe080b2e444c2786ed6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:29.189441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-169e25b7-81b2-44ef-baf0-1959a51bfa3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72fbb6fe99cb4fe080b2e444c2786ed6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:29.203664 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-169e25b7-81b2-44ef-baf0-1959a51bfa3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72fbb6fe99cb4fe080b2e444c2786ed6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:29.211049 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-169e25b7-81b2-44ef-baf0-1959a51bfa3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72fbb6fe99cb4fe080b2e444c2786ed6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:29.299457 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1410/2862] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:07:28 2022] DELETE /identity/v3/users/72fbb6fe99cb4fe080b2e444c2786ed6 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:29.304466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c132ff-f9d5-400d-b69b-4fef06f9a3dd None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:29.304992 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c132ff-f9d5-400d-b69b-4fef06f9a3dd None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:29.305184 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c132ff-f9d5-400d-b69b-4fef06f9a3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:29.325316 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-11c132ff-f9d5-400d-b69b-4fef06f9a3dd None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:29.326942 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-11c132ff-f9d5-400d-b69b-4fef06f9a3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:29.393375 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1453/2863] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:07:29.403726 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e25b7-81b2-44ef-baf0-1959a51bfa3f admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:29.406086 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-169e25b7-81b2-44ef-baf0-1959a51bfa3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:29.461622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:29.474391 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e25b7-81b2-44ef-baf0-1959a51bfa3f admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:29.478219 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90235690-80f6-40a7-b1c1-522da5fad500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:29.483276 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90235690-80f6-40a7-b1c1-522da5fad500 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:29.483276 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90235690-80f6-40a7-b1c1-522da5fad500 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:29.483276 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90235690-80f6-40a7-b1c1-522da5fad500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:29.490691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90235690-80f6-40a7-b1c1-522da5fad500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:29.492213 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90235690-80f6-40a7-b1c1-522da5fad500 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:29.503939 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1411/2864] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:07:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:07:29.945377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c132ff-f9d5-400d-b69b-4fef06f9a3dd None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:29.947166 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-11c132ff-f9d5-400d-b69b-4fef06f9a3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:29.961473 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c132ff-f9d5-400d-b69b-4fef06f9a3dd None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:29.968670 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09b52a-4029-41b8-9410-9cc1c865f143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:29.969434 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09b52a-4029-41b8-9410-9cc1c865f143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:29.969831 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09b52a-4029-41b8-9410-9cc1c865f143 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:29.970198 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09b52a-4029-41b8-9410-9cc1c865f143 admin admin] PATH_INFO: `/v3/projects/70110fbaf4a2486fa8d8f55435a5cc4a` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:29.971572 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09b52a-4029-41b8-9410-9cc1c865f143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70110fbaf4a2486fa8d8f55435a5cc4a)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:29.973526 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09b52a-4029-41b8-9410-9cc1c865f143 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:30.094453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1f09b52a-4029-41b8-9410-9cc1c865f143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70110fbaf4a2486fa8d8f55435a5cc4a', 'request_id': 'req-1f09b52a-4029-41b8-9410-9cc1c865f143'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:30.102555 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1f09b52a-4029-41b8-9410-9cc1c865f143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70110fbaf4a2486fa8d8f55435a5cc4a', 'request_id': 'req-1f09b52a-4029-41b8-9410-9cc1c865f143'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:30.111322 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1f09b52a-4029-41b8-9410-9cc1c865f143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70110fbaf4a2486fa8d8f55435a5cc4a', 'request_id': 'req-1f09b52a-4029-41b8-9410-9cc1c865f143'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:30.195611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1f09b52a-4029-41b8-9410-9cc1c865f143 admin admin] The token cache is being invalidate because project 70110fbaf4a2486fa8d8f55435a5cc4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:07:30.196102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1f09b52a-4029-41b8-9410-9cc1c865f143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:30.197204 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1f09b52a-4029-41b8-9410-9cc1c865f143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:30.200019 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1454/2865] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:07:29 2022] DELETE /identity/v3/projects/70110fbaf4a2486fa8d8f55435a5cc4a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:30.206616 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90235690-80f6-40a7-b1c1-522da5fad500 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:30.223142 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90235690-80f6-40a7-b1c1-522da5fad500 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:30.302255 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f477b-fab3-4753-b22a-129d9c1b19b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:30.302953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f477b-fab3-4753-b22a-129d9c1b19b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:30.303236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f477b-fab3-4753-b22a-129d9c1b19b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:30.303624 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f477b-fab3-4753-b22a-129d9c1b19b5 admin admin] PATH_INFO: `/v3/users/b39f4db481e649ed85348ab7a0981b7c` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:30.305856 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f477b-fab3-4753-b22a-129d9c1b19b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b39f4db481e649ed85348ab7a0981b7c)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:30.309359 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f477b-fab3-4753-b22a-129d9c1b19b5 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:30.500483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-609f477b-fab3-4753-b22a-129d9c1b19b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b39f4db481e649ed85348ab7a0981b7c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:30.501598 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-609f477b-fab3-4753-b22a-129d9c1b19b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b39f4db481e649ed85348ab7a0981b7c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:30.502384 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-609f477b-fab3-4753-b22a-129d9c1b19b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b39f4db481e649ed85348ab7a0981b7c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:30.518395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-609f477b-fab3-4753-b22a-129d9c1b19b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b39f4db481e649ed85348ab7a0981b7c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:30.526283 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-609f477b-fab3-4753-b22a-129d9c1b19b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b39f4db481e649ed85348ab7a0981b7c'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:30.614913 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1412/2866] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:07:30 2022] DELETE /identity/v3/users/b39f4db481e649ed85348ab7a0981b7c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:31.109688 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09b52a-4029-41b8-9410-9cc1c865f143 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:31.111206 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-1f09b52a-4029-41b8-9410-9cc1c865f143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:31.127121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09b52a-4029-41b8-9410-9cc1c865f143 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:31.182851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:31.198438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca03c64-9496-497a-bf42-62bbe6ebbdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:31.199087 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca03c64-9496-497a-bf42-62bbe6ebbdc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:31.199371 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca03c64-9496-497a-bf42-62bbe6ebbdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:31.199687 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca03c64-9496-497a-bf42-62bbe6ebbdc0 admin admin] PATH_INFO: `/v3/projects/bf0115b7b2a147ea9158f860089c6329` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:31.201441 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca03c64-9496-497a-bf42-62bbe6ebbdc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0115b7b2a147ea9158f860089c6329)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:31.203398 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca03c64-9496-497a-bf42-62bbe6ebbdc0 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:31.319100 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4ca03c64-9496-497a-bf42-62bbe6ebbdc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0115b7b2a147ea9158f860089c6329', 'request_id': 'req-4ca03c64-9496-497a-bf42-62bbe6ebbdc0'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:31.326847 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4ca03c64-9496-497a-bf42-62bbe6ebbdc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0115b7b2a147ea9158f860089c6329', 'request_id': 'req-4ca03c64-9496-497a-bf42-62bbe6ebbdc0'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:31.333866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4ca03c64-9496-497a-bf42-62bbe6ebbdc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0115b7b2a147ea9158f860089c6329', 'request_id': 'req-4ca03c64-9496-497a-bf42-62bbe6ebbdc0'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:31.412647 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4ca03c64-9496-497a-bf42-62bbe6ebbdc0 admin admin] The token cache is being invalidate because project bf0115b7b2a147ea9158f860089c6329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:07:31.412892 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4ca03c64-9496-497a-bf42-62bbe6ebbdc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:31.413483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-4ca03c64-9496-497a-bf42-62bbe6ebbdc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:07:31.414993 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1455/2867] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:07:31 2022] DELETE /identity/v3/projects/bf0115b7b2a147ea9158f860089c6329 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:31.420028 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a1809-c056-436c-a422-73013f989fbb None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:31.420915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a1809-c056-436c-a422-73013f989fbb None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:31.420915 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a1809-c056-436c-a422-73013f989fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:31.442582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-af6a1809-c056-436c-a422-73013f989fbb None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:31.443798 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-af6a1809-c056-436c-a422-73013f989fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:31.507587 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1413/2868] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:07:31.576954 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635631fb-56c5-4d77-8725-7f7875539773 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:31.577300 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635631fb-56c5-4d77-8725-7f7875539773 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:31.577616 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635631fb-56c5-4d77-8725-7f7875539773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:31.598101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-635631fb-56c5-4d77-8725-7f7875539773 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:31.599323 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-635631fb-56c5-4d77-8725-7f7875539773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:31.607997 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1456/2869] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:31.611691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a1809-c056-436c-a422-73013f989fbb None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:31.621633 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a1809-c056-436c-a422-73013f989fbb None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:31.626829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a0f9a-aee3-4a63-8de5-719a61a399d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:31.627460 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a0f9a-aee3-4a63-8de5-719a61a399d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:31.627736 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a0f9a-aee3-4a63-8de5-719a61a399d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:31.628005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a0f9a-aee3-4a63-8de5-719a61a399d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:31.628709 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a0f9a-aee3-4a63-8de5-719a61a399d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:07:31.629009 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a0f9a-aee3-4a63-8de5-719a61a399d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:31.630621 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a0f9a-aee3-4a63-8de5-719a61a399d8 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:31.632260 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:31.644472 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1414/2870] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:07:31.649074 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635631fb-56c5-4d77-8725-7f7875539773 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:31.658603 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635631fb-56c5-4d77-8725-7f7875539773 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:31.663463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba88a82-8182-41de-96b8-c62c76f75c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:31.664001 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba88a82-8182-41de-96b8-c62c76f75c95 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:31.664320 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba88a82-8182-41de-96b8-c62c76f75c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:31.664594 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba88a82-8182-41de-96b8-c62c76f75c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:31.665229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba88a82-8182-41de-96b8-c62c76f75c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:31.667133 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba88a82-8182-41de-96b8-c62c76f75c95 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:31.762931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1457/2871] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:07:31 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:07:31.767781 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a0f9a-aee3-4a63-8de5-719a61a399d8 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:31.779236 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a0f9a-aee3-4a63-8de5-719a61a399d8 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:31.840666 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277b4e1-23de-4a3d-8e80-9aafce556283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:31.841281 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277b4e1-23de-4a3d-8e80-9aafce556283 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:31.841821 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277b4e1-23de-4a3d-8e80-9aafce556283 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:31.841821 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277b4e1-23de-4a3d-8e80-9aafce556283 admin admin] PATH_INFO: `/v3/users` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:31.842519 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277b4e1-23de-4a3d-8e80-9aafce556283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:31.844435 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277b4e1-23de-4a3d-8e80-9aafce556283 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:31.967850 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1415/2872] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:07:31 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:07:31.972090 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba88a82-8182-41de-96b8-c62c76f75c95 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:31.983803 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba88a82-8182-41de-96b8-c62c76f75c95 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:31.988522 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde2b07-29a8-4ca1-b4b8-b1890b912f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:31.989139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde2b07-29a8-4ca1-b4b8-b1890b912f15 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:31.989418 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde2b07-29a8-4ca1-b4b8-b1890b912f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:31.989691 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde2b07-29a8-4ca1-b4b8-b1890b912f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:31.990368 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde2b07-29a8-4ca1-b4b8-b1890b912f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:31.992000 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde2b07-29a8-4ca1-b4b8-b1890b912f15 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:32.003747 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1458/2873] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:07:32.007837 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277b4e1-23de-4a3d-8e80-9aafce556283 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:32.019083 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277b4e1-23de-4a3d-8e80-9aafce556283 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:32.024150 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49609681-73f7-4eed-a03d-d747e7fbac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:32.024806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49609681-73f7-4eed-a03d-d747e7fbac0d admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:32.025091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49609681-73f7-4eed-a03d-d747e7fbac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:32.025369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49609681-73f7-4eed-a03d-d747e7fbac0d admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:32.026021 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49609681-73f7-4eed-a03d-d747e7fbac0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:32.027641 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49609681-73f7-4eed-a03d-d747e7fbac0d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:32.040407 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1416/2874] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:07:32.045261 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde2b07-29a8-4ca1-b4b8-b1890b912f15 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:32.056512 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde2b07-29a8-4ca1-b4b8-b1890b912f15 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:32.062171 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e64f85-246e-4bb1-9b3f-b5ab0c799f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:32.062851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e64f85-246e-4bb1-9b3f-b5ab0c799f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:32.063135 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e64f85-246e-4bb1-9b3f-b5ab0c799f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:32.063413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e64f85-246e-4bb1-9b3f-b5ab0c799f46 admin admin] PATH_INFO: `/v3/projects/cfb55a1b78b64a1f8c5f6789fa5a83db/users/b23d8c95c3764fbaa8a80bb4bb1b2b5b/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:32.079843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e64f85-246e-4bb1-9b3f-b5ab0c799f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb55a1b78b64a1f8c5f6789fa5a83db, user_id=b23d8c95c3764fbaa8a80bb4bb1b2b5b, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:32.082586 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e64f85-246e-4bb1-9b3f-b5ab0c799f46 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:32.201651 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1459/2875] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:07:32 2022] PUT /identity/v3/projects/cfb55a1b78b64a1f8c5f6789fa5a83db/users/b23d8c95c3764fbaa8a80bb4bb1b2b5b/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:07:32.206847 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84fc84-8e67-450d-ac4e-c61d13f5a041 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:32.207134 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84fc84-8e67-450d-ac4e-c61d13f5a041 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:32.207412 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84fc84-8e67-450d-ac4e-c61d13f5a041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:32.227954 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-7b84fc84-8e67-450d-ac4e-c61d13f5a041 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:32.229256 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7b84fc84-8e67-450d-ac4e-c61d13f5a041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:32.288697 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1417/2876] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:32.299551 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e64f85-246e-4bb1-9b3f-b5ab0c799f46 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:32.301302 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-65e64f85-246e-4bb1-9b3f-b5ab0c799f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:32.361665 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e64f85-246e-4bb1-9b3f-b5ab0c799f46 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:32.365452 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f01a0-effb-4560-9bf4-17b7a8a54257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:32.366056 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f01a0-effb-4560-9bf4-17b7a8a54257 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:32.366335 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f01a0-effb-4560-9bf4-17b7a8a54257 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:32.366605 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f01a0-effb-4560-9bf4-17b7a8a54257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:32.376228 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f01a0-effb-4560-9bf4-17b7a8a54257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:32.377819 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f01a0-effb-4560-9bf4-17b7a8a54257 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:32.387417 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1460/2877] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:07:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:07:33.667459 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43999c3c-7e44-4ed2-a60f-2ee404204a43 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:33.668078 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43999c3c-7e44-4ed2-a60f-2ee404204a43 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:33.668078 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43999c3c-7e44-4ed2-a60f-2ee404204a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:33.704081 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-43999c3c-7e44-4ed2-a60f-2ee404204a43 None None] MFA Rules not processed for user `b23d8c95c3764fbaa8a80bb4bb1b2b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:33.706240 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-43999c3c-7e44-4ed2-a60f-2ee404204a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:33.783057 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1418/2878] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:33.793985 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f01a0-effb-4560-9bf4-17b7a8a54257 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:33.795946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-604f01a0-effb-4560-9bf4-17b7a8a54257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:33.814520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:33.854017 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f01a0-effb-4560-9bf4-17b7a8a54257 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:33.858416 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fd740-a7ba-41f4-aaa5-8a5de171e0a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:33.859012 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fd740-a7ba-41f4-aaa5-8a5de171e0a2 service cinder] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:33.859289 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fd740-a7ba-41f4-aaa5-8a5de171e0a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:33.859558 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fd740-a7ba-41f4-aaa5-8a5de171e0a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:33.867682 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fd740-a7ba-41f4-aaa5-8a5de171e0a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:33.869140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fd740-a7ba-41f4-aaa5-8a5de171e0a2 service cinder] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:33.879108 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1461/2879] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:07:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:07:35.595259 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a470183-4f1b-48e4-937d-c1031a090dcd None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:35.595845 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a470183-4f1b-48e4-937d-c1031a090dcd None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:35.595845 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a470183-4f1b-48e4-937d-c1031a090dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:35.602973 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:35.618341 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-5a470183-4f1b-48e4-937d-c1031a090dcd None None] MFA Rules not processed for user `b23d8c95c3764fbaa8a80bb4bb1b2b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:35.620717 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5a470183-4f1b-48e4-937d-c1031a090dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:35.632830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1419/2880] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:43.927986 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=19 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:45.675121 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:54.558424 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaedc26-1e1a-44b7-a3b1-cb0d4541076a None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:54.560470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaedc26-1e1a-44b7-a3b1-cb0d4541076a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:54.560470 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaedc26-1e1a-44b7-a3b1-cb0d4541076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:54.578617 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-7aaedc26-1e1a-44b7-a3b1-cb0d4541076a None None] MFA Rules not processed for user `b23d8c95c3764fbaa8a80bb4bb1b2b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:07:54.579946 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-7aaedc26-1e1a-44b7-a3b1-cb0d4541076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:54.587275 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1462/2881] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:07:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:07:55.256757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a470183-4f1b-48e4-937d-c1031a090dcd None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:07:55.258265 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-5a470183-4f1b-48e4-937d-c1031a090dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:55.271091 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a470183-4f1b-48e4-937d-c1031a090dcd None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:07:55.274688 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562b88a-709c-4a8e-bf70-9567b3252772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:07:55.275326 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562b88a-709c-4a8e-bf70-9567b3252772 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:07:55.275600 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562b88a-709c-4a8e-bf70-9567b3252772 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:07:55.275866 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562b88a-709c-4a8e-bf70-9567b3252772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:07:55.277586 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b562b88a-709c-4a8e-bf70-9567b3252772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:07:55.353441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562b88a-709c-4a8e-bf70-9567b3252772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:07:55.354534 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562b88a-709c-4a8e-bf70-9567b3252772 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:07:55.367436 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1420/2882] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:07:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:08:02.393437 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaedc26-1e1a-44b7-a3b1-cb0d4541076a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:02.407169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaedc26-1e1a-44b7-a3b1-cb0d4541076a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:02.409436 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92b5dd-82df-4a80-b96b-1c85c26b2f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:02.410045 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92b5dd-82df-4a80-b96b-1c85c26b2f19 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:02.410337 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92b5dd-82df-4a80-b96b-1c85c26b2f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:02.410620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92b5dd-82df-4a80-b96b-1c85c26b2f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:02.412412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-0e92b5dd-82df-4a80-b96b-1c85c26b2f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:02.427866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92b5dd-82df-4a80-b96b-1c85c26b2f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:02.429370 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92b5dd-82df-4a80-b96b-1c85c26b2f19 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:02.441192 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1463/2883] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:08:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:08:05.361935 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=34 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:12.436238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=9 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:14.168674 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd115d-75e1-4c8b-8df5-697625110d06 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:14.168674 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd115d-75e1-4c8b-8df5-697625110d06 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:14.168674 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd115d-75e1-4c8b-8df5-697625110d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:14.215710 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-d8fd115d-75e1-4c8b-8df5-697625110d06 None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:14.216974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d8fd115d-75e1-4c8b-8df5-697625110d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:14.282331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1421/2884] 10.222.0.72 () {58 vars in 1009 bytes} [Mon Aug 29 23:08:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:08:14.323606 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92b5dd-82df-4a80-b96b-1c85c26b2f19 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:14.325091 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-0e92b5dd-82df-4a80-b96b-1c85c26b2f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:14.414308 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92b5dd-82df-4a80-b96b-1c85c26b2f19 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:14.419577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950844a-b3af-4c85-add1-b03511aee1ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:14.420123 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950844a-b3af-4c85-add1-b03511aee1ee service swift] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:14.420441 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950844a-b3af-4c85-add1-b03511aee1ee service swift] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:14.420720 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950844a-b3af-4c85-add1-b03511aee1ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:14.430248 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950844a-b3af-4c85-add1-b03511aee1ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:14.431839 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950844a-b3af-4c85-add1-b03511aee1ee service swift] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:14.439884 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1464/2885] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 23:08:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:08:24.279312 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=40 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:24.436715 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=41 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:30.438017 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd115d-75e1-4c8b-8df5-697625110d06 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:30.439582 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d8fd115d-75e1-4c8b-8df5-697625110d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:30.458994 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd115d-75e1-4c8b-8df5-697625110d06 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:30.467078 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b4a9c-c86d-480e-9105-01e9630d20e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:30.467685 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b4a9c-c86d-480e-9105-01e9630d20e7 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:30.468042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b4a9c-c86d-480e-9105-01e9630d20e7 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:30.468358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b4a9c-c86d-480e-9105-01e9630d20e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:30.470309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-e29b4a9c-c86d-480e-9105-01e9630d20e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:30.485951 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b4a9c-c86d-480e-9105-01e9630d20e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:30.489211 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b4a9c-c86d-480e-9105-01e9630d20e7 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:30.505377 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1422/2886] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:08:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:08:30.604410 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950844a-b3af-4c85-add1-b03511aee1ee service swift] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:30.617820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950844a-b3af-4c85-add1-b03511aee1ee service swift] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:30.621991 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26753144-c4e0-4d3d-a66b-89862b2e6936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:30.622614 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26753144-c4e0-4d3d-a66b-89862b2e6936 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:30.623081 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26753144-c4e0-4d3d-a66b-89862b2e6936 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:30.623428 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26753144-c4e0-4d3d-a66b-89862b2e6936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:30.626115 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-26753144-c4e0-4d3d-a66b-89862b2e6936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:30.638566 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26753144-c4e0-4d3d-a66b-89862b2e6936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:30.643937 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26753144-c4e0-4d3d-a66b-89862b2e6936 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:30.653377 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1465/2887] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:08:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:08:31.887868 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1ba9c-6dfd-4bd8-981a-196995811124 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:31.888416 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1ba9c-6dfd-4bd8-981a-196995811124 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:31.888529 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1ba9c-6dfd-4bd8-981a-196995811124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:31.908262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-0ad1ba9c-6dfd-4bd8-981a-196995811124 None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:31.910452 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0ad1ba9c-6dfd-4bd8-981a-196995811124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:31.928047 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1423/2888] 10.222.0.72 () {58 vars in 967 bytes} [Mon Aug 29 23:08:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:08:31.942661 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26753144-c4e0-4d3d-a66b-89862b2e6936 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:31.956866 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26753144-c4e0-4d3d-a66b-89862b2e6936 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:31.962573 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e7d5f-331b-4644-afda-045c2f3eb0cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:31.963234 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e7d5f-331b-4644-afda-045c2f3eb0cf service swift] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:31.963529 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e7d5f-331b-4644-afda-045c2f3eb0cf service swift] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:31.963825 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e7d5f-331b-4644-afda-045c2f3eb0cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:31.974134 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e7d5f-331b-4644-afda-045c2f3eb0cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:31.975734 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e7d5f-331b-4644-afda-045c2f3eb0cf service swift] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:31.985087 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1466/2889] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 23:08:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:08:34.984437 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1ba9c-6dfd-4bd8-981a-196995811124 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:34.985862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0ad1ba9c-6dfd-4bd8-981a-196995811124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:35.071237 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1ba9c-6dfd-4bd8-981a-196995811124 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:35.078275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68e9a1-1b97-4335-823c-b83bd7e2f5c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5fb88d96640089eba545f4c8d3c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:35.079144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68e9a1-1b97-4335-823c-b83bd7e2f5c0 service placement] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:35.079536 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68e9a1-1b97-4335-823c-b83bd7e2f5c0 service placement] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:35.079933 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68e9a1-1b97-4335-823c-b83bd7e2f5c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:35.082695 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-7f68e9a1-1b97-4335-823c-b83bd7e2f5c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:35.094811 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68e9a1-1b97-4335-823c-b83bd7e2f5c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:35.096469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68e9a1-1b97-4335-823c-b83bd7e2f5c0 service placement] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:35.108830 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1424/2890] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:08:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:08:35.117293 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e7d5f-331b-4644-afda-045c2f3eb0cf service swift] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:35.136648 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e7d5f-331b-4644-afda-045c2f3eb0cf service swift] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:35.142214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ceb7f1-4d1d-42fa-81c5-b3daf1d056c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:35.143102 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceb7f1-4d1d-42fa-81c5-b3daf1d056c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:35.143365 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceb7f1-4d1d-42fa-81c5-b3daf1d056c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:35.143698 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceb7f1-4d1d-42fa-81c5-b3daf1d056c4 admin admin] PATH_INFO: `/v3/users/b23d8c95c3764fbaa8a80bb4bb1b2b5b` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:35.145055 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ceb7f1-4d1d-42fa-81c5-b3daf1d056c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23d8c95c3764fbaa8a80bb4bb1b2b5b)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:35.146966 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ceb7f1-4d1d-42fa-81c5-b3daf1d056c4 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:35.355101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c1ceb7f1-4d1d-42fa-81c5-b3daf1d056c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23d8c95c3764fbaa8a80bb4bb1b2b5b'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:35.362794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c1ceb7f1-4d1d-42fa-81c5-b3daf1d056c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23d8c95c3764fbaa8a80bb4bb1b2b5b'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:35.452041 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c1ceb7f1-4d1d-42fa-81c5-b3daf1d056c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23d8c95c3764fbaa8a80bb4bb1b2b5b'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:35.452609 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c1ceb7f1-4d1d-42fa-81c5-b3daf1d056c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23d8c95c3764fbaa8a80bb4bb1b2b5b'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:35.465864 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-c1ceb7f1-4d1d-42fa-81c5-b3daf1d056c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23d8c95c3764fbaa8a80bb4bb1b2b5b'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:35.472766 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1467/2891] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:08:35 2022] DELETE /identity/v3/users/b23d8c95c3764fbaa8a80bb4bb1b2b5b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:08:35.747557 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68e9a1-1b97-4335-823c-b83bd7e2f5c0 service placement] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:35.758884 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68e9a1-1b97-4335-823c-b83bd7e2f5c0 service placement] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:35.822059 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe308ad-af2a-41e6-8caf-7f756ffa82a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:35.822687 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe308ad-af2a-41e6-8caf-7f756ffa82a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:35.822966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe308ad-af2a-41e6-8caf-7f756ffa82a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:35.823239 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe308ad-af2a-41e6-8caf-7f756ffa82a0 admin admin] PATH_INFO: `/v3/projects/cfb55a1b78b64a1f8c5f6789fa5a83db` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:35.824403 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe308ad-af2a-41e6-8caf-7f756ffa82a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfb55a1b78b64a1f8c5f6789fa5a83db)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:35.826320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe308ad-af2a-41e6-8caf-7f756ffa82a0 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:35.930168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-bbe308ad-af2a-41e6-8caf-7f756ffa82a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfb55a1b78b64a1f8c5f6789fa5a83db', 'request_id': 'req-bbe308ad-af2a-41e6-8caf-7f756ffa82a0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:35.985818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-bbe308ad-af2a-41e6-8caf-7f756ffa82a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfb55a1b78b64a1f8c5f6789fa5a83db', 'request_id': 'req-bbe308ad-af2a-41e6-8caf-7f756ffa82a0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:35.993622 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-bbe308ad-af2a-41e6-8caf-7f756ffa82a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfb55a1b78b64a1f8c5f6789fa5a83db', 'request_id': 'req-bbe308ad-af2a-41e6-8caf-7f756ffa82a0'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:36.000957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:36.010210 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-bbe308ad-af2a-41e6-8caf-7f756ffa82a0 admin admin] The token cache is being invalidate because project cfb55a1b78b64a1f8c5f6789fa5a83db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:08:36.010511 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-bbe308ad-af2a-41e6-8caf-7f756ffa82a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:36.011231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-bbe308ad-af2a-41e6-8caf-7f756ffa82a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:36.012841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1425/2892] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:08:35 2022] DELETE /identity/v3/projects/cfb55a1b78b64a1f8c5f6789fa5a83db => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:08:36.018329 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951af88c-04ac-48b3-a280-45df9e46d8a9 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:36.018625 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951af88c-04ac-48b3-a280-45df9e46d8a9 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:36.020358 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951af88c-04ac-48b3-a280-45df9e46d8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:36.040024 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-951af88c-04ac-48b3-a280-45df9e46d8a9 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:36.043344 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-951af88c-04ac-48b3-a280-45df9e46d8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:36.103954 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1468/2893] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:08:36.111522 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91697fe0-d72c-4a1e-a06c-3200422fc71b None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:36.111957 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91697fe0-d72c-4a1e-a06c-3200422fc71b None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:36.112275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91697fe0-d72c-4a1e-a06c-3200422fc71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:36.132854 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-91697fe0-d72c-4a1e-a06c-3200422fc71b None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:36.134063 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-91697fe0-d72c-4a1e-a06c-3200422fc71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:36.142005 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1426/2894] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:08:36.147111 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951af88c-04ac-48b3-a280-45df9e46d8a9 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:36.156843 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951af88c-04ac-48b3-a280-45df9e46d8a9 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:36.161871 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77909361-ceb1-4b0d-93ab-a68efebb1482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:36.162701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77909361-ceb1-4b0d-93ab-a68efebb1482 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:36.162854 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77909361-ceb1-4b0d-93ab-a68efebb1482 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:36.163015 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77909361-ceb1-4b0d-93ab-a68efebb1482 admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:36.163668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77909361-ceb1-4b0d-93ab-a68efebb1482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:36.163970 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77909361-ceb1-4b0d-93ab-a68efebb1482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:36.165628 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77909361-ceb1-4b0d-93ab-a68efebb1482 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:36.178156 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1469/2895] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:36.184089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91697fe0-d72c-4a1e-a06c-3200422fc71b None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:36.194008 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91697fe0-d72c-4a1e-a06c-3200422fc71b None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:36.198708 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419f1c2-0acd-476d-8d79-fd6a64a33aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:36.199302 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419f1c2-0acd-476d-8d79-fd6a64a33aed admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:36.199581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419f1c2-0acd-476d-8d79-fd6a64a33aed admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:36.199851 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419f1c2-0acd-476d-8d79-fd6a64a33aed admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:36.200565 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419f1c2-0acd-476d-8d79-fd6a64a33aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:36.202451 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419f1c2-0acd-476d-8d79-fd6a64a33aed admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:36.293757 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1427/2896] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:08:36 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:36.294561 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77909361-ceb1-4b0d-93ab-a68efebb1482 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:36.305128 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77909361-ceb1-4b0d-93ab-a68efebb1482 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:36.337793 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:36.378622 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5794b5-f92a-4b69-b958-0c70407e937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:36.379256 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5794b5-f92a-4b69-b958-0c70407e937d admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:36.379538 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5794b5-f92a-4b69-b958-0c70407e937d admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:36.379812 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5794b5-f92a-4b69-b958-0c70407e937d admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:36.380545 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5794b5-f92a-4b69-b958-0c70407e937d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:36.382480 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5794b5-f92a-4b69-b958-0c70407e937d admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:36.473667 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1470/2897] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:08:36 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:36.478245 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419f1c2-0acd-476d-8d79-fd6a64a33aed admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:36.489196 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419f1c2-0acd-476d-8d79-fd6a64a33aed admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:36.493895 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603f5f3-495b-4c6d-8e59-8119a0c539a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:36.494488 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603f5f3-495b-4c6d-8e59-8119a0c539a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:36.494765 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603f5f3-495b-4c6d-8e59-8119a0c539a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:36.495034 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603f5f3-495b-4c6d-8e59-8119a0c539a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:36.495675 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603f5f3-495b-4c6d-8e59-8119a0c539a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:36.497288 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603f5f3-495b-4c6d-8e59-8119a0c539a0 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:36.511829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1428/2898] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:08:36.516028 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5794b5-f92a-4b69-b958-0c70407e937d admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:36.527643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5794b5-f92a-4b69-b958-0c70407e937d admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:36.532296 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9c50f-6bed-4982-b525-b455b5752566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:36.532890 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9c50f-6bed-4982-b525-b455b5752566 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:36.533168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9c50f-6bed-4982-b525-b455b5752566 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:36.533441 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9c50f-6bed-4982-b525-b455b5752566 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:36.535074 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9c50f-6bed-4982-b525-b455b5752566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:36.536692 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9c50f-6bed-4982-b525-b455b5752566 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:36.546673 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1471/2899] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:08:36.551196 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603f5f3-495b-4c6d-8e59-8119a0c539a0 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:36.561649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603f5f3-495b-4c6d-8e59-8119a0c539a0 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:36.567430 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74085a09-bdee-41db-83ab-8d1225a6b773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:36.568089 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74085a09-bdee-41db-83ab-8d1225a6b773 admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:36.568420 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74085a09-bdee-41db-83ab-8d1225a6b773 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:36.568702 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74085a09-bdee-41db-83ab-8d1225a6b773 admin admin] PATH_INFO: `/v3/projects/a28479ceba304d35910c4c3304270d53/users/258a965fe60c4e9e8779d76b7e80f152/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:36.584953 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74085a09-bdee-41db-83ab-8d1225a6b773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28479ceba304d35910c4c3304270d53, user_id=258a965fe60c4e9e8779d76b7e80f152, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:36.587564 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74085a09-bdee-41db-83ab-8d1225a6b773 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:36.668431 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1429/2900] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:08:36 2022] PUT /identity/v3/projects/a28479ceba304d35910c4c3304270d53/users/258a965fe60c4e9e8779d76b7e80f152/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:08:36.679139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d5883-d0c1-466c-be3c-423812016891 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:36.679707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d5883-d0c1-466c-be3c-423812016891 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:36.679981 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d5883-d0c1-466c-be3c-423812016891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:36.709482 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-e83d5883-d0c1-466c-be3c-423812016891 None None] MFA Rules not processed for user `258a965fe60c4e9e8779d76b7e80f152`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:36.710830 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-e83d5883-d0c1-466c-be3c-423812016891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:36.777438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1472/2901] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:08:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:08:36.788513 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74085a09-bdee-41db-83ab-8d1225a6b773 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:36.790231 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-74085a09-bdee-41db-83ab-8d1225a6b773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:36.849806 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74085a09-bdee-41db-83ab-8d1225a6b773 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:36.853514 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbdf7b-0e05-4963-bbcb-dae3550676f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e187bd54667a46c4a234d4aff23e1777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:36.854118 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbdf7b-0e05-4963-bbcb-dae3550676f6 service cinder] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:36.854395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbdf7b-0e05-4963-bbcb-dae3550676f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:36.854664 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbdf7b-0e05-4963-bbcb-dae3550676f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:36.863616 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbdf7b-0e05-4963-bbcb-dae3550676f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:36.865040 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbdf7b-0e05-4963-bbcb-dae3550676f6 service cinder] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:36.873592 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1430/2902] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:08:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:08:41.549327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443f925-9856-4f4f-9d11-afd6d2490e4a None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:41.549327 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443f925-9856-4f4f-9d11-afd6d2490e4a None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:41.550034 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443f925-9856-4f4f-9d11-afd6d2490e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:41.571739 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-0443f925-9856-4f4f-9d11-afd6d2490e4a None None] MFA Rules not processed for user `e7b1650890fe409091ddbc881ee28973`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:41.573105 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-0443f925-9856-4f4f-9d11-afd6d2490e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:41.631694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1473/2903] 10.222.0.72 () {58 vars in 967 bytes} [Mon Aug 29 23:08:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:08:41.644902 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbdf7b-0e05-4963-bbcb-dae3550676f6 service cinder] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:41.646331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c3cbdf7b-0e05-4963-bbcb-dae3550676f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:41.722740 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbdf7b-0e05-4963-bbcb-dae3550676f6 service cinder] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:41.727841 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15469d-719c-49e8-9351-1550f98f7888 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94511ad9ee7a4ab0b70d8d5098079886', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:41.728478 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15469d-719c-49e8-9351-1550f98f7888 service swift] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:41.728759 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15469d-719c-49e8-9351-1550f98f7888 service swift] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:41.729032 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15469d-719c-49e8-9351-1550f98f7888 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:41.737901 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15469d-719c-49e8-9351-1550f98f7888 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:41.739473 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15469d-719c-49e8-9351-1550f98f7888 service swift] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:41.747948 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1431/2904] 10.222.0.72 () {60 vars in 1384 bytes} [Mon Aug 29 23:08:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:08:48.678262 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443f925-9856-4f4f-9d11-afd6d2490e4a None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:48.738246 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:48.755533 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443f925-9856-4f4f-9d11-afd6d2490e4a None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:48.760643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a621934-7c97-4483-a1a4-0428b3370aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:48.761344 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621934-7c97-4483-a1a4-0428b3370aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:48.761637 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621934-7c97-4483-a1a4-0428b3370aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:48.761941 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621934-7c97-4483-a1a4-0428b3370aa0 admin admin] PATH_INFO: `/v3/users/258a965fe60c4e9e8779d76b7e80f152` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:48.763137 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a621934-7c97-4483-a1a4-0428b3370aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=258a965fe60c4e9e8779d76b7e80f152)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:48.765179 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a621934-7c97-4483-a1a4-0428b3370aa0 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:48.982517 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-6a621934-7c97-4483-a1a4-0428b3370aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '258a965fe60c4e9e8779d76b7e80f152'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:48.991537 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-6a621934-7c97-4483-a1a4-0428b3370aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '258a965fe60c4e9e8779d76b7e80f152'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:49.074577 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-6a621934-7c97-4483-a1a4-0428b3370aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '258a965fe60c4e9e8779d76b7e80f152'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:49.075475 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-6a621934-7c97-4483-a1a4-0428b3370aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '258a965fe60c4e9e8779d76b7e80f152'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:49.089411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-6a621934-7c97-4483-a1a4-0428b3370aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '258a965fe60c4e9e8779d76b7e80f152'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:49.096637 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1474/2905] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:08:48 2022] DELETE /identity/v3/users/258a965fe60c4e9e8779d76b7e80f152 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:08:49.101611 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c165b-4bd5-42a5-8ea9-961eb05e6ed3 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:49.102193 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c165b-4bd5-42a5-8ea9-961eb05e6ed3 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:49.102380 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c165b-4bd5-42a5-8ea9-961eb05e6ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:49.124455 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-509c165b-4bd5-42a5-8ea9-961eb05e6ed3 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:49.125937 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-509c165b-4bd5-42a5-8ea9-961eb05e6ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:49.139784 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:49.187417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1432/2906] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:08:49.197168 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a621934-7c97-4483-a1a4-0428b3370aa0 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:49.198564 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-6a621934-7c97-4483-a1a4-0428b3370aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:49.258653 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a621934-7c97-4483-a1a4-0428b3370aa0 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:49.262277 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea64d8-ee14-4c37-8016-d175df6f1f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:49.262943 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea64d8-ee14-4c37-8016-d175df6f1f44 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:49.263224 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea64d8-ee14-4c37-8016-d175df6f1f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:49.263520 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea64d8-ee14-4c37-8016-d175df6f1f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:49.274086 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea64d8-ee14-4c37-8016-d175df6f1f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:49.276413 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea64d8-ee14-4c37-8016-d175df6f1f44 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:49.285794 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1475/2907] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:08:50.006207 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c165b-4bd5-42a5-8ea9-961eb05e6ed3 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:50.007640 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-509c165b-4bd5-42a5-8ea9-961eb05e6ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:50.030836 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c165b-4bd5-42a5-8ea9-961eb05e6ed3 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:50.051682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5588587-d57c-40c8-a5fe-44b44ef05a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:50.051682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5588587-d57c-40c8-a5fe-44b44ef05a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:50.051682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5588587-d57c-40c8-a5fe-44b44ef05a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:50.051682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5588587-d57c-40c8-a5fe-44b44ef05a82 admin admin] PATH_INFO: `/v3/projects/a28479ceba304d35910c4c3304270d53` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:50.052390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5588587-d57c-40c8-a5fe-44b44ef05a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28479ceba304d35910c4c3304270d53)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:50.054322 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5588587-d57c-40c8-a5fe-44b44ef05a82 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:50.194465 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c5588587-d57c-40c8-a5fe-44b44ef05a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28479ceba304d35910c4c3304270d53', 'request_id': 'req-c5588587-d57c-40c8-a5fe-44b44ef05a82'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:50.256706 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c5588587-d57c-40c8-a5fe-44b44ef05a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28479ceba304d35910c4c3304270d53', 'request_id': 'req-c5588587-d57c-40c8-a5fe-44b44ef05a82'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:50.266466 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c5588587-d57c-40c8-a5fe-44b44ef05a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28479ceba304d35910c4c3304270d53', 'request_id': 'req-c5588587-d57c-40c8-a5fe-44b44ef05a82'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:50.278604 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c5588587-d57c-40c8-a5fe-44b44ef05a82 admin admin] The token cache is being invalidate because project a28479ceba304d35910c4c3304270d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:08:50.278986 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c5588587-d57c-40c8-a5fe-44b44ef05a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:50.279826 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-c5588587-d57c-40c8-a5fe-44b44ef05a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:50.281581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1433/2908] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:08:50 2022] DELETE /identity/v3/projects/a28479ceba304d35910c4c3304270d53 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:08:50.860332 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea64d8-ee14-4c37-8016-d175df6f1f44 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:50.862412 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-64ea64d8-ee14-4c37-8016-d175df6f1f44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:50.878267 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea64d8-ee14-4c37-8016-d175df6f1f44 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:50.936605 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a11b49-76f3-4b67-b1ed-970fad9883b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:50.937241 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11b49-76f3-4b67-b1ed-970fad9883b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:50.937521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11b49-76f3-4b67-b1ed-970fad9883b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:50.937798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11b49-76f3-4b67-b1ed-970fad9883b6 admin admin] PATH_INFO: `/v3/users/71c94932b7e2480c88103e141e46d004` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:50.938945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a11b49-76f3-4b67-b1ed-970fad9883b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c94932b7e2480c88103e141e46d004)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:50.940915 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a11b49-76f3-4b67-b1ed-970fad9883b6 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:50.951140 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:51.130136 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-81a11b49-76f3-4b67-b1ed-970fad9883b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c94932b7e2480c88103e141e46d004'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:51.136855 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-81a11b49-76f3-4b67-b1ed-970fad9883b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c94932b7e2480c88103e141e46d004'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:51.208031 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-81a11b49-76f3-4b67-b1ed-970fad9883b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c94932b7e2480c88103e141e46d004'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:51.208678 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-81a11b49-76f3-4b67-b1ed-970fad9883b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c94932b7e2480c88103e141e46d004'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:51.221571 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-81a11b49-76f3-4b67-b1ed-970fad9883b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c94932b7e2480c88103e141e46d004'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:51.227632 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1476/2909] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:08:50 2022] DELETE /identity/v3/users/71c94932b7e2480c88103e141e46d004 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:08:51.484153 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5588587-d57c-40c8-a5fe-44b44ef05a82 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:51.493266 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-c5588587-d57c-40c8-a5fe-44b44ef05a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:51.500639 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5588587-d57c-40c8-a5fe-44b44ef05a82 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:51.559462 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ada6f2-8a6b-44a3-b401-3462e7ada98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:51.560092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ada6f2-8a6b-44a3-b401-3462e7ada98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:51.560399 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ada6f2-8a6b-44a3-b401-3462e7ada98f admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:51.560668 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ada6f2-8a6b-44a3-b401-3462e7ada98f admin admin] PATH_INFO: `/v3/projects/f7de45ba5d124e2daf13d96cd1ec6c18` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:51.561771 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ada6f2-8a6b-44a3-b401-3462e7ada98f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7de45ba5d124e2daf13d96cd1ec6c18)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:51.563634 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ada6f2-8a6b-44a3-b401-3462e7ada98f admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:51.664329 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:51.667203 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-01ada6f2-8a6b-44a3-b401-3462e7ada98f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7de45ba5d124e2daf13d96cd1ec6c18', 'request_id': 'req-01ada6f2-8a6b-44a3-b401-3462e7ada98f'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:51.728070 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-01ada6f2-8a6b-44a3-b401-3462e7ada98f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7de45ba5d124e2daf13d96cd1ec6c18', 'request_id': 'req-01ada6f2-8a6b-44a3-b401-3462e7ada98f'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:51.734872 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-01ada6f2-8a6b-44a3-b401-3462e7ada98f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7de45ba5d124e2daf13d96cd1ec6c18', 'request_id': 'req-01ada6f2-8a6b-44a3-b401-3462e7ada98f'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:51.745449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-01ada6f2-8a6b-44a3-b401-3462e7ada98f admin admin] The token cache is being invalidate because project f7de45ba5d124e2daf13d96cd1ec6c18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:08:51.745732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-01ada6f2-8a6b-44a3-b401-3462e7ada98f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:51.746395 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-01ada6f2-8a6b-44a3-b401-3462e7ada98f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:51.747888 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1434/2910] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:08:51 2022] DELETE /identity/v3/projects/f7de45ba5d124e2daf13d96cd1ec6c18 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:08:51.752169 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a11b49-76f3-4b67-b1ed-970fad9883b6 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:51.753777 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-81a11b49-76f3-4b67-b1ed-970fad9883b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:51.768479 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a11b49-76f3-4b67-b1ed-970fad9883b6 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:51.831850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef617a8-94ff-4c79-abdf-ed59e3018adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:51.832519 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef617a8-94ff-4c79-abdf-ed59e3018adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:51.832798 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef617a8-94ff-4c79-abdf-ed59e3018adb admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:51.833068 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef617a8-94ff-4c79-abdf-ed59e3018adb admin admin] PATH_INFO: `/v3/users/819893e347ac40fc9548590416d20f8a` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:51.834209 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef617a8-94ff-4c79-abdf-ed59e3018adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=819893e347ac40fc9548590416d20f8a)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:51.836159 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef617a8-94ff-4c79-abdf-ed59e3018adb admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:52.091597 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-3ef617a8-94ff-4c79-abdf-ed59e3018adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '819893e347ac40fc9548590416d20f8a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:52.098781 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-3ef617a8-94ff-4c79-abdf-ed59e3018adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '819893e347ac40fc9548590416d20f8a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:52.161924 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-3ef617a8-94ff-4c79-abdf-ed59e3018adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '819893e347ac40fc9548590416d20f8a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:52.162637 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-3ef617a8-94ff-4c79-abdf-ed59e3018adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '819893e347ac40fc9548590416d20f8a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:52.176883 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-3ef617a8-94ff-4c79-abdf-ed59e3018adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '819893e347ac40fc9548590416d20f8a'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:52.183710 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1477/2911] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:08:51 2022] DELETE /identity/v3/users/819893e347ac40fc9548590416d20f8a => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:08:52.425500 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ada6f2-8a6b-44a3-b401-3462e7ada98f admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:52.427633 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-01ada6f2-8a6b-44a3-b401-3462e7ada98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:52.442649 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ada6f2-8a6b-44a3-b401-3462e7ada98f admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:52.504530 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8123d6-fccb-4e55-adbf-77cb462fc01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:52.505300 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8123d6-fccb-4e55-adbf-77cb462fc01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:52.505441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8123d6-fccb-4e55-adbf-77cb462fc01a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:52.505711 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8123d6-fccb-4e55-adbf-77cb462fc01a admin admin] PATH_INFO: `/v3/projects/cbde6b2f485a47799e7d8216ac8f8431` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:52.506879 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8123d6-fccb-4e55-adbf-77cb462fc01a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbde6b2f485a47799e7d8216ac8f8431)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:52.509007 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8123d6-fccb-4e55-adbf-77cb462fc01a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:52.626753 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-ea8123d6-fccb-4e55-adbf-77cb462fc01a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbde6b2f485a47799e7d8216ac8f8431', 'request_id': 'req-ea8123d6-fccb-4e55-adbf-77cb462fc01a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:52.699468 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-ea8123d6-fccb-4e55-adbf-77cb462fc01a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbde6b2f485a47799e7d8216ac8f8431', 'request_id': 'req-ea8123d6-fccb-4e55-adbf-77cb462fc01a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:52.706664 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-ea8123d6-fccb-4e55-adbf-77cb462fc01a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbde6b2f485a47799e7d8216ac8f8431', 'request_id': 'req-ea8123d6-fccb-4e55-adbf-77cb462fc01a'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:52.717335 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-ea8123d6-fccb-4e55-adbf-77cb462fc01a admin admin] The token cache is being invalidate because project cbde6b2f485a47799e7d8216ac8f8431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:08:52.717625 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-ea8123d6-fccb-4e55-adbf-77cb462fc01a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:52.718270 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-ea8123d6-fccb-4e55-adbf-77cb462fc01a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:08:52.719842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1435/2912] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:08:52 2022] DELETE /identity/v3/projects/cbde6b2f485a47799e7d8216ac8f8431 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:08:52.725673 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe6dd3-d4ad-4fda-91bc-283a07351da9 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:52.725958 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe6dd3-d4ad-4fda-91bc-283a07351da9 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:52.726240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe6dd3-d4ad-4fda-91bc-283a07351da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:52.740979 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:52.747205 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-cafe6dd3-d4ad-4fda-91bc-283a07351da9 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:52.749844 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-cafe6dd3-d4ad-4fda-91bc-283a07351da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:52.810142 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1478/2913] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:08:52.818138 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3eb5c-7c36-4b7a-9fe6-2d18be86d664 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:52.818432 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3eb5c-7c36-4b7a-9fe6-2d18be86d664 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:52.818712 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3eb5c-7c36-4b7a-9fe6-2d18be86d664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:52.838795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-2bc3eb5c-7c36-4b7a-9fe6-2d18be86d664 None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:52.841861 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-2bc3eb5c-7c36-4b7a-9fe6-2d18be86d664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:52.848701 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1436/2914] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:08:52.852886 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe6dd3-d4ad-4fda-91bc-283a07351da9 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:52.863427 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe6dd3-d4ad-4fda-91bc-283a07351da9 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:52.868026 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90f1f5-27b1-4265-b17c-ac79dbdd104e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:52.871463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90f1f5-27b1-4265-b17c-ac79dbdd104e admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:52.871463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90f1f5-27b1-4265-b17c-ac79dbdd104e admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:52.871463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90f1f5-27b1-4265-b17c-ac79dbdd104e admin admin] PATH_INFO: `/v3/domains` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:52.871463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90f1f5-27b1-4265-b17c-ac79dbdd104e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:52.871463 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90f1f5-27b1-4265-b17c-ac79dbdd104e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:52.871945 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90f1f5-27b1-4265-b17c-ac79dbdd104e admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:52.883486 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1479/2915] 10.222.0.72 () {58 vars in 1153 bytes} [Mon Aug 29 23:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:52.887820 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3eb5c-7c36-4b7a-9fe6-2d18be86d664 None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:52.897552 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3eb5c-7c36-4b7a-9fe6-2d18be86d664 None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:52.902417 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254c018-9a11-47a6-9ab1-e2b89018d489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:52.903037 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254c018-9a11-47a6-9ab1-e2b89018d489 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:52.903319 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254c018-9a11-47a6-9ab1-e2b89018d489 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:52.903619 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254c018-9a11-47a6-9ab1-e2b89018d489 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:52.904333 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254c018-9a11-47a6-9ab1-e2b89018d489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:52.906256 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254c018-9a11-47a6-9ab1-e2b89018d489 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:53.007767 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1437/2916] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:08:52 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:53.012589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90f1f5-27b1-4265-b17c-ac79dbdd104e admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:53.024236 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90f1f5-27b1-4265-b17c-ac79dbdd104e admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:53.086270 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71418-ecae-4031-98ed-483997b25e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:53.086878 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71418-ecae-4031-98ed-483997b25e76 admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.087161 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71418-ecae-4031-98ed-483997b25e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.087432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71418-ecae-4031-98ed-483997b25e76 admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.088095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb71418-ecae-4031-98ed-483997b25e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:53.090052 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb71418-ecae-4031-98ed-483997b25e76 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:53.202521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1480/2917] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:08:53 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:53.211334 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254c018-9a11-47a6-9ab1-e2b89018d489 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:53.222492 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254c018-9a11-47a6-9ab1-e2b89018d489 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:53.227840 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fac8c2-a3dc-4651-9d49-583d44546ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:53.228504 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fac8c2-a3dc-4651-9d49-583d44546ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.228819 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fac8c2-a3dc-4651-9d49-583d44546ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.229092 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fac8c2-a3dc-4651-9d49-583d44546ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.229732 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fac8c2-a3dc-4651-9d49-583d44546ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:53.231310 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fac8c2-a3dc-4651-9d49-583d44546ad6 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:53.241484 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1438/2918] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:08:53.245657 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71418-ecae-4031-98ed-483997b25e76 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:53.256108 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71418-ecae-4031-98ed-483997b25e76 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:53.260751 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dd07d-636f-47ae-b21f-44f7f5a5bed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:53.261337 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dd07d-636f-47ae-b21f-44f7f5a5bed4 admin admin] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.261615 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dd07d-636f-47ae-b21f-44f7f5a5bed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.261885 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dd07d-636f-47ae-b21f-44f7f5a5bed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.262544 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dd07d-636f-47ae-b21f-44f7f5a5bed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:53.264129 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dd07d-636f-47ae-b21f-44f7f5a5bed4 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:53.275500 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1481/2919] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:08:53.279429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fac8c2-a3dc-4651-9d49-583d44546ad6 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:53.290103 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fac8c2-a3dc-4651-9d49-583d44546ad6 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:53.294802 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0b3a8-655c-4e68-9ad2-5246323a161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:53.295449 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0b3a8-655c-4e68-9ad2-5246323a161d admin admin] REQUEST_METHOD: `PUT` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.295773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0b3a8-655c-4e68-9ad2-5246323a161d admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.296051 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0b3a8-655c-4e68-9ad2-5246323a161d admin admin] PATH_INFO: `/v3/projects/e1ccd358234d4c92b01b9395211db162/users/a10617abc7db4c57b6d6b0eb6229904e/roles/bebe72a018ea47b992e9e6715060fadb` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.311163 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0b3a8-655c-4e68-9ad2-5246323a161d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ccd358234d4c92b01b9395211db162, user_id=a10617abc7db4c57b6d6b0eb6229904e, role_id=bebe72a018ea47b992e9e6715060fadb)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:53.313836 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0b3a8-655c-4e68-9ad2-5246323a161d admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:53.386292 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:53.391274 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1439/2920] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:08:53 2022] PUT /identity/v3/projects/e1ccd358234d4c92b01b9395211db162/users/a10617abc7db4c57b6d6b0eb6229904e/roles/bebe72a018ea47b992e9e6715060fadb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:08:53.396443 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaba6d6-0ede-470b-a6a2-be5712993a8d None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.402101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaba6d6-0ede-470b-a6a2-be5712993a8d None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.402101 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaba6d6-0ede-470b-a6a2-be5712993a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.416177 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-1eaba6d6-0ede-470b-a6a2-be5712993a8d None None] MFA Rules not processed for user `179ea3f8c1ea4c8fb5be02793b645d99`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:53.417400 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-1eaba6d6-0ede-470b-a6a2-be5712993a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:53.479669 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1482/2921] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:08:53.490852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0b3a8-655c-4e68-9ad2-5246323a161d admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:53.493864 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-57a0b3a8-655c-4e68-9ad2-5246323a161d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:53.551922 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0b3a8-655c-4e68-9ad2-5246323a161d admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:53.555868 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05511d7-01ff-41d4-9587-0ff8c02fd95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:53.556517 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05511d7-01ff-41d4-9587-0ff8c02fd95d service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.556795 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05511d7-01ff-41d4-9587-0ff8c02fd95d service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.557066 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05511d7-01ff-41d4-9587-0ff8c02fd95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.566551 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05511d7-01ff-41d4-9587-0ff8c02fd95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:53.567963 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05511d7-01ff-41d4-9587-0ff8c02fd95d service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:53.577454 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1440/2922] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:08:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:08:59.066026 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdb955-3e23-4ebc-9723-f760019f5549 None None] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:59.066466 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdb955-3e23-4ebc-9723-f760019f5549 None None] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:59.066568 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdb955-3e23-4ebc-9723-f760019f5549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:59.093684 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:59.098213 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.auth.core [None req-59fdb955-3e23-4ebc-9723-f760019f5549 None None] MFA Rules not processed for user `a10617abc7db4c57b6d6b0eb6229904e`. Rule list: `[]` (Enabled: `True`). {{(pid=88552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:59.099483 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-59fdb955-3e23-4ebc-9723-f760019f5549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:59.171133 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1483/2923] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:08:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:08:59.176572 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05511d7-01ff-41d4-9587-0ff8c02fd95d service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:59.186682 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05511d7-01ff-41d4-9587-0ff8c02fd95d service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:59.192262 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238bc0c-4e19-4d10-9059-86af1f32be22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:59.193751 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238bc0c-4e19-4d10-9059-86af1f32be22 admin admin] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:59.194034 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238bc0c-4e19-4d10-9059-86af1f32be22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:59.194309 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238bc0c-4e19-4d10-9059-86af1f32be22 admin admin] PATH_INFO: `/v3/projects` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:59.195168 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238bc0c-4e19-4d10-9059-86af1f32be22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:59.197197 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238bc0c-4e19-4d10-9059-86af1f32be22 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:59.296254 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1441/2924] 10.222.0.72 () {60 vars in 1153 bytes} [Mon Aug 29 23:08:59 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:59.301345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdb955-3e23-4ebc-9723-f760019f5549 None None] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:59.313773 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdb955-3e23-4ebc-9723-f760019f5549 None None] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:59.371964 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027602e2-7853-4cc2-8808-dcd79d7deccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:59.372608 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027602e2-7853-4cc2-8808-dcd79d7deccc admin admin] REQUEST_METHOD: `POST` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:59.372887 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027602e2-7853-4cc2-8808-dcd79d7deccc admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:59.373155 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027602e2-7853-4cc2-8808-dcd79d7deccc admin admin] PATH_INFO: `/v3/users` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:59.373797 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027602e2-7853-4cc2-8808-dcd79d7deccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:59.375723 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027602e2-7853-4cc2-8808-dcd79d7deccc admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:59.478357 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1484/2925] 10.222.0.72 () {60 vars in 1144 bytes} [Mon Aug 29 23:08:59 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:59.482580 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238bc0c-4e19-4d10-9059-86af1f32be22 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:59.495150 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238bc0c-4e19-4d10-9059-86af1f32be22 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:59.500279 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b42a4-c2cf-4884-8865-574ed21d1c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:59.500939 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b42a4-c2cf-4884-8865-574ed21d1c00 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:59.501267 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b42a4-c2cf-4884-8865-574ed21d1c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:59.501581 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b42a4-c2cf-4884-8865-574ed21d1c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:59.502507 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b42a4-c2cf-4884-8865-574ed21d1c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:59.504396 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b42a4-c2cf-4884-8865-574ed21d1c00 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:59.516074 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1442/2926] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:08:59.521048 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027602e2-7853-4cc2-8808-dcd79d7deccc admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:59.532414 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027602e2-7853-4cc2-8808-dcd79d7deccc admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:59.538405 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289b4a8-3ac6-4ed4-b294-48d580218217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:59.539121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289b4a8-3ac6-4ed4-b294-48d580218217 admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:59.539441 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289b4a8-3ac6-4ed4-b294-48d580218217 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:59.539743 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289b4a8-3ac6-4ed4-b294-48d580218217 admin admin] PATH_INFO: `/v3/projects/c267799e77704618a5b4ec9e010e2afd/users/4576ea69d2984ffb89f42efbcc189dd6/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:59.557066 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289b4a8-3ac6-4ed4-b294-48d580218217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c267799e77704618a5b4ec9e010e2afd, user_id=4576ea69d2984ffb89f42efbcc189dd6, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:59.560026 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289b4a8-3ac6-4ed4-b294-48d580218217 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:59.654820 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1485/2927] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:08:59 2022] PUT /identity/v3/projects/c267799e77704618a5b4ec9e010e2afd/users/4576ea69d2984ffb89f42efbcc189dd6/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:08:59.660082 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b42a4-c2cf-4884-8865-574ed21d1c00 admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:59.671546 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b42a4-c2cf-4884-8865-574ed21d1c00 admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:59.733815 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f6103-4a87-4865-8c2f-3f97be704528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:59.734346 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f6103-4a87-4865-8c2f-3f97be704528 admin admin] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:59.734629 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f6103-4a87-4865-8c2f-3f97be704528 admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:59.734929 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f6103-4a87-4865-8c2f-3f97be704528 admin admin] PATH_INFO: `/v3/roles` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:59.735550 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f6103-4a87-4865-8c2f-3f97be704528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:59.737716 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f6103-4a87-4865-8c2f-3f97be704528 admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:59.751190 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1443/2928] 10.222.0.72 () {58 vars in 1122 bytes} [Mon Aug 29 23:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:08:59.753233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289b4a8-3ac6-4ed4-b294-48d580218217 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:59.764261 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289b4a8-3ac6-4ed4-b294-48d580218217 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:59.769707 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f64f72-23ac-4d8a-9556-8fafee21a89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:59.770668 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f64f72-23ac-4d8a-9556-8fafee21a89c admin admin] REQUEST_METHOD: `PUT` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:59.770951 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f64f72-23ac-4d8a-9556-8fafee21a89c admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:59.771229 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f64f72-23ac-4d8a-9556-8fafee21a89c admin admin] PATH_INFO: `/v3/projects/c267799e77704618a5b4ec9e010e2afd/users/4576ea69d2984ffb89f42efbcc189dd6/roles/6cf3bd9974754c428f17420e0643bc17` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:59.773274 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f64f72-23ac-4d8a-9556-8fafee21a89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c267799e77704618a5b4ec9e010e2afd, user_id=4576ea69d2984ffb89f42efbcc189dd6, role_id=6cf3bd9974754c428f17420e0643bc17)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:59.775962 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f64f72-23ac-4d8a-9556-8fafee21a89c admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:59.787701 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1486/2929] 10.222.0.72 () {60 vars in 1483 bytes} [Mon Aug 29 23:08:59 2022] PUT /identity/v3/projects/c267799e77704618a5b4ec9e010e2afd/users/4576ea69d2984ffb89f42efbcc189dd6/roles/6cf3bd9974754c428f17420e0643bc17 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:09:05.477073 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12518c20-fc87-44ce-a5ea-f68343922155 None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:05.477519 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12518c20-fc87-44ce-a5ea-f68343922155 None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:05.477661 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12518c20-fc87-44ce-a5ea-f68343922155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:05.519039 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-12518c20-fc87-44ce-a5ea-f68343922155 None None] MFA Rules not processed for user `4576ea69d2984ffb89f42efbcc189dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:05.519228 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-12518c20-fc87-44ce-a5ea-f68343922155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:05.580645 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:05.602512 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1444/2930] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:09:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:09:05.620672 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f64f72-23ac-4d8a-9556-8fafee21a89c admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:05.622719 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-75f64f72-23ac-4d8a-9556-8fafee21a89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:05.689357 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:05.710453 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f64f72-23ac-4d8a-9556-8fafee21a89c admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:05.716735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f0a64-48c6-48e2-9c91-f207d637ac6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:05.717380 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f0a64-48c6-48e2-9c91-f207d637ac6c service nova] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:05.717683 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f0a64-48c6-48e2-9c91-f207d637ac6c service nova] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:05.717936 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f0a64-48c6-48e2-9c91-f207d637ac6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:05.780038 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f0a64-48c6-48e2-9c91-f207d637ac6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:05.781689 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f0a64-48c6-48e2-9c91-f207d637ac6c service nova] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:05.794911 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1487/2931] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:09:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:09:08.626985 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf507648-0705-468c-8154-82de998c934d None None] REQUEST_METHOD: `POST` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:08.627660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf507648-0705-468c-8154-82de998c934d None None] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:08.627660 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf507648-0705-468c-8154-82de998c934d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:08.648852 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.auth.core [None req-bf507648-0705-468c-8154-82de998c934d None None] MFA Rules not processed for user `a10617abc7db4c57b6d6b0eb6229904e`. Rule list: `[]` (Enabled: `True`). {{(pid=88553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:08.650045 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-bf507648-0705-468c-8154-82de998c934d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:08.656750 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1445/2932] 10.222.0.72 () {58 vars in 958 bytes} [Mon Aug 29 23:09:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:09:15.862620 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=31 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:18.645647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=7 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:25.524894 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f0a64-48c6-48e2-9c91-f207d637ac6c service nova] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:25.526621 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-559f0a64-48c6-48e2-9c91-f207d637ac6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:25.600871 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f0a64-48c6-48e2-9c91-f207d637ac6c service nova] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:25.605932 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fbd7d-92e3-41c1-b6aa-e32dc1d3f826 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5fb88d96640089eba545f4c8d3c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:25.606567 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fbd7d-92e3-41c1-b6aa-e32dc1d3f826 service placement] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:25.606850 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fbd7d-92e3-41c1-b6aa-e32dc1d3f826 service placement] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:25.607127 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fbd7d-92e3-41c1-b6aa-e32dc1d3f826 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:25.608886 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-f70fbd7d-92e3-41c1-b6aa-e32dc1d3f826 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:25.621744 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fbd7d-92e3-41c1-b6aa-e32dc1d3f826 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:25.623254 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fbd7d-92e3-41c1-b6aa-e32dc1d3f826 service placement] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:25.634763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1488/2933] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:09:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:09:35.629903 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=32 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:36.977820 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf507648-0705-468c-8154-82de998c934d None None] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:36.979319 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-bf507648-0705-468c-8154-82de998c934d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:36.998316 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf507648-0705-468c-8154-82de998c934d None None] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:37.004035 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2508a-2dc2-4dc7-8580-f64227284848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be09bd9ba7443aaa31879f56ca4aad1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:37.004691 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2508a-2dc2-4dc7-8580-f64227284848 service nova] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:37.004971 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2508a-2dc2-4dc7-8580-f64227284848 service nova] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:37.005243 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2508a-2dc2-4dc7-8580-f64227284848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:37.007043 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-61b2508a-2dc2-4dc7-8580-f64227284848 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:37.020415 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2508a-2dc2-4dc7-8580-f64227284848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:37.022162 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2508a-2dc2-4dc7-8580-f64227284848 service nova] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:37.034669 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1446/2934] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:09:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:09:39.975020 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fbd7d-92e3-41c1-b6aa-e32dc1d3f826 service placement] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:40.030083 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fbd7d-92e3-41c1-b6aa-e32dc1d3f826 service placement] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:40.033684 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bb8d1-67ae-41c0-905a-98a136a94ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:40.034290 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb8d1-67ae-41c0-905a-98a136a94ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:40.034565 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb8d1-67ae-41c0-905a-98a136a94ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:40.034835 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb8d1-67ae-41c0-905a-98a136a94ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:40.044345 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bb8d1-67ae-41c0-905a-98a136a94ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:40.045763 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bb8d1-67ae-41c0-905a-98a136a94ac8 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:40.056244 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1489/2935] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:09:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:09:47.029702 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=6 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:50.051016 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=26 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:07.044970 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2508a-2dc2-4dc7-8580-f64227284848 service nova] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:07.046348 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-61b2508a-2dc2-4dc7-8580-f64227284848 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:07.060647 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2508a-2dc2-4dc7-8580-f64227284848 service nova] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:07.066640 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1ea3f-1f3d-4a34-a5d5-00b65d0dc142 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5fb88d96640089eba545f4c8d3c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:07.067225 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1ea3f-1f3d-4a34-a5d5-00b65d0dc142 service placement] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:07.067526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1ea3f-1f3d-4a34-a5d5-00b65d0dc142 service placement] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:07.067799 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1ea3f-1f3d-4a34-a5d5-00b65d0dc142 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:07.069620 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-29f1ea3f-1f3d-4a34-a5d5-00b65d0dc142 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:07.081042 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1ea3f-1f3d-4a34-a5d5-00b65d0dc142 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:07.083258 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1ea3f-1f3d-4a34-a5d5-00b65d0dc142 service placement] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:07.093214 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1447/2936] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:11:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:11:17.089032 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=6 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:53.726095 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bb8d1-67ae-41c0-905a-98a136a94ac8 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:53.735187 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bb8d1-67ae-41c0-905a-98a136a94ac8 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:53.739600 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc2c5c-ac1f-46cc-a152-96f6e4533010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:53.740339 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc2c5c-ac1f-46cc-a152-96f6e4533010 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:53.740521 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc2c5c-ac1f-46cc-a152-96f6e4533010 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:53.740792 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc2c5c-ac1f-46cc-a152-96f6e4533010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:53.742705 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-2cdc2c5c-ac1f-46cc-a152-96f6e4533010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:53.753899 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc2c5c-ac1f-46cc-a152-96f6e4533010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:53.755780 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc2c5c-ac1f-46cc-a152-96f6e4533010 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:53.764611 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1490/2937] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:11:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:11:54.147728 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1ea3f-1f3d-4a34-a5d5-00b65d0dc142 service placement] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:54.158441 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1ea3f-1f3d-4a34-a5d5-00b65d0dc142 service placement] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:54.162966 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6194955-5e5e-44ae-8255-925e181eedf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:54.163859 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6194955-5e5e-44ae-8255-925e181eedf6 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:54.164390 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6194955-5e5e-44ae-8255-925e181eedf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:54.164887 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6194955-5e5e-44ae-8255-925e181eedf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:54.167331 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-d6194955-5e5e-44ae-8255-925e181eedf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:54.180797 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6194955-5e5e-44ae-8255-925e181eedf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:54.182483 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6194955-5e5e-44ae-8255-925e181eedf6 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:54.190862 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1448/2938] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:11:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:11:54.301089 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc2c5c-ac1f-46cc-a152-96f6e4533010 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:54.310783 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc2c5c-ac1f-46cc-a152-96f6e4533010 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:54.314691 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c5dc1-6b5e-4432-8810-3427276e42aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:54.319438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c5dc1-6b5e-4432-8810-3427276e42aa service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:54.319438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c5dc1-6b5e-4432-8810-3427276e42aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:54.319438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c5dc1-6b5e-4432-8810-3427276e42aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:54.319438 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-5c9c5dc1-6b5e-4432-8810-3427276e42aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:54.332159 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c5dc1-6b5e-4432-8810-3427276e42aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:54.333658 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c5dc1-6b5e-4432-8810-3427276e42aa service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:54.345040 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1491/2939] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:11:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:12:04.187125 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=6 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:04.339926 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=12 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:19.796592 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6194955-5e5e-44ae-8255-925e181eedf6 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:19.806526 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6194955-5e5e-44ae-8255-925e181eedf6 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:19.810320 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bc94a-d2c8-4069-a520-45321a480ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:19.810929 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bc94a-d2c8-4069-a520-45321a480ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:19.819842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bc94a-d2c8-4069-a520-45321a480ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:19.819842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bc94a-d2c8-4069-a520-45321a480ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:19.819842 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b02bc94a-d2c8-4069-a520-45321a480ce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:13:19.828383 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bc94a-d2c8-4069-a520-45321a480ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:19.829805 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bc94a-d2c8-4069-a520-45321a480ce9 service neutron] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:19.843635 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1449/2940] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:13:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:13:22.228346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c5dc1-6b5e-4432-8810-3427276e42aa service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:22.237277 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c5dc1-6b5e-4432-8810-3427276e42aa service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:22.241237 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18389a0-cd2f-4fcf-bcff-485aa5d41342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380c6683b4ab4d08a6cf377e620439e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:22.241851 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18389a0-cd2f-4fcf-bcff-485aa5d41342 service neutron] REQUEST_METHOD: `GET` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:22.242136 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18389a0-cd2f-4fcf-bcff-485aa5d41342 service neutron] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:22.242411 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18389a0-cd2f-4fcf-bcff-485aa5d41342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:22.244214 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-d18389a0-cd2f-4fcf-bcff-485aa5d41342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:13:22.259664 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18389a0-cd2f-4fcf-bcff-485aa5d41342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:22.261150 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18389a0-cd2f-4fcf-bcff-485aa5d41342 service neutron] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:22.274477 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1492/2941] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:13:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:13:29.837978 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=6 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:32.268139 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=6 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:32.423829 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bc94a-d2c8-4069-a520-45321a480ce9 service neutron] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:32.487469 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bc94a-d2c8-4069-a520-45321a480ce9 service neutron] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:32.492358 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432835c-0d40-46af-933f-989b7d39e47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:32.493000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432835c-0d40-46af-933f-989b7d39e47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:32.493290 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432835c-0d40-46af-933f-989b7d39e47a admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:32.493591 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432835c-0d40-46af-933f-989b7d39e47a admin admin] PATH_INFO: `/v3/users/a10617abc7db4c57b6d6b0eb6229904e` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:32.494719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432835c-0d40-46af-933f-989b7d39e47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10617abc7db4c57b6d6b0eb6229904e)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:32.496719 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432835c-0d40-46af-933f-989b7d39e47a admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:32.682949 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0432835c-0d40-46af-933f-989b7d39e47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10617abc7db4c57b6d6b0eb6229904e'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:32.683596 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0432835c-0d40-46af-933f-989b7d39e47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10617abc7db4c57b6d6b0eb6229904e'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:32.684275 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0432835c-0d40-46af-933f-989b7d39e47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10617abc7db4c57b6d6b0eb6229904e'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:32.696773 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0432835c-0d40-46af-933f-989b7d39e47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10617abc7db4c57b6d6b0eb6229904e'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:32.703698 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-0432835c-0d40-46af-933f-989b7d39e47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10617abc7db4c57b6d6b0eb6229904e'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:32.794458 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1450/2942] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:13:32 2022] DELETE /identity/v3/users/a10617abc7db4c57b6d6b0eb6229904e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:13:33.054931 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18389a0-cd2f-4fcf-bcff-485aa5d41342 service neutron] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:33.067375 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18389a0-cd2f-4fcf-bcff-485aa5d41342 service neutron] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:33.134392 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de92acd-1870-4e54-bda4-ee5f758e6e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:33.135028 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92acd-1870-4e54-bda4-ee5f758e6e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:33.135314 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92acd-1870-4e54-bda4-ee5f758e6e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:33.135589 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92acd-1870-4e54-bda4-ee5f758e6e47 admin admin] PATH_INFO: `/v3/projects/e1ccd358234d4c92b01b9395211db162` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:33.136749 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de92acd-1870-4e54-bda4-ee5f758e6e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ccd358234d4c92b01b9395211db162)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:33.138643 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de92acd-1870-4e54-bda4-ee5f758e6e47 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:33.292429 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1de92acd-1870-4e54-bda4-ee5f758e6e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ccd358234d4c92b01b9395211db162', 'request_id': 'req-1de92acd-1870-4e54-bda4-ee5f758e6e47'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:33.299840 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1de92acd-1870-4e54-bda4-ee5f758e6e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ccd358234d4c92b01b9395211db162', 'request_id': 'req-1de92acd-1870-4e54-bda4-ee5f758e6e47'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:33.305694 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1de92acd-1870-4e54-bda4-ee5f758e6e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ccd358234d4c92b01b9395211db162', 'request_id': 'req-1de92acd-1870-4e54-bda4-ee5f758e6e47'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:33.371711 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1de92acd-1870-4e54-bda4-ee5f758e6e47 admin admin] The token cache is being invalidate because project e1ccd358234d4c92b01b9395211db162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:13:33.372062 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1de92acd-1870-4e54-bda4-ee5f758e6e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:33.372868 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-1de92acd-1870-4e54-bda4-ee5f758e6e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:33.379752 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1493/2943] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:13:33 2022] DELETE /identity/v3/projects/e1ccd358234d4c92b01b9395211db162 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:13:33.379910 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432835c-0d40-46af-933f-989b7d39e47a admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:33.381144 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-0432835c-0d40-46af-933f-989b7d39e47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:13:33.398000 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432835c-0d40-46af-933f-989b7d39e47a admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:33.457730 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6011328-b66b-4ca5-b138-da74d2294dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:33.458429 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6011328-b66b-4ca5-b138-da74d2294dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:33.458630 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6011328-b66b-4ca5-b138-da74d2294dac admin admin] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:33.458903 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6011328-b66b-4ca5-b138-da74d2294dac admin admin] PATH_INFO: `/v3/users/4576ea69d2984ffb89f42efbcc189dd6` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:33.460052 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6011328-b66b-4ca5-b138-da74d2294dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4576ea69d2984ffb89f42efbcc189dd6)` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:33.462029 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6011328-b66b-4ca5-b138-da74d2294dac admin admin] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:33.484657 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:33.688154 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b6011328-b66b-4ca5-b138-da74d2294dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4576ea69d2984ffb89f42efbcc189dd6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:33.688818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b6011328-b66b-4ca5-b138-da74d2294dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4576ea69d2984ffb89f42efbcc189dd6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:33.689426 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b6011328-b66b-4ca5-b138-da74d2294dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4576ea69d2984ffb89f42efbcc189dd6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:33.701350 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b6011328-b66b-4ca5-b138-da74d2294dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4576ea69d2984ffb89f42efbcc189dd6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:33.708974 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.notifications [None req-b6011328-b66b-4ca5-b138-da74d2294dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4576ea69d2984ffb89f42efbcc189dd6'} {{(pid=88553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:33.765549 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1451/2944] 10.222.0.72 () {58 vars in 1224 bytes} [Mon Aug 29 23:13:33 2022] DELETE /identity/v3/users/4576ea69d2984ffb89f42efbcc189dd6 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:13:34.030785 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de92acd-1870-4e54-bda4-ee5f758e6e47 admin admin] Authenticating user token {{(pid=88552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:34.032233 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.fernet_utils [None req-1de92acd-1870-4e54-bda4-ee5f758e6e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:13:34.050432 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de92acd-1870-4e54-bda4-ee5f758e6e47 admin admin] Validating token access rules against request {{(pid=88552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:34.115238 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239b2c7-8a3d-44a6-a36d-65a5a53559a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179ea3f8c1ea4c8fb5be02793b645d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c5435e2f5ae455ab9a7fc1e7c010ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:34.115909 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239b2c7-8a3d-44a6-a36d-65a5a53559a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:34.116210 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239b2c7-8a3d-44a6-a36d-65a5a53559a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:34.116505 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239b2c7-8a3d-44a6-a36d-65a5a53559a6 admin admin] PATH_INFO: `/v3/projects/c267799e77704618a5b4ec9e010e2afd` {{(pid=88552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:34.117641 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239b2c7-8a3d-44a6-a36d-65a5a53559a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c267799e77704618a5b4ec9e010e2afd)` {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:34.119594 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239b2c7-8a3d-44a6-a36d-65a5a53559a6 admin admin] RBAC: Authorization granted {{(pid=88552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:34.212835 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:34.225552 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b239b2c7-8a3d-44a6-a36d-65a5a53559a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c267799e77704618a5b4ec9e010e2afd', 'request_id': 'req-b239b2c7-8a3d-44a6-a36d-65a5a53559a6'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:34.231870 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b239b2c7-8a3d-44a6-a36d-65a5a53559a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c267799e77704618a5b4ec9e010e2afd', 'request_id': 'req-b239b2c7-8a3d-44a6-a36d-65a5a53559a6'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:34.237493 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b239b2c7-8a3d-44a6-a36d-65a5a53559a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c267799e77704618a5b4ec9e010e2afd', 'request_id': 'req-b239b2c7-8a3d-44a6-a36d-65a5a53559a6'} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:34.313863 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b239b2c7-8a3d-44a6-a36d-65a5a53559a6 admin admin] The token cache is being invalidate because project c267799e77704618a5b4ec9e010e2afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:13:34.315121 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b239b2c7-8a3d-44a6-a36d-65a5a53559a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:34.315240 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG keystone.notifications [None req-b239b2c7-8a3d-44a6-a36d-65a5a53559a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:13:34.316735 dv-cinder-854271-4-smb devstack@keystone.service[88552]: [pid: 88552|app: 0|req: 1494/2945] 10.222.0.72 () {58 vars in 1233 bytes} [Mon Aug 29 23:13:34 2022] DELETE /identity/v3/projects/c267799e77704618a5b4ec9e010e2afd => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:13:43.761805 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:44.474346 dv-cinder-854271-4-smb devstack@keystone.service[88552]: DEBUG dbcounter [-] [88552] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:12.003369 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6011328-b66b-4ca5-b138-da74d2294dac admin admin] Authenticating user token {{(pid=88553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:12.004818 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-b6011328-b66b-4ca5-b138-da74d2294dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:12.149185 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6011328-b66b-4ca5-b138-da74d2294dac admin admin] Validating token access rules against request {{(pid=88553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:12.207404 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eee1d8-db52-448a-9889-aca295082d48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5fb88d96640089eba545f4c8d3c44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abc4d6c6e004b15abff7738164175db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:12.208011 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eee1d8-db52-448a-9889-aca295082d48 service placement] REQUEST_METHOD: `GET` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:12.208332 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eee1d8-db52-448a-9889-aca295082d48 service placement] SCRIPT_NAME: `/identity` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:12.208639 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eee1d8-db52-448a-9889-aca295082d48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:12.210363 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.fernet_utils [None req-80eee1d8-db52-448a-9889-aca295082d48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:12.221506 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eee1d8-db52-448a-9889-aca295082d48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:12.223097 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eee1d8-db52-448a-9889-aca295082d48 service placement] RBAC: Authorization granted {{(pid=88553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:12.233627 dv-cinder-854271-4-smb devstack@keystone.service[88553]: [pid: 88553|app: 0|req: 1452/2946] 10.222.0.72 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:22.229349 dv-cinder-854271-4-smb devstack@keystone.service[88553]: DEBUG dbcounter [-] [88553] Writing DB stats keystone:SELECT=89 {{(pid=88553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}